v1v2v3 (latest)

Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks

15 August 2016

Yossi Adi

Papers citing "Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks"

50 / 359 papers shown

Title
Embedded Named Entity Recognition using Probing ClassifiersConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Nicholas Popovic Michael Färber 188 3 0 18 Mar 2024
Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched TextInternational Conference on Language Resources and Evaluation (LREC), 2024 Frances Adriana Laureano De Leon Harish Tayyar Madabushi Mark Lee 179 7 0 07 Mar 2024
What has LeBenchmark Learnt about French Syntax? Zdravko Dugonjić Adrien Pupier Benjamin Lecouteux Maximin Coavoux 126 1 0 04 Mar 2024
Topic Aware Probing: From Sentence Length Prediction to Idiom Identification how reliant are Neural Language Models on Topic? Vasudevan Nedumpozhimana John D. Kelleher 155 2 0 04 Mar 2024
CausalGym: Benchmarking causal interpretability methods on linguistic tasks Aryaman Arora Daniel Jurafsky Christopher Potts 157 33 0 19 Feb 2024
Metric Learning Encoding Models: A Multivariate Framework for Interpreting Neural Representations Louis Jalouzot Robin Sobczyk Bastien Lhopitallier Jeanne Salle 170 3 0 18 Feb 2024
Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications Boyi Wei Kaixuan Huang Yangsibo Huang Tinghao Xie Xiangyu Qi Mengzhou Xia Prateek Mittal Mengdi Wang Peter Henderson AAML 259 166 0 07 Feb 2024
Deep de Finetti: Recovering Topic Distributions from Large Language Models Liyi Zhang R. Thomas McCoy T. Sumers Jian-Qiao Zhu Thomas Griffiths BDL 185 8 0 21 Dec 2023
The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction Pratyusha Sharma Jordan T. Ash Dipendra Kumar Misra LRM 192 111 0 21 Dec 2023
INSPECT: Intrinsic and Systematic Probing Evaluation for Code TransformersIEEE Transactions on Software Engineering (TSE), 2023 Anjan Karmakar Romain Robbes 185 5 0 08 Dec 2023
Compositional Fusion of Signals in Data Embedding Zhijin Guo Zhaozhen Xu Martha Lewis N. Cristianini 132 0 0 18 Nov 2023
Probing LLMs for Joint Encoding of Linguistic CategoriesConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Giulio Starace Konstantinos Papakostas Rochelle Choenni Apostolos Panagiotopoulos Matteo Rosati Alina Leidinger Ekaterina Shutova 209 12 0 28 Oct 2023
Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Ahmed Alajrami Katerina Margatina Nikolaos Aletras AAML 124 2 0 26 Oct 2023
Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model TrainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Max Müller-Eberstein Rob van der Goot Barbara Plank Ivan Titov 205 15 0 25 Oct 2023
Is Probing All You Need? Indicator Tasks as an Alternative to Probing Embedding SpacesConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Tal Levy Omer Goldman Reut Tsarfaty 150 5 0 24 Oct 2023
Probing Representations for Document-level Event ExtractionConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Barry Wang Xinya Du Claire Cardie 87 2 0 23 Oct 2023
Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject NumberConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Sophie Hao Tal Linzen 134 6 0 23 Oct 2023
Understanding the Inner Workings of Language Models Through Representation DissimilarityConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Davis Brown Charles Godfrey Nicholas Konz Jonathan Tu Henry Kvinge 179 12 0 23 Oct 2023
Transparency at the Source: Evaluating and Interpreting Language Models With Access to the True DistributionConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Jaap Jumelet Willem H. Zuidema 236 8 0 23 Oct 2023
The Locality and Symmetry of Positional Encodings Lihu Chen Gaël Varoquaux Fabian M. Suchanek 158 1 0 19 Oct 2023
Rethinking the Construction of Effective Metrics for Understanding the Mechanisms of Pretrained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 You Li Jinhui Yin Yuming Lin 139 0 0 19 Oct 2023
From Neural Activations to Concepts: A Survey on Explaining Concepts in Neural Networks Jae Hee Lee Sergio Lanza Stefan Wermter 186 17 0 18 Oct 2023
The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Aviv Slobodkin Omer Goldman Avi Caciularu Ido Dagan Haiqin Yang HILM LRM 218 43 0 18 Oct 2023
Disentangling the Linguistic Competence of Privacy-Preserving BERTBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2023 Stefan Arnold Nils Kemmerzell Annika Schreiner 216 0 0 17 Oct 2023
On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language ModelsFindings (Findings), 2023 Thilini Wijesiriwardene Ruwan Wickramarachchi Aishwarya N. Reganti Vinija Jain Vasu Sharma Amit P. Sheth Amitava Das 270 2 0 11 Oct 2023
Establishing Trustworthiness: Rethinking Tasks and Model EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Robert Litschko Max Müller-Eberstein Rob van der Goot Leon Weber Barbara Plank LRM 170 3 0 09 Oct 2023
Observatory: Characterizing Embeddings of Relational TablesProceedings of the VLDB Endowment (PVLDB), 2023 Tianji Cong Madelon Hulsebos Zhenjie Sun Paul Groth H. V. Jagadish 263 16 0 05 Oct 2023
Why do universal adversarial attacks work on large language models?: Geometry might be the answer Varshini Subhash Anna Bialas Weiwei Pan Finale Doshi-Velez AAML 161 16 0 01 Sep 2023
Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP Vedant Palit Rohan Pandey Aryaman Arora Paul Pu Liang 208 43 0 27 Aug 2023
Social World Knowledge: Modeling and ApplicationsPLoS ONE (PLoS ONE), 2023 Nir Lotan Einat Minkov 137 4 0 28 Jun 2023
Operationalising Representation in Natural Language ProcessingBritish Journal for the Philosophy of Science (BJPS), 2023 J. Harding 277 16 0 14 Jun 2023
Morphosyntactic probing of multilingual BERT modelsNatural Language Engineering (NLE), 2023 Judit Ács Endre Hamerlik Roy Schwartz Noah A. Smith András Kornai 159 15 0 09 Jun 2023
Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of MindAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Ece Takmaz Nicolo' Brandizzi Mario Giulianelli Sandro Pezzelle Raquel Fernández 185 7 0 31 May 2023
Assessing Word Importance Using Models Trained for Semantic TasksAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Dávid Javorský Ondrej Bojar François Yvon 110 3 0 31 May 2023
Representation Of Lexical Stylistic Features In Language Models' Embedding Space Qing Lyu Marianna Apidianaki Chris Callison-Burch 182 11 0 29 May 2023
Should We Attend More or Less? Modulating Attention for Fairness A. Zayed Gonçalo Mordido Samira Shabanian Sarath Chandar 199 15 0 22 May 2023
Few-Shot Dialogue Summarization via Skeleton-Assisted Prompt Transfer in Prompt TuningConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Kaige Xie Tong Yu Haoliang Wang Junda Wu Handong Zhao Ruiyi Zhang K. Mahadik A. Nenkova Mark O. Riedl 265 4 0 20 May 2023
ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writing Hua Shen Huang Chieh-Yang Tongshuang Wu Ting-Hao 'Kenneth' Huang 317 43 0 16 May 2023
Idioms, Probing and Dangerous Things: Towards Structural Probing for Idiomaticity in Vector SpaceWorkshop on Multiword Expressions (MWE), 2023 Filip Klubicka Vasudevan Nedumpozhimana John D. Kelleher 160 4 0 27 Apr 2023
L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERTPacific Asia Conference on Language, Information and Computation (PACLIC), 2023 Samruddhi Deode Janhavi Gadre Aditi Kajale Ananya Joshi Raviraj Joshi 136 33 0 22 Apr 2023
Zero-Shot Multi-Label Topic Inference with Sentence EncodersConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Souvik Sarkar Dongji Feng Shubhra (Santu) Karmaker BDL 229 6 0 14 Apr 2023
Jump to Conclusions: Short-Cutting Transformers With Linear TransformationsInternational Conference on Language Resources and Evaluation (LREC), 2023 Alexander Yom Din Taelin Karidi Leshem Choshen Mor Geva 157 78 0 16 Mar 2023
Probing Graph RepresentationsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 Mohammad Sadegh Akhondzadeh Vijay Lingam Aleksandar Bojchevski 166 12 0 07 Mar 2023
NxPlain: Web-based Tool for Discovery of Latent ConceptsConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Fahim Dalvi Nadir Durrani Hassan Sajjad Tamim Jaban Musab Husaini Ummar Abbas 177 1 0 06 Mar 2023
Trust, but Verify: Using Self-Supervised Probing to Improve TrustworthinessEuropean Conference on Computer Vision (ECCV), 2023 Ailin Deng Shen Li Miao Xiong Zhirui Chen Bryan Hooi 108 4 0 06 Feb 2023
SkinCon: A skin disease dataset densely annotated by domain experts for fine-grained model debugging and analysisNeural Information Processing Systems (NeurIPS), 2023 Roxana Daneshjou Mert Yuksekgonul Zhuo Cai R. Novoa J. Zou 188 62 0 01 Feb 2023
Probing Taxonomic and Thematic Embeddings for Taxonomic InformationGlobal WordNet Conference (GWC), 2023 Filip Klubicka John D. Kelleher 156 2 0 25 Jan 2023
Can Large Language Models Change User Preference Adversarially? Varshini Subhash AAML 150 9 0 05 Jan 2023
A Natural Bias for Language Generation ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Clara Meister Wojciech Stokowiec Tiago Pimentel Lei Yu Laura Rimell A. Kuncoro MILM 163 6 0 19 Dec 2022
Joint processing of linguistic properties in brains and language modelsNeural Information Processing Systems (NeurIPS), 2022 R. Mamidi Subba Reddy Oota Mariya Toneva 173 47 0 15 Dec 2022