Title
ParaScopes: What do Language Models Activations Encode About Future Text? Nicky Pochinkov Yulia Volkova Anna Vasileva Sai V R Chereddy LLMSV 184 0 0 31 Oct 2025
Do Prompts Reshape Representations? An Empirical Study of Prompting Effects on Embeddings Cesar Gonzalez-Gutierrez Dirk Hovy 120 0 0 22 Oct 2025
Type and Complexity Signals in Multilingual Question Representations Robin Kokot Wessel Poelman 104 0 0 07 Oct 2025
Allocation of Parameters in Transformers Ruoxi Yu Haotian Jiang Jingpu Cheng Penghao Yu Qianxiao Li Zhong Li MoE 130 0 0 04 Oct 2025
Evaluation Framework for Highlight Explanations of Context Utilisation in Language Models Jingyi Sun Pepa Atanasova Sagnik Ray Choudhury Sekh Mainul Islam Isabelle Augenstein 146 0 0 03 Oct 2025
Steering Prepositional Phrases in Language Models: A Case of with-headed Adjectival and Adverbial Complements in Gemma-2 Stefan Arnold Rene Gröbner LLMSV 112 0 0 27 Sep 2025
Towards Transparent AI: A Survey on Explainable Language Models Avash Palikhe Sribala Vidyadhari Chinta Zhipeng Yin Rui Guo Qiang Duan Jie Yang Wenbin Zhang 156 1 0 25 Sep 2025
Quantifying Compositionality of Classic and State-of-the-Art Embeddings Zhijin Guo Chenhao Xue Zhaozhen Xu Hongbo Bo Yuxuan Ye Janet B. Pierrehumbert Martha Lewis CoGe 165 0 0 14 Sep 2025
Testing the assumptions about the geometry of sentence embedding spaces: the cosine measure need not apply Vivi Nastase Paola Merlo 57 0 0 01 Sep 2025
Reasoning in Computer Vision: Taxonomy, Models, Tasks, and Methodologies Ayushman Sarkar Mohd Yamani Idna Idris Zhenyu Yu LRM 136 8 0 14 Aug 2025
Probing Syntax in Large Language Models: Successes and Remaining Challenges Pablo Diego-Simón Emmanuel Chemla J. King Yair Lakretz 194 1 0 05 Aug 2025
How Does Controllability Emerge In Language Models During Pretraining? Jianshu She Xinyue Li Eric Xing Zhengzhong Liu Qirong Ho LLMSV 196 0 0 03 Aug 2025
On the Performance of Concept Probing: The Influence of the Data (Extended Version) Manuel de Sousa Ribeiro Afonso Leote João Leite 130 1 0 24 Jul 2025
Concept Probing: Where to Find Human-Defined Concepts (Extended Version) Manuel de Sousa Ribeiro Afonso Leote João Leite 126 1 0 24 Jul 2025
Distinct Computations Emerge From Compositional Curricula in In-Context Learning Jin Hwa Lee Andrew Kyle Lampinen Aaditya K. Singh Andrew Saxe 172 1 0 16 Jun 2025
A Comprehensive Study of Decoder-Only LLMs for Text-to-Image GenerationComputer Vision and Pattern Recognition (CVPR), 2025 Andrew Z. Wang Songwei Ge Tero Karras Ming-Yu Liu Yogesh Balaji 167 3 0 09 Jun 2025
Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety Seongmin Lee Aeree Cho Grace C. Kim ShengYun Peng Mansi Phute Duen Horng Chau LM&MA AI4CE 257 3 0 05 Jun 2025
Behavioural vs. Representational Systematicity in End-to-End Models: An Opinionated SurveyAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Ivan Vegner Sydelle de Souza Valentin Forch Martha Lewis Leonidas A.A. Doumas 210 3 0 04 Jun 2025
LayerIF: Estimating Layer Quality for Large Language Models using Influence Functions Hadi Askari Shivanshu Gupta Fei Wang Anshuman Chhabra Muhao Chen TDI 329 4 0 27 May 2025
A Representation Level Analysis of NMT Model Robustness to Grammatical ErrorsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Abderrahmane Issam Yusuf Can Semerci Jan Scholtes Gerasimos Spanakis 238 0 0 27 May 2025
Multi-Scale Manifold Alignment for Interpreting Large Language Models: A Unified Information-Geometric Framework Yukun Zhang Qi Dong 105 0 0 24 May 2025
Multi-Scale Probabilistic Generation Theory: A Unified Information-Theoretic Framework for Hierarchical Structure in Large Language Models Yukin Zhang Qi Dong 229 0 0 23 May 2025
Designing and Contextualising Probes for African Languages Wisdom Aduah Francois Meyer 291 0 0 15 May 2025
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models Chuan Sun Han Yu Lizhen Cui Xiaoxiao Li 967 4 0 03 May 2025
Do Large Language Models know who did what to whom? Joseph M. Denning Xiaohan Bryor Snefjella Idan A. Blank 507 2 0 23 Apr 2025
Probing then Editing Response Personality of Large Language Models Tianjie Ju Zhenyu Shao Binghai Wang Yulin Chen Zhuosheng Zhang Hao Fei Yang Deng Wynne Hsu Sufeng Duan Gongshen Liu KELM 349 3 0 14 Apr 2025
Aligned Probing: Relating Toxic Behavior and Model Internals Andreas Waldis Vagrant Gautam Anne Lauscher Dietrich Klakow Iryna Gurevych 270 2 0 17 Mar 2025
MoLEx: Mixture of Layer Experts for Finetuning with Sparse UpcyclingInternational Conference on Learning Representations (ICLR), 2025 R. Teo T. Nguyen MoE 332 4 0 14 Mar 2025
Probing LLMs for Multilingual Discourse Generalization Through a Unified Label SetAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Florian Eichin Wenshu Fan Yun Xue Michael A. Hedderich 368 6 0 13 Mar 2025
Semantic Wave Functions: Exploring Meaning in Large Language Models Through Quantum Formalism Timo Aukusti Laine 151 3 0 09 Mar 2025
Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspective Yuko Nakagi Keigo Tada Sota Yoshino Shinji Nishimoto Yu Takagi LRM 331 3 0 28 Feb 2025
Representation Engineering for Large-Language Models: Survey and Research Challenges Lukasz Bartoszcze Sarthak Munshi Bryan Sukidi Jennifer Yen Zejia Yang David Williams-King Linh Le Kosi Asuzu Carsten Maple 356 4 0 24 Feb 2025
On Representational Dissociation of Language and Arithmetic in Large Language Models Riku Kisako Tatsuki Kuribayashi Ryohei Sasano 245 1 0 17 Feb 2025
Multi-Agent Actor-Critic Generative AI for Query Resolution and AnalysisIEEE Transactions on Artificial Intelligence (IEEE TAI), 2025 Mohammad Wali Ur Rahman Ric Nevarez Lamia Tasnim Mim Salim Hariri 154 4 0 17 Feb 2025
We Can't Understand AI Using our Existing Vocabulary John Hewitt Robert Geirhos Been Kim 287 13 0 11 Feb 2025
Mechanistic Interpretability of Emotion Inference in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Ala Nekouvaght Tak Amin Banayeeanzade Anahita Bolourani Mina Kian Robin Jia Jonathan Gratch 276 5 0 08 Feb 2025
What is a Number, That a Large Language Model May Know It? Raja Marjieh Veniamin Veselovsky Thomas Griffiths Ilia Sucholutsky 891 11 0 03 Feb 2025
Reverse Probing: Evaluating Knowledge Transfer via Finetuned Task Embeddings for Coreference ResolutionWorkshop on Representation Learning for NLP (RepL4NLP), 2025 Tatiana Anikina Arne Binder David Harbecke Stalin Varanasi Leonhard Hennig Simon Ostermann Sebastian Möller Josef van Genabith 347 0 0 31 Jan 2025
GPT-2 Through the Lens of Vector Symbolic Architectures Johannes Knittel Tushaar Gangavarapu Hendrik Strobelt Hanspeter Pfister 131 2 0 10 Dec 2024
Think-to-Talk or Talk-to-Think? When LLMs Come Up with an Answer in Multi-Hop Arithmetic Reasoning Keito Kudo Yoichi Aoki Tatsuki Kuribayashi Shusaku Sone Masaya Taniguchi Ana Brassard Keisuke Sakaguchi Kentaro Inui ReLM LRM 366 0 0 02 Dec 2024
Profiling Bias in LLMs: Stereotype Dimensions in Contextual Word Embeddings Carolin M. Schuster Maria-Alexandra Dinisor Shashwat Ghatiwala Georg Groh 323 3 0 25 Nov 2024
Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey Longxuan Ma Mingda Li Weinan Zhang Jiapeng Li Ting Liu 317 19 0 14 Nov 2024
Reducing the Scope of Language Models David Yunis Siyu Huo Chulaka Gunasekara Danish Contractor KELM 227 0 0 28 Oct 2024
Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Kushal Tatariya Vladimir Araujo Thomas Bauwens Miryam de Lhoneux VLM 212 1 0 15 Oct 2024
Why pre-training is beneficial for downstream classification tasks? Xin Jiang Xu Cheng Zechao Li 156 0 0 11 Oct 2024
Investigating large language models for their competence in extracting grammatically sound sentences from transcribed noisy utterancesConference on Computational Natural Language Learning (CoNLL), 2024 Alina Wróblewska 148 0 0 07 Oct 2024
How Language Models Prioritize Contextual Grammatical Cues?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2024 Hamidreza Amirzadeh Afra Alishahi Hosein Mohebbi 124 0 0 04 Oct 2024
Do Music Generation Models Encode Music Theory?International Society for Music Information Retrieval Conference (ISMIR), 2024 Megan Wei Michael Freeman Chris Donahue Chen Sun MGen 160 7 0 01 Oct 2024
Probing Omissions and Distortions in Transformer-based RDF-to-Text Models J. Faille Albert Gatt Claire Gardent 199 0 0 25 Sep 2024
Investigating Layer Importance in Large Language ModelsBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2024 Yang Zhang Yanfei Dong Kenji Kawaguchi FAtt 197 26 0 22 Sep 2024

1 2 3 4...10 11 12

Home
Papers
1905.06316
Cited By

What do you learn from context? Probing for sentence structure in contextualized word representations

International Conference on Learning Representations (ICLR), 2019

15 May 2019

Berlin Chen

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 555 papers shown

Title
ParaScopes: What do Language Models Activations Encode About Future Text? Nicky Pochinkov Yulia Volkova Anna Vasileva Sai V R Chereddy LLMSV 184 0 0 31 Oct 2025
Do Prompts Reshape Representations? An Empirical Study of Prompting Effects on Embeddings Cesar Gonzalez-Gutierrez Dirk Hovy 120 0 0 22 Oct 2025
Type and Complexity Signals in Multilingual Question Representations Robin Kokot Wessel Poelman 104 0 0 07 Oct 2025
Allocation of Parameters in Transformers Ruoxi Yu Haotian Jiang Jingpu Cheng Penghao Yu Qianxiao Li Zhong Li MoE 130 0 0 04 Oct 2025
Evaluation Framework for Highlight Explanations of Context Utilisation in Language Models Jingyi Sun Pepa Atanasova Sagnik Ray Choudhury Sekh Mainul Islam Isabelle Augenstein 146 0 0 03 Oct 2025
Steering Prepositional Phrases in Language Models: A Case of with-headed Adjectival and Adverbial Complements in Gemma-2 Stefan Arnold Rene Gröbner LLMSV 112 0 0 27 Sep 2025
Towards Transparent AI: A Survey on Explainable Language Models Avash Palikhe Sribala Vidyadhari Chinta Zhipeng Yin Rui Guo Qiang Duan Jie Yang Wenbin Zhang 156 1 0 25 Sep 2025
Quantifying Compositionality of Classic and State-of-the-Art Embeddings Zhijin Guo Chenhao Xue Zhaozhen Xu Hongbo Bo Yuxuan Ye Janet B. Pierrehumbert Martha Lewis CoGe 165 0 0 14 Sep 2025
Testing the assumptions about the geometry of sentence embedding spaces: the cosine measure need not apply Vivi Nastase Paola Merlo 57 0 0 01 Sep 2025
Reasoning in Computer Vision: Taxonomy, Models, Tasks, and Methodologies Ayushman Sarkar Mohd Yamani Idna Idris Zhenyu Yu LRM 136 8 0 14 Aug 2025
Probing Syntax in Large Language Models: Successes and Remaining Challenges Pablo Diego-Simón Emmanuel Chemla J. King Yair Lakretz 194 1 0 05 Aug 2025
How Does Controllability Emerge In Language Models During Pretraining? Jianshu She Xinyue Li Eric Xing Zhengzhong Liu Qirong Ho LLMSV 196 0 0 03 Aug 2025
On the Performance of Concept Probing: The Influence of the Data (Extended Version) Manuel de Sousa Ribeiro Afonso Leote João Leite 130 1 0 24 Jul 2025
Concept Probing: Where to Find Human-Defined Concepts (Extended Version) Manuel de Sousa Ribeiro Afonso Leote João Leite 126 1 0 24 Jul 2025
Distinct Computations Emerge From Compositional Curricula in In-Context Learning Jin Hwa Lee Andrew Kyle Lampinen Aaditya K. Singh Andrew Saxe 172 1 0 16 Jun 2025
A Comprehensive Study of Decoder-Only LLMs for Text-to-Image GenerationComputer Vision and Pattern Recognition (CVPR), 2025 Andrew Z. Wang Songwei Ge Tero Karras Ming-Yu Liu Yogesh Balaji 167 3 0 09 Jun 2025
Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety Seongmin Lee Aeree Cho Grace C. Kim ShengYun Peng Mansi Phute Duen Horng Chau LM&MA AI4CE 257 3 0 05 Jun 2025
Behavioural vs. Representational Systematicity in End-to-End Models: An Opinionated SurveyAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Ivan Vegner Sydelle de Souza Valentin Forch Martha Lewis Leonidas A.A. Doumas 210 3 0 04 Jun 2025
LayerIF: Estimating Layer Quality for Large Language Models using Influence Functions Hadi Askari Shivanshu Gupta Fei Wang Anshuman Chhabra Muhao Chen TDI 329 4 0 27 May 2025
A Representation Level Analysis of NMT Model Robustness to Grammatical ErrorsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Abderrahmane Issam Yusuf Can Semerci Jan Scholtes Gerasimos Spanakis 238 0 0 27 May 2025
Multi-Scale Manifold Alignment for Interpreting Large Language Models: A Unified Information-Geometric Framework Yukun Zhang Qi Dong 105 0 0 24 May 2025
Multi-Scale Probabilistic Generation Theory: A Unified Information-Theoretic Framework for Hierarchical Structure in Large Language Models Yukin Zhang Qi Dong 229 0 0 23 May 2025
Designing and Contextualising Probes for African Languages Wisdom Aduah Francois Meyer 291 0 0 15 May 2025
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models Chuan Sun Han Yu Lizhen Cui Xiaoxiao Li 967 4 0 03 May 2025
Do Large Language Models know who did what to whom? Joseph M. Denning Xiaohan Bryor Snefjella Idan A. Blank 507 2 0 23 Apr 2025
Probing then Editing Response Personality of Large Language Models Tianjie Ju Zhenyu Shao Binghai Wang Yulin Chen Zhuosheng Zhang Hao Fei Yang Deng Wynne Hsu Sufeng Duan Gongshen Liu KELM 349 3 0 14 Apr 2025
Aligned Probing: Relating Toxic Behavior and Model Internals Andreas Waldis Vagrant Gautam Anne Lauscher Dietrich Klakow Iryna Gurevych 270 2 0 17 Mar 2025
MoLEx: Mixture of Layer Experts for Finetuning with Sparse UpcyclingInternational Conference on Learning Representations (ICLR), 2025 R. Teo T. Nguyen MoE 332 4 0 14 Mar 2025
Probing LLMs for Multilingual Discourse Generalization Through a Unified Label SetAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Florian Eichin Wenshu Fan Yun Xue Michael A. Hedderich 368 6 0 13 Mar 2025
Semantic Wave Functions: Exploring Meaning in Large Language Models Through Quantum Formalism Timo Aukusti Laine 151 3 0 09 Mar 2025
Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspective Yuko Nakagi Keigo Tada Sota Yoshino Shinji Nishimoto Yu Takagi LRM 331 3 0 28 Feb 2025
Representation Engineering for Large-Language Models: Survey and Research Challenges Lukasz Bartoszcze Sarthak Munshi Bryan Sukidi Jennifer Yen Zejia Yang David Williams-King Linh Le Kosi Asuzu Carsten Maple 356 4 0 24 Feb 2025
On Representational Dissociation of Language and Arithmetic in Large Language Models Riku Kisako Tatsuki Kuribayashi Ryohei Sasano 245 1 0 17 Feb 2025
Multi-Agent Actor-Critic Generative AI for Query Resolution and AnalysisIEEE Transactions on Artificial Intelligence (IEEE TAI), 2025 Mohammad Wali Ur Rahman Ric Nevarez Lamia Tasnim Mim Salim Hariri 154 4 0 17 Feb 2025
We Can't Understand AI Using our Existing Vocabulary John Hewitt Robert Geirhos Been Kim 287 13 0 11 Feb 2025
Mechanistic Interpretability of Emotion Inference in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Ala Nekouvaght Tak Amin Banayeeanzade Anahita Bolourani Mina Kian Robin Jia Jonathan Gratch 276 5 0 08 Feb 2025
What is a Number, That a Large Language Model May Know It? Raja Marjieh Veniamin Veselovsky Thomas Griffiths Ilia Sucholutsky 891 11 0 03 Feb 2025
Reverse Probing: Evaluating Knowledge Transfer via Finetuned Task Embeddings for Coreference ResolutionWorkshop on Representation Learning for NLP (RepL4NLP), 2025 Tatiana Anikina Arne Binder David Harbecke Stalin Varanasi Leonhard Hennig Simon Ostermann Sebastian Möller Josef van Genabith 347 0 0 31 Jan 2025
GPT-2 Through the Lens of Vector Symbolic Architectures Johannes Knittel Tushaar Gangavarapu Hendrik Strobelt Hanspeter Pfister 131 2 0 10 Dec 2024
Think-to-Talk or Talk-to-Think? When LLMs Come Up with an Answer in Multi-Hop Arithmetic Reasoning Keito Kudo Yoichi Aoki Tatsuki Kuribayashi Shusaku Sone Masaya Taniguchi Ana Brassard Keisuke Sakaguchi Kentaro Inui ReLM LRM 366 0 0 02 Dec 2024
Profiling Bias in LLMs: Stereotype Dimensions in Contextual Word Embeddings Carolin M. Schuster Maria-Alexandra Dinisor Shashwat Ghatiwala Georg Groh 323 3 0 25 Nov 2024
Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey Longxuan Ma Mingda Li Weinan Zhang Jiapeng Li Ting Liu 317 19 0 14 Nov 2024
Reducing the Scope of Language Models David Yunis Siyu Huo Chulaka Gunasekara Danish Contractor KELM 227 0 0 28 Oct 2024
Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Kushal Tatariya Vladimir Araujo Thomas Bauwens Miryam de Lhoneux VLM 212 1 0 15 Oct 2024
Why pre-training is beneficial for downstream classification tasks? Xin Jiang Xu Cheng Zechao Li 156 0 0 11 Oct 2024
Investigating large language models for their competence in extracting grammatically sound sentences from transcribed noisy utterancesConference on Computational Natural Language Learning (CoNLL), 2024 Alina Wróblewska 148 0 0 07 Oct 2024
How Language Models Prioritize Contextual Grammatical Cues?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2024 Hamidreza Amirzadeh Afra Alishahi Hosein Mohebbi 124 0 0 04 Oct 2024
Do Music Generation Models Encode Music Theory?International Society for Music Information Retrieval Conference (ISMIR), 2024 Megan Wei Michael Freeman Chris Donahue Chen Sun MGen 160 7 0 01 Oct 2024
Probing Omissions and Distortions in Transformer-based RDF-to-Text Models J. Faille Albert Gatt Claire Gardent 199 0 0 25 Sep 2024
Investigating Layer Importance in Large Language ModelsBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2024 Yang Zhang Yanfei Dong Kenji Kawaguchi FAtt 197 26 0 22 Sep 2024

1 2 3 4...10 11 12