Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1905.06316
Cited By
What do you learn from context? Probing for sentence structure in contextualized word representations
International Conference on Learning Representations (ICLR), 2019
15 May 2019
Ian Tenney
Patrick Xia
Berlin Chen
Alex Jinpeng Wang
Adam Poliak
R. Thomas McCoy
Najoung Kim
Benjamin Van Durme
Samuel R. Bowman
Dipanjan Das
Ellie Pavlick
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"What do you learn from context? Probing for sentence structure in contextualized word representations"
50 / 555 papers shown
ParaScopes: What do Language Models Activations Encode About Future Text?
Nicky Pochinkov
Yulia Volkova
Anna Vasileva
Sai V R Chereddy
LLMSV
223
0
0
31 Oct 2025
Do Prompts Reshape Representations? An Empirical Study of Prompting Effects on Embeddings
Cesar Gonzalez-Gutierrez
Dirk Hovy
149
0
0
22 Oct 2025
Type and Complexity Signals in Multilingual Question Representations
Robin Kokot
Wessel Poelman
104
0
0
07 Oct 2025
Allocation of Parameters in Transformers
Ruoxi Yu
Haotian Jiang
Jingpu Cheng
Penghao Yu
Qianxiao Li
Zhong Li
MoE
154
0
0
04 Oct 2025
Evaluation Framework for Highlight Explanations of Context Utilisation in Language Models
Jingyi Sun
Pepa Atanasova
Sagnik Ray Choudhury
Sekh Mainul Islam
Isabelle Augenstein
196
0
0
03 Oct 2025
Steering Prepositional Phrases in Language Models: A Case of with-headed Adjectival and Adverbial Complements in Gemma-2
Stefan Arnold
Rene Gröbner
LLMSV
128
0
0
27 Sep 2025
Towards Transparent AI: A Survey on Explainable Language Models
Avash Palikhe
Sribala Vidyadhari Chinta
Zhipeng Yin
Rui Guo
Qiang Duan
Jie Yang
Wenbin Zhang
174
2
0
25 Sep 2025
Quantifying Compositionality of Classic and State-of-the-Art Embeddings
Zhijin Guo
Chenhao Xue
Zhaozhen Xu
Hongbo Bo
Yuxuan Ye
Janet B. Pierrehumbert
Martha Lewis
CoGe
169
0
0
14 Sep 2025
Testing the assumptions about the geometry of sentence embedding spaces: the cosine measure need not apply
Vivi Nastase
Paola Merlo
81
0
0
01 Sep 2025
Reasoning in Computer Vision: Taxonomy, Models, Tasks, and Methodologies
Ayushman Sarkar
Mohd Yamani Idna Idris
Zhenyu Yu
LRM
160
12
0
14 Aug 2025
Probing Syntax in Large Language Models: Successes and Remaining Challenges
Pablo Diego-Simón
Emmanuel Chemla
J. King
Yair Lakretz
262
1
0
05 Aug 2025
How Does Controllability Emerge In Language Models During Pretraining?
Jianshu She
Xinyue Li
Eric Xing
Zhengzhong Liu
Qirong Ho
LLMSV
232
0
0
03 Aug 2025
On the Performance of Concept Probing: The Influence of the Data (Extended Version)
Manuel de Sousa Ribeiro
Afonso Leote
João Leite
158
1
0
24 Jul 2025
Concept Probing: Where to Find Human-Defined Concepts (Extended Version)
Manuel de Sousa Ribeiro
Afonso Leote
João Leite
179
1
0
24 Jul 2025
Distinct Computations Emerge From Compositional Curricula in In-Context Learning
Jin Hwa Lee
Andrew Kyle Lampinen
Aaditya K. Singh
Andrew Saxe
180
1
0
16 Jun 2025
A Comprehensive Study of Decoder-Only LLMs for Text-to-Image Generation
Computer Vision and Pattern Recognition (CVPR), 2025
Andrew Z. Wang
Songwei Ge
Tero Karras
Ming-Yu Liu
Yogesh Balaji
211
4
0
09 Jun 2025
Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety
Seongmin Lee
Aeree Cho
Grace C. Kim
ShengYun Peng
Mansi Phute
Duen Horng Chau
LM&MA
AI4CE
273
3
0
05 Jun 2025
Behavioural vs. Representational Systematicity in End-to-End Models: An Opinionated Survey
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Ivan Vegner
Sydelle de Souza
Valentin Forch
Martha Lewis
Leonidas A.A. Doumas
230
3
0
04 Jun 2025
LayerIF: Estimating Layer Quality for Large Language Models using Influence Functions
Hadi Askari
Shivanshu Gupta
Fei Wang
Anshuman Chhabra
Muhao Chen
TDI
401
4
0
27 May 2025
A Representation Level Analysis of NMT Model Robustness to Grammatical Errors
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Abderrahmane Issam
Yusuf Can Semerci
Jan Scholtes
Gerasimos Spanakis
254
0
0
27 May 2025
Multi-Scale Manifold Alignment for Interpreting Large Language Models: A Unified Information-Geometric Framework
Yukun Zhang
Qi Dong
137
0
0
24 May 2025
Multi-Scale Probabilistic Generation Theory: A Unified Information-Theoretic Framework for Hierarchical Structure in Large Language Models
Yukin Zhang
Qi Dong
282
0
0
23 May 2025
Designing and Contextualising Probes for African Languages
Wisdom Aduah
Francois Meyer
371
0
0
15 May 2025
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models
Chuan Sun
Han Yu
Lizhen Cui
Xiaoxiao Li
1.0K
5
0
03 May 2025
Do Large Language Models know who did what to whom?
Joseph M. Denning
Xiaohan
Bryor Snefjella
Idan A. Blank
564
2
0
23 Apr 2025
Probing then Editing Response Personality of Large Language Models
Tianjie Ju
Zhenyu Shao
Binghai Wang
Yulin Chen
Zhuosheng Zhang
Hao Fei
Yang Deng
Wynne Hsu
Sufeng Duan
Gongshen Liu
KELM
381
3
0
14 Apr 2025
Aligned Probing: Relating Toxic Behavior and Model Internals
Andreas Waldis
Vagrant Gautam
Anne Lauscher
Dietrich Klakow
Iryna Gurevych
286
2
0
17 Mar 2025
MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcycling
International Conference on Learning Representations (ICLR), 2025
R. Teo
T. Nguyen
MoE
372
5
0
14 Mar 2025
Probing LLMs for Multilingual Discourse Generalization Through a Unified Label Set
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Florian Eichin
Wenshu Fan
Yun Xue
Michael A. Hedderich
404
6
0
13 Mar 2025
Semantic Wave Functions: Exploring Meaning in Large Language Models Through Quantum Formalism
Timo Aukusti Laine
171
3
0
09 Mar 2025
Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspective
Yuko Nakagi
Keigo Tada
Sota Yoshino
Shinji Nishimoto
Yu Takagi
LRM
359
3
0
28 Feb 2025
Representation Engineering for Large-Language Models: Survey and Research Challenges
Lukasz Bartoszcze
Sarthak Munshi
Bryan Sukidi
Jennifer Yen
Zejia Yang
David Williams-King
Linh Le
Kosi Asuzu
Carsten Maple
410
4
0
24 Feb 2025
On Representational Dissociation of Language and Arithmetic in Large Language Models
Riku Kisako
Tatsuki Kuribayashi
Ryohei Sasano
265
1
0
17 Feb 2025
Multi-Agent Actor-Critic Generative AI for Query Resolution and Analysis
IEEE Transactions on Artificial Intelligence (IEEE TAI), 2025
Mohammad Wali Ur Rahman
Ric Nevarez
Lamia Tasnim Mim
Salim Hariri
179
5
0
17 Feb 2025
We Can't Understand AI Using our Existing Vocabulary
John Hewitt
Robert Geirhos
Been Kim
319
14
0
11 Feb 2025
Mechanistic Interpretability of Emotion Inference in Large Language Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Ala Nekouvaght Tak
Amin Banayeeanzade
Anahita Bolourani
Mina Kian
Robin Jia
Jonathan Gratch
316
5
0
08 Feb 2025
What is a Number, That a Large Language Model May Know It?
Raja Marjieh
Veniamin Veselovsky
Thomas Griffiths
Ilia Sucholutsky
967
11
0
03 Feb 2025
Reverse Probing: Evaluating Knowledge Transfer via Finetuned Task Embeddings for Coreference Resolution
Workshop on Representation Learning for NLP (RepL4NLP), 2025
Tatiana Anikina
Arne Binder
David Harbecke
Stalin Varanasi
Leonhard Hennig
Simon Ostermann
Sebastian Möller
Josef van Genabith
399
0
0
31 Jan 2025
GPT-2 Through the Lens of Vector Symbolic Architectures
Johannes Knittel
Tushaar Gangavarapu
Hendrik Strobelt
Hanspeter Pfister
155
2
0
10 Dec 2024
Think-to-Talk or Talk-to-Think? When LLMs Come Up with an Answer in Multi-Hop Arithmetic Reasoning
Keito Kudo
Yoichi Aoki
Tatsuki Kuribayashi
Shusaku Sone
Masaya Taniguchi
Ana Brassard
Keisuke Sakaguchi
Kentaro Inui
ReLM
LRM
418
0
0
02 Dec 2024
Profiling Bias in LLMs: Stereotype Dimensions in Contextual Word Embeddings
Carolin M. Schuster
Maria-Alexandra Dinisor
Shashwat Ghatiwala
Georg Groh
363
3
0
25 Nov 2024
Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey
Longxuan Ma
Mingda Li
Weinan Zhang
Jiapeng Li
Ting Liu
349
19
0
14 Nov 2024
Reducing the Scope of Language Models
David Yunis
Siyu Huo
Chulaka Gunasekara
Danish Contractor
KELM
259
0
0
28 Oct 2024
Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language Models
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Kushal Tatariya
Vladimir Araujo
Thomas Bauwens
Miryam de Lhoneux
VLM
236
1
0
15 Oct 2024
Why pre-training is beneficial for downstream classification tasks?
Xin Jiang
Xu Cheng
Zechao Li
188
0
0
11 Oct 2024
Investigating large language models for their competence in extracting grammatically sound sentences from transcribed noisy utterances
Conference on Computational Natural Language Learning (CoNLL), 2024
Alina Wróblewska
168
0
0
07 Oct 2024
How Language Models Prioritize Contextual Grammatical Cues?
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2024
Hamidreza Amirzadeh
Afra Alishahi
Hosein Mohebbi
180
0
0
04 Oct 2024
Do Music Generation Models Encode Music Theory?
International Society for Music Information Retrieval Conference (ISMIR), 2024
Megan Wei
Michael Freeman
Chris Donahue
Chen Sun
MGen
192
7
0
01 Oct 2024
Probing Omissions and Distortions in Transformer-based RDF-to-Text Models
J. Faille
Albert Gatt
Claire Gardent
271
0
0
25 Sep 2024
Investigating Layer Importance in Large Language Models
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2024
Yang Zhang
Yanfei Dong
Kenji Kawaguchi
FAtt
241
26
0
22 Sep 2024
1
2
3
4
...
10
11
12
Next
