What do you learn from context? Probing for sentence structure in contextualized word representations

15 May 2019

Berlin Chen

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 532 papers shown

Title
Designing and Contextualising Probes for African Languages Wisdom Aduah Francois Meyer 24 0 0 15 May 2025
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models Chuan Sun Han Yu Lizhen Cui Xiaoxiao Li 75 0 0 03 May 2025
Do Large Language Models know who did what to whom? Joseph M. Denning Xiaohan Bryor Snefjella Idan A. Blank 50 1 0 23 Apr 2025
Probing then Editing Response Personality of Large Language Models Tianjie Ju Zhenyu Shao B. Wang Y. Chen Zhuosheng Zhang Hao Fei M. Lee W. Hsu Sufeng Duan Gongshen Liu KELM 43 0 0 14 Apr 2025
Aligned Probing: Relating Toxic Behavior and Model Internals Andreas Waldis Vagrant Gautam Anne Lauscher Dietrich Klakow Iryna Gurevych 36 0 0 17 Mar 2025
MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcycling R. Teo T. Nguyen MoE 55 2 0 14 Mar 2025
Probing LLMs for Multilingual Discourse Generalization Through a Unified Label Set Florian Eichin Y. Liu Barbara Plank Michael A. Hedderich 39 0 0 13 Mar 2025
Semantic Wave Functions: Exploring Meaning in Large Language Models Through Quantum Formalism Timo Aukusti Laine 39 1 0 09 Mar 2025
Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspective Yuko Nakagi Keigo Tada Sota Yoshino Shinji Nishimoto Yu Takagi LRM 37 0 0 28 Feb 2025
Representation Engineering for Large-Language Models: Survey and Research Challenges Lukasz Bartoszcze Sarthak Munshi Bryan Sukidi Jennifer Yen Zejia Yang David Williams-King Linh Le Kosi Asuzu Carsten Maple 100 0 0 24 Feb 2025
On Representational Dissociation of Language and Arithmetic in Large Language Models Riku Kisako Tatsuki Kuribayashi Ryohei Sasano 38 0 0 17 Feb 2025
Mechanistic Interpretability of Emotion Inference in Large Language Models Ala Nekouvaght Tak Amin Banayeeanzade Anahita Bolourani Mina Kian Robin Jia Jonathan Gratch 49 0 0 08 Feb 2025
What is a Number, That a Large Language Model May Know It? Raja Marjieh Veniamin Veselovsky Thomas L. Griffiths Ilia Sucholutsky 141 2 0 03 Feb 2025
Reverse Probing: Evaluating Knowledge Transfer via Finetuned Task Embeddings for Coreference Resolution Tatiana Anikina Arne Binder David Harbecke Stalin Varanasi Leonhard Hennig Simon Ostermann Sebastian Möller Josef van Genabith 92 0 0 31 Jan 2025
Think-to-Talk or Talk-to-Think? When LLMs Come Up with an Answer in Multi-Step Arithmetic Reasoning Keito Kudo Yoichi Aoki Tatsuki Kuribayashi Shusaku Sone Masaya Taniguchi Ana Brassard Keisuke Sakaguchi Kentaro Inui ReLM LRM 69 0 0 02 Dec 2024
Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey Longxuan Ma Mingda Li Weinan Zhang Jiapeng Li Ting Liu 40 16 0 14 Nov 2024
Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language Models Kushal Tatariya Vladimir Araujo Thomas Bauwens Miryam de Lhoneux VLM 29 0 0 15 Oct 2024
Why pre-training is beneficial for downstream classification tasks? Xin Jiang Xu Cheng Zechao Li 32 0 0 11 Oct 2024
Investigating large language models for their competence in extracting grammatically sound sentences from transcribed noisy utterances Alina Wróblewska 23 0 0 07 Oct 2024
How Language Models Prioritize Contextual Grammatical Cues? Hamidreza Amirzadeh A. Alishahi Hosein Mohebbi 21 0 0 04 Oct 2024
Do Music Generation Models Encode Music Theory? Megan Wei Michael Freeman Chris Donahue Chen Sun MGen 26 4 0 01 Oct 2024
Probing Omissions and Distortions in Transformer-based RDF-to-Text Models J. Faille Albert Gatt Claire Gardent 24 0 0 25 Sep 2024
Investigating Layer Importance in Large Language Models Yang Zhang Yanfei Dong Kenji Kawaguchi FAtt 46 6 0 22 Sep 2024
Measuring Sound Symbolism in Audio-visual Models Wei-Cheng Tseng Yi-Jen Shih David Harwath Raymond Mooney 32 0 0 18 Sep 2024
Prevailing Research Areas for Music AI in the Era of Foundation Models Megan Wei M. Modrzejewski Aswin Sivaraman Dorien Herremans MedIm 29 1 0 14 Sep 2024
Exploring syntactic information in sentence embeddings through multilingual subject-verb agreement Vivi Nastase Chunyang Jiang Giuseppe Samo Paola Merlo 30 1 0 10 Sep 2024
The representation landscape of few-shot learning and fine-tuning in large language models Diego Doimo Alessandro Serra A. Ansuini Alberto Cazzaniga 88 4 0 05 Sep 2024
Analysis of Argument Structure Constructions in the Large Language Model BERT Pegah Ramezani Achim Schilling Patrick Krauss 37 1 0 08 Aug 2024
SARA: Singular-Value Based Adaptive Low-Rank Adaption Jihao Gu Shuai Chen Zelin Wang Yibo Zhang Ping Gong 27 3 0 06 Aug 2024
Tracking linguistic information in transformer-based sentence embeddings through targeted sparsification Vivi Nastase Paola Merlo 28 2 0 25 Jul 2024
LLMs' morphological analyses of complex FST-generated Finnish words Anssi Moisio Mathias Creutz M. Kurimo 33 1 0 11 Jul 2024
A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models Daking Rai Yilun Zhou Shi Feng Abulhair Saparov Ziyu Yao 75 19 0 02 Jul 2024
Monitoring Latent World States in Language Models with Propositional Probes Jiahai Feng Stuart Russell Jacob Steinhardt HILM 32 6 0 27 Jun 2024
Benchmarking Mental State Representations in Language Models Matteo Bortoletto Constantin Ruhdorfer Lei Shi Andreas Bulling AI4MH LRM 44 4 0 25 Jun 2024
Are there identifiable structural parts in the sentence embedding whole? Vivi Nastase Paola Merlo 32 3 0 24 Jun 2024
Unveiling LLM Mechanisms Through Neural ODEs and Control Theory Yukun Zhang Qi Dong 34 0 0 23 Jun 2024
What Should Embeddings Embed? Autoregressive Models Represent Latent Generating Distributions Liyi Zhang Michael Y. Li Thomas L. Griffiths 48 2 0 06 Jun 2024
Probing the Category of Verbal Aspect in Transformer Language Models Anisia Katinskaia R. Yangarber 53 2 0 04 Jun 2024
SF-DQN: Provable Knowledge Transfer using Successor Feature for Deep Reinforcement Learning Shuai Zhang Heshan Devaka Fernando Miao Liu K. Murugesan Songtao Lu Pin-Yu Chen Tianyi Chen Meng Wang 38 1 0 24 May 2024
Do language models capture implied discourse meanings? An investigation with exhaustivity implicatures of Korean morphology Hagyeong Shin Sean Trott 22 0 0 15 May 2024
Do Pretrained Contextual Language Models Distinguish between Hebrew Homograph Analyses? Avi Shmidman C. Shmidman Dan Bareket Moshe Koppel Reut Tsarfaty 19 4 0 11 May 2024
Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRL Ning Cheng Zhaohui Yan Ziming Wang Zhijie Li Jiaming Yu Zilong Zheng Kewei Tu Jinan Xu Wenjuan Han 29 5 0 10 May 2024
Natural Language Processing RELIES on Linguistics Juri Opitz Shira Wein Nathan Schneider AI4CE 44 7 0 09 May 2024
Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers Kabir Ahuja Vidhisha Balachandran Madhur Panwar Tianxing He Noah A. Smith Navin Goyal Yulia Tsvetkov 34 8 0 25 Apr 2024
mOthello: When Do Cross-Lingual Representation Alignment and Cross-Lingual Transfer Emerge in Multilingual Models? Tianze Hua Tian Yun Ellie Pavlick LRM 24 9 0 18 Apr 2024
Large language models and linguistic intentionality J. Grindrod 33 5 0 15 Apr 2024
Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agenda Johannes Schneider 81 26 0 15 Apr 2024
Adjusting Interpretable Dimensions in Embedding Space with Human Judgments Katrin Erk Marianna Apidianaki 19 3 0 03 Apr 2024
On Linearizing Structured Data in Encoder-Decoder Language Models: Insights from Text-to-SQL Yutong Shao N. Nakashole 22 1 0 03 Apr 2024
Toward Informal Language Processing: Knowledge of Slang in Large Language Models Zhewei Sun Qian Hu Rahul Gupta Richard Zemel Yang Xu 35 1 0 02 Apr 2024