What do you learn from context? Probing for sentence structure in contextualized word representations

15 May 2019

Berlin Chen

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 532 papers shown

Title
Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary Information on Knowledge Retrieval from Pretrained Language Models Stephan Linzbach Dimitar Dimitrov Laura Kallmeyer Kilian Evang Hajira Jabeen Stefan Dietze KELM 31 0 0 02 Apr 2024
Using Domain Knowledge to Guide Dialog Structure Induction via Neural Probabilistic Soft Logic Connor Pryor Quan Yuan J. Liu Mehran Kazemi Deepak Ramachandran Tania Bedrax-Weiss Lise Getoor 27 1 0 26 Mar 2024
Decoding Probing: Revealing Internal Linguistic Structures in Neural Language Models using Minimal Pairs Linyang He Peili Chen Ercong Nie Yuanning Li Jonathan R. Brennan 13 5 0 26 Mar 2024
Embedded Named Entity Recognition using Probing Classifiers Nicholas Popovic Michael Färber 40 1 0 18 Mar 2024
Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Text Frances Adriana Laureano De Leon Harish Tayyar Madabushi Mark Lee 33 3 0 07 Mar 2024
Word Importance Explains How Prompts Affect Language Model Outputs Stefan Hackmann Haniyeh Mahmoudian Mark Steadman Michael Schmidt AAML 156 5 0 05 Mar 2024
What has LeBenchmark Learnt about French Syntax? Zdravko Dugonjić Adrien Pupier Benjamin Lecouteux Maximin Coavoux 23 0 0 04 Mar 2024
Topic Aware Probing: From Sentence Length Prediction to Idiom Identification how reliant are Neural Language Models on Topic? Vasudevan Nedumpozhimana John D. Kelleher 29 1 0 04 Mar 2024
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models Chao Qian Jie M. Zhang Wei Yao Dongrui Liu Zhen-fei Yin Yu Qiao Yong Liu Jing Shao LLMSV LRM 52 13 0 29 Feb 2024
Probing Multimodal Large Language Models for Global and Local Semantic Representations Mingxu Tao Quzhe Huang Kun Xu Liwei Chen Yansong Feng Dongyan Zhao 19 5 0 27 Feb 2024
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study Tianjie Ju Weiwei Sun Wei Du Xinwei Yuan Zhaochun Ren Gongshen Liu KELM 31 23 0 25 Feb 2024
Metric-Learning Encoding Models Identify Processing Profiles of Linguistic Features in BERT's Representations Louis Jalouzot Robin Sobczyk Bastien Lhopitallier Jeanne Salle N. Lan Emmanuel Chemla Yair Lakretz 24 2 0 18 Feb 2024
Strong hallucinations from negation and how to fix them Nicholas Asher Swarnadeep Bhar ReLM LRM 29 3 0 16 Feb 2024
The Queen of England is not England's Queen: On the Lack of Factual Coherency in PLMs Paul Youssef Jorg Schlotterer Christin Seifert KELM 21 2 0 02 Feb 2024
Dive into the Chasm: Probing the Gap between In- and Cross-Topic Generalization Andreas Waldis Yufang Hou Iryna Gurevych ELM 24 7 0 02 Feb 2024
Towards Visual Syntactical Understanding Sayeed Shafayet Chowdhury Soumyadeep Chandra Kaushik Roy NAI 25 0 0 30 Jan 2024
Textual Entailment for Effective Triple Validation in Object Prediction Andrés García-Silva Cristian Berrío José Manuél Gómez-Pérez KELM 19 1 0 29 Jan 2024
Explicitly Representing Syntax Improves Sentence-to-layout Prediction of Unexpected Situations Wolf Nuyts Ruben Cartuyvels Marie-Francine Moens 34 1 0 25 Jan 2024
Mission: Impossible Language Models Julie Kallini Isabel Papadimitriou Richard Futrell Kyle Mahowald Christopher Potts ELM LRM 42 19 0 12 Jan 2024
A Vision Check-up for Language Models Pratyusha Sharma Tamar Rott Shaham Manel Baradad Stephanie Fu Adrian Rodriguez-Munoz Shivam Duggal Phillip Isola Antonio Torralba VLM LRM 78 24 0 03 Jan 2024
Language Model as an Annotator: Unsupervised Context-aware Quality Phrase Generation Zhihao Zhang Yuan Zuo Chenghua Lin Junjie Wu 8 5 0 28 Dec 2023
Deep de Finetti: Recovering Topic Distributions from Large Language Models Liyi Zhang R. Thomas McCoy T. Sumers Jian-Qiao Zhu Thomas L. Griffiths BDL 42 6 0 21 Dec 2023
Assessing Logical Reasoning Capabilities of Encoder-Only Transformer Models Paulo Pirozelli M. M. José Paulo de Tarso P. Filho A. Brandão Fabio Gagliardi Cozman LRM ELM 27 2 0 18 Dec 2023
Picking the Underused Heads: A Network Pruning Perspective of Attention Head Selection for Fusing Dialogue Coreference Information Zhengyuan Liu Nancy F. Chen 21 1 0 15 Dec 2023
INSPECT: Intrinsic and Systematic Probing Evaluation for Code Transformers Anjan Karmakar Romain Robbes 22 4 0 08 Dec 2023
Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers Nuo Chen Ning Wu Shining Liang Ming Gong Linjun Shou Dongmei Zhang Jia Li LRM 19 9 0 07 Dec 2023
The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP Julian Michael 11 1 0 01 Dec 2023
Probabilistic Transformer: A Probabilistic Dependency Model for Contextual Word Representation Haoyi Wu Kewei Tu 111 3 0 26 Nov 2023
Physical Reasoning and Object Planning for Household Embodied Agents Ayush Agrawal Raghav Prabhakar Anirudh Goyal Dianbo Liu LM&Ro LRM 11 0 0 22 Nov 2023
MELA: Multilingual Evaluation of Linguistic Acceptability Ziyin Zhang Yikang Liu Wei Huang Junyu Mao Rui Wang Hai Hu 22 3 0 15 Nov 2023
Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders Yingji Zhang Marco Valentino Danilo S. Carvalho Ian Pratt-Hartmann André Freitas DRL 21 7 0 14 Nov 2023
How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument Structure Michael Wilson Jackson Petty Robert Frank 26 15 0 08 Nov 2023
Uncovering Intermediate Variables in Transformers using Circuit Probing Michael A. Lepori Thomas Serre Ellie Pavlick 70 7 0 07 Nov 2023
Perturbation-based Active Learning for Question Answering Fan Luo Mihai Surdeanu 14 0 0 04 Nov 2023
Emergence of Abstract State Representations in Embodied Sequence Modeling Tian Yun Zilai Zeng Kunal Handa Ashish V. Thapliyal Bo Pang Ellie Pavlick Chen Sun LM&Ro 24 7 0 03 Nov 2023
Mean BERTs make erratic language teachers: the effectiveness of latent bootstrapping in low-resource settings David Samuel 11 2 0 30 Oct 2023
Probing LLMs for Joint Encoding of Linguistic Categories Giulio Starace Konstantinos Papakostas Rochelle Choenni Apostolos Panagiotopoulos Matteo Rosati Alina Leidinger Ekaterina Shutova 15 5 0 28 Oct 2023
Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance? Ahmed Alajrami Katerina Margatina Nikolaos Aletras AAML 19 1 0 26 Oct 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models Paul Youssef Osman Alperen Koracs Meijie Li Jorg Schlotterer Christin Seifert KELM 24 16 0 25 Oct 2023
Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models Xiang Chen Xiaojun Wan 27 0 0 25 Oct 2023
The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining Ting-Rui Chiang Dani Yogatama 25 1 0 25 Oct 2023
Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models Raymond Li Gabriel Murray Giuseppe Carenini MoE 39 2 0 24 Oct 2023
On the Convergence and Sample Complexity Analysis of Deep Q-Networks with $ε$ -Greedy Exploration Shuai Zhang Hongkang Li Meng Wang Miao Liu Pin-Yu Chen Songtao Lu Sijia Liu K. Murugesan Subhajit Chaudhury 32 19 0 24 Oct 2023
From Heuristic to Analytic: Cognitively Motivated Strategies for Coherent Physical Commonsense Reasoning Zheyuan Zhang Shane Storks Fengyuan Hu Sungryull Sohn Moontae Lee Honglak Lee Joyce Chai LRM 34 3 0 24 Oct 2023
Visually Grounded Continual Language Learning with Selective Specialization Kyra Ahrens Lennart Bengtson Jae Hee Lee Stefan Wermter 16 0 0 24 Oct 2023
EpiK-Eval: Evaluation for Language Models as Epistemic Models Gabriele Prato Jerry Huang Prasannna Parthasarathi Shagun Sodhani Sarath Chandar ELM 30 4 0 23 Oct 2023
Probing Representations for Document-level Event Extraction Barry Wang Xinya Du Claire Cardie 11 1 0 23 Oct 2023
Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number Sophie Hao Tal Linzen 14 5 0 23 Oct 2023
Large Language Models are biased to overestimate profoundness Eugenio Herrera-Berg Tomás Vergara Browne Pablo León-Villagrá Marc-Lluís Vives Cristian Buc Calderon ELM 19 6 0 22 Oct 2023
Implications of Annotation Artifacts in Edge Probing Test Datasets Sagnik Ray Choudhury Jushaan Kalra 16 0 0 20 Oct 2023