What do you learn from context? Probing for sentence structure in contextualized word representations

15 May 2019

Berlin Chen

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 532 papers shown

Title
Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU? Jakub Ho'scilowicz Marcin Sowanski Piotr Czubowski Artur Janicki 23 2 0 27 Jan 2023
The Role of Interactive Visualization in Explaining (Large) NLP Models: from Data to Inference R. Brath Daniel A. Keim Johannes Knittel Shimei Pan Pia Sommerauer Hendrik Strobelt 16 11 0 11 Jan 2023
Counteracts: Testing Stereotypical Representation in Pre-trained Language Models Damin Zhang Julia Taylor Rayz Romila Pradhan 26 2 0 11 Jan 2023
Topics as Entity Clusters: Entity-based Topics from Language Models and Graph Neural Networks Manuel V. Loureiro Steven Derby Tri Kurniawan Wijaya 8 0 0 06 Jan 2023
Examining Political Rhetoric with Epistemic Stance Detection Ankita Gupta Su Lin Blodgett Justin H. Gross Brendan T. O'Connor 20 0 0 29 Dec 2022
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer? Ningyu Xu Tao Gui Ruotian Ma Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 30 13 0 21 Dec 2022
Reconstruction Probing Najoung Kim Jatin Khilnani Alex Warstadt Abed Qaddoumi 11 1 0 21 Dec 2022
Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering Akshay Chaturvedi Swarnadeep Bhar Soumadeep Saha Utpal Garain Nicholas Asher 25 4 0 21 Dec 2022
Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities Wei Ma Shangqing Liu Mengjie Zhao Xiaofei Xie Wenhan Wang Q. Hu Jiexin Zhang Yang Liu 19 16 0 20 Dec 2022
Explainability of Text Processing and Retrieval Methods: A Critical Survey Sourav Saha Debapriyo Majumdar Mandar Mitra 8 5 0 14 Dec 2022
Assessing the Capacity of Transformer to Abstract Syntactic Representations: A Contrastive Analysis Based on Long-distance Agreement Bingzhi Li Guillaume Wisniewski Benoît Crabbé 64 12 0 08 Dec 2022
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief Review Jiangjie Chen Yanghua Xiao 36 4 0 07 Dec 2022
Localization vs. Semantics: Visual Representations in Unimodal and Multimodal Models Zhuowan Li Cihang Xie Benjamin Van Durme Alan L. Yuille VLM SSL 20 2 0 01 Dec 2022
Penalizing Confident Predictions on Largely Perturbed Inputs Does Not Improve Out-of-Distribution Generalization in Question Answering Kazutoshi Shinoda Saku Sugawara Akiko Aizawa OOD AAML 30 0 0 29 Nov 2022
Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in Hex Charles Lovering Jessica Zosa Forde G. Konidaris Ellie Pavlick Michael L. Littman 13 7 0 26 Nov 2022
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering Yueqing Sun Yu Zhang Le Qi Qi Shi ReLM RALM LRM 16 5 0 24 Nov 2022
Probing for Incremental Parse States in Autoregressive Language Models Tiwalayo Eisape Vineet Gangireddy R. Levy Yoon Kim 19 11 0 17 Nov 2022
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement Learning S. Takagi OffRL 18 7 0 17 Nov 2022
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model BigScience Workshop : Teven Le Scao Angela Fan Christopher Akiki ... Zhongli Xie Zifan Ye M. Bras Younes Belkada Thomas Wolf VLM 89 2,306 0 09 Nov 2022
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models Hao Peng Xiaozhi Wang Shengding Hu Hailong Jin Lei Hou Juanzi Li Zhiyuan Liu Qun Liu 10 22 0 08 Nov 2022
Do Charge Prediction Models Learn Legal Theory? Zhenwei An Quzhe Huang Cong Jiang Yansong Feng Dongyan Zhao ELM AILaw 27 6 0 31 Oct 2022
Probing for targeted syntactic knowledge through grammatical error detection Christopher Davis Christopher Bryant Andrew Caines Marek Rei P. Buttery 22 3 0 28 Oct 2022
IELM: An Open Information Extraction Benchmark for Pre-Trained Language Models Chenguang Wang Xiao Liu Dawn Song VLM 16 2 0 25 Oct 2022
Exploring Mode Connectivity for Pre-trained Language Models Yujia Qin Cheng Qian Jing Yi Weize Chen Yankai Lin Xu Han Zhiyuan Liu Maosong Sun Jie Zhou 27 20 0 25 Oct 2022
Controlled Text Reduction Aviv Slobodkin Paul Roit Eran Hirsch Ori Ernst Ido Dagan 29 10 0 24 Oct 2022
The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative Leonie Weissweiler Valentin Hofmann Abdullatif Köksal Hinrich Schütze 27 31 0 24 Oct 2022
Structural generalization is hard for sequence-to-sequence models Yuekun Yao Alexander Koller 22 21 0 24 Oct 2022
An Empirical Revisiting of Linguistic Knowledge Fusion in Language Understanding Tasks Changlong Yu Tianyi Xiao Lingpeng Kong Yangqiu Song Wilfred Ng 24 3 0 24 Oct 2022
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback Jiacheng Ye Jiahui Gao Jiangtao Feng Zhiyong Wu Tao Yu Lingpeng Kong SyDa VLM 73 70 0 22 Oct 2022
Probing with Noise: Unpicking the Warp and Weft of Embeddings Filip Klubicka John D. Kelleher 24 4 0 21 Oct 2022
Exploration of the Usage of Color Terms by Color-blind Participants in Online Discussion Platforms Ella Rabinovich Boaz Carmeli 13 1 0 21 Oct 2022
SLING: Sino Linguistic Evaluation of Large Language Models Yixiao Song Kalpesh Krishna R. Bhatt Mohit Iyyer 10 8 0 21 Oct 2022
Automatic Document Selection for Efficient Encoder Pretraining Yukun Feng Patrick Xia Benjamin Van Durme João Sedoc 44 7 0 20 Oct 2022
Towards Procedural Fairness: Uncovering Biases in How a Toxic Language Classifier Uses Sentiment Information I. Nejadgholi Esma Balkir Kathleen C. Fraser S. Kiritchenko 23 3 0 19 Oct 2022
Taxonomy of Abstractive Dialogue Summarization: Scenarios, Approaches and Future Directions Qi Jia Yizhu Liu Siyu Ren Kenny Q. Zhu 24 6 0 18 Oct 2022
Transparency Helps Reveal When Language Models Learn Meaning Zhaofeng Wu William Merrill Hao Peng Iz Beltagy Noah A. Smith 16 9 0 14 Oct 2022
On the Explainability of Natural Language Processing Deep Models Julia El Zini M. Awad 25 82 0 13 Oct 2022
Analyzing Text Representations under Tight Annotation Budgets: Measuring Structural Alignment César González-Gutiérrez Audi Primadhanty Francesco Cazzaro A. Quattoni 23 0 0 11 Oct 2022
"No, they did not": Dialogue response dynamics in pre-trained language models Sanghee Kim Lang-Chi Yu Allyson Ettinger 16 1 0 05 Oct 2022
Evaluation of taxonomic and neural embedding methods for calculating semantic similarity Dongqiang Yang Yanqin Yin 25 3 0 30 Sep 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 104 107 0 22 Sep 2022
Negation, Coordination, and Quantifiers in Contextualized Language Models A. Kalouli R. Sevastjanova C. Beck Maribel Romero 32 11 0 16 Sep 2022
DECK: Behavioral Tests to Improve Interpretability and Generalizability of BERT Models Detecting Depression from Text Jekaterina Novikova Ksenia Shkaruta AI4MH 22 4 0 12 Sep 2022
Testing Pre-trained Language Models' Understanding of Distributivity via Causal Mediation Analysis Pangbo Ban Yifan Jiang Tianran Liu Shane Steinert-Threlkeld 45 4 0 11 Sep 2022
On the Effectiveness of Compact Biomedical Transformers Omid Rohanian Mohammadmahdi Nouriborji Samaneh Kouchaki David A. Clifton MedIm 18 31 0 07 Sep 2022
Why Do Neural Language Models Still Need Commonsense Knowledge to Handle Semantic Variations in Question Answering? Sunjae Kwon Cheongwoong Kang Jiyeon Han Jaesik Choi 14 0 0 01 Sep 2022
Combating high variance in Data-Scarce Implicit Hate Speech Classification Debaditya Pal Kaustubh Chaudhari Harsh Sharma 19 1 0 29 Aug 2022
Lost in Context? On the Sense-wise Variance of Contextualized Word Embeddings Yile Wang Yue Zhang 11 4 0 20 Aug 2022
What Artificial Neural Networks Can Tell Us About Human Language Acquisition Alex Warstadt Samuel R. Bowman 13 111 0 17 Aug 2022
Unit Testing for Concepts in Neural Networks Charles Lovering Ellie Pavlick 15 28 0 28 Jul 2022