v1v2v3 (latest)

Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks

15 August 2016

Yossi Adi

Papers citing "Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks"

50 / 359 papers shown

Title
Augmenting BERT Carefully with Underrepresented Linguistic Features Aparna Balagopalan Jekaterina Novikova 71 2 0 12 Nov 2020
When Do You Need Billions of Words of Pretraining Data? Yian Zhang Alex Warstadt Haau-Sing Li Samuel R. Bowman 174 155 0 10 Nov 2020
CxGBERT: BERT meets Construction Grammar Harish Tayyar Madabushi Laurence Romain Dagmar Divjak P. Milin 114 52 0 09 Nov 2020
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American EnglishInternational Conference on Computational Linguistics (COLING), 2020 Marius Mosbach Stefania Degaetano-Ortlieb Marie-Pauline Krielke Badr M. Abdullah Dietrich Klakow 96 7 0 02 Nov 2020
Vec2Sent: Probing Sentence Embeddings with Natural Language GenerationInternational Conference on Computational Linguistics (COLING), 2020 M. Kerscher Steffen Eger 145 1 0 01 Nov 2020
Understanding Pre-trained BERT for Aspect-based Sentiment AnalysisInternational Conference on Computational Linguistics (COLING), 2020 Hu Xu Lei Shu Philip S. Yu Bing-Quan Liu SSL 175 48 0 31 Oct 2020
Probing Task-Oriented Dialogue Representation from Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Chien-Sheng Wu Caiming Xiong 134 20 0 26 Oct 2020
Language Models are Open Knowledge Graphs Chenguang Wang Xiao Liu Basel Alomair SSL KELM 163 144 0 22 Oct 2020
From Language to Language-ish: How Brain-Like is an LSTM's Representation of Nonsensical Language Stimuli? Maryam Hashemzadeh Greta Kaufeld Martha White Andrea E. Martin Alona Fyshe MILM 88 6 0 14 Oct 2020
A Self-supervised Representation Learning of Sentence Structure for Authorship Attribution Fereshteh Jafariakinabad K. Hua NAI SSL 223 21 0 14 Oct 2020
Unsupervised Distillation of Syntactic Information from Contextualized Word RepresentationsBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020 Shauli Ravfogel Yanai Elazar Jacob Goldberger Yoav Goldberg 158 12 0 11 Oct 2020
Recurrent babbling: evaluating the acquisition of grammar from limited input dataConference on Computational Natural Language Learning (CoNLL), 2020 Ludovica Pannitto Aurélie Herbelot 109 16 0 09 Oct 2020
BERTering RAMS: What and How Much does BERT Already Know About Event Arguments? -- A Study on the RAMS Dataset Varun Gangal Eduard H. Hovy 134 4 0 08 Oct 2020
Assessing Phrasal Representation and Composition in Transformers Lang-Chi Yu Allyson Ettinger CoGe 209 69 0 08 Oct 2020
Intrinsic Probing through Dimension Selection Lucas Torroba Hennigen Adina Williams Robert Bamler 163 60 0 06 Oct 2020
Analyzing Individual Neurons in Pre-trained Language Models Nadir Durrani Hassan Sajjad Fahim Dalvi Yonatan Belinkov MILM 188 117 0 06 Oct 2020
On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained TransformersBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020 Marius Mosbach A. Khokhlova Michael A. Hedderich Dietrich Klakow 119 50 0 06 Oct 2020
Linguistic Profiling of a Neural Language ModelInternational Conference on Computational Linguistics (COLING), 2020 Alessio Miaschi D. Brunato F. Dell’Orletta Giulia Venturi 201 49 0 05 Oct 2020
How LSTM Encodes Syntax: Exploring Context Vectors and Semi-Quantization on Natural TextInternational Conference on Computational Linguistics (COLING), 2020 Chihiro Shibata Kei Uchiumi D. Mochihashi 132 7 0 01 Oct 2020
Examining the rhetorical capacities of neural language modelsBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020 Zining Zhu Chuer Pan Mohamed Abdalla Frank Rudzicz 238 10 0 01 Oct 2020
Bridging Information-Seeking Human Gaze and Machine Reading Comprehension J. Malmaud R. Levy Yevgeni Berzak 165 33 0 30 Sep 2020
Multi-timescale Representation Learning in LSTM Language ModelsInternational Conference on Learning Representations (ICLR), 2020 Shivangi Mahto Vy A. Vo Javier S. Turek Alexander G. Huth 127 33 0 27 Sep 2020
An information theoretic view on selecting linguistic probesConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Zining Zhu Frank Rudzicz 137 20 0 15 Sep 2020
Learning Universal Representations from Word to Sentence Yian Li Hai Zhao SSL 113 2 0 10 Sep 2020
BERTology Meets Biology: Interpreting Attention in Protein Language Models Jesse Vig Ali Madani Lav Varshney Caiming Xiong R. Socher Nazneen Rajani 366 331 0 26 Jun 2020
What shapes feature representations? Exploring datasets, architectures, and training Katherine L. Hermann Andrew Kyle Lampinen OOD 220 174 0 22 Jun 2020
How to Probe Sentence Embeddings in Low-Resource Languages: On Structural Design Choices for Probing Task Evaluation Steffen Eger Johannes Daxenberger Iryna Gurevych 194 12 0 16 Jun 2020
Probing Neural Dialog Models for Conversational Understanding Abdelrhman Saleh Tovly Deutsch Stephen Casper Yonatan Belinkov Stuart M. Shieber 125 14 0 07 Jun 2020
Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals Yanai Elazar Shauli Ravfogel Alon Jacovi Yoav Goldberg 314 25 0 01 Jun 2020
Syntactic Structure Distillation Pretraining For Bidirectional EncodersTransactions of the Association for Computational Linguistics (TACL), 2020 A. Kuncoro Lingpeng Kong Daniel Fried Dani Yogatama Laura Rimell Chris Dyer Phil Blunsom 145 34 0 27 May 2020
CausaLM: Causal Model Explanation Through Counterfactual Language ModelsInternational Conference on Computational Logic (ICCL), 2020 Amir Feder Nadav Oved Uri Shalit Roi Reichart CML LRM 399 178 0 27 May 2020
A Further Study of Unsupervised Pre-training for Transformer Based Speech Recognition Dongwei Jiang Wubo Li Ruixiong Zhang Miao Cao Ne Luo Yang Han Wei Zou Xiangang Li SSL 177 31 0 20 May 2020
Finding Experts in Transformer Models Xavier Suau Luca Zappella N. Apostoloff 137 32 0 15 May 2020
On the Robustness of Language Encoders against Grammatical Errors Fan Yin Quanyu Long Tao Meng Kai-Wei Chang 164 39 0 12 May 2020
The Cascade Transformer: an Application for Efficient Answer Sentence SelectionAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Luca Soldaini Alessandro Moschitti 152 45 0 05 May 2020
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding wordsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Josef Klafka Allyson Ettinger 176 47 0 04 May 2020
Similarity Analysis of Contextual Word Representation ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 John M. Wu Yonatan Belinkov Hassan Sajjad Nadir Durrani Fahim Dalvi James R. Glass 250 78 0 03 May 2020
Probing Contextual Language Models for Common Ground with Visual Representations Gabriel Ilharco Rowan Zellers Ali Farhadi Hannaneh Hajishirzi 272 14 0 01 May 2020
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable MaskingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Nicola De Cao Michael Schlichtkrull Wilker Aziz Ivan Titov 164 92 0 30 Apr 2020
Hierarchical Encoders for Modeling and Interpreting Screenplays G. Bhat Avneesh Singh Saluja Melody Dye Jan Florjanczyk 125 5 0 30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Julian Michael Jan A. Botha Ian Tenney 238 44 0 29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020 Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 204 203 0 29 Apr 2020
Quantifying the Contextualization of Word Representations with Semantic Class ProbingFindings (Findings), 2020 Mengjie Zhao Philipp Dufter Yadollah Yaghoobzadeh Hinrich Schütze 191 28 0 25 Apr 2020
Syntactic Structure from Deep Learning Tal Linzen Marco Baroni NAI 204 206 0 22 Apr 2020
Probing Linguistic Features of Sentence-Level Representations in Neural Relation ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Christoph Alt Aleksandra Gabryszak Leonhard Hennig NAI 122 34 0 17 Apr 2020
Analyzing analytical methods: The case of phonology in neural models of spoken languageAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Grzegorz Chrupała Bertrand Higy Afra Alishahi 145 21 0 15 Apr 2020
Probing Word Translations in the Transformer and Trading Decoder for Encoder Layers Hongfei Xu Josef van Genabith Qiuhui Liu Deyi Xiong 115 3 0 21 Mar 2020
Sentence Analogies: Exploring Linguistic Relationships and Regularities in Sentence Embeddings Xunjie Zhu Gerard de Melo NAI 114 12 0 09 Mar 2020
On the impressive performance of randomly weighted encoders in summarization tasksAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Jonathan Pilault Jaehong Park C. Pal BDL 125 6 0 21 Feb 2020
An empirical analysis of information encoded in disentangled neural speaker representationsThe Speaker and Language Recognition Workshop (Odyssey), 2020 Raghuveer Peri Haoqi Li Krishna Somandepalli Arindam Jati Shrikanth Narayanan DRL 145 14 0 10 Feb 2020