Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks

15 August 2016

Yossi Adi

Papers citing "Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks"

34 / 134 papers shown

Title
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 111 1,581 0 11 Jun 2019
Pretraining Methods for Dialog Context Representation Learning Shikib Mehri E. Razumovskaia Tiancheng Zhao M. Eskénazi 22 84 0 02 Jun 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 91 848 0 15 May 2019
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension Najoung Kim Roma Patel Adam Poliak Alex Jinpeng Wang Patrick Xia ... Alexis Ross Tal Linzen Benjamin Van Durme Samuel R. Bowman Ellie Pavlick 28 105 0 25 Apr 2019
Evaluating the Representational Hub of Language and Vision Models Ravi Shekhar Ece Takmaz Raquel Fernández Raffaella Bernardi 30 11 0 12 Apr 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 52 719 0 21 Mar 2019
Trick or TReAT: Thematic Reinforcement for Artistic Typography Purva Tendulkar Kalpesh Krishna Ramprasaath R. Selvaraju Devi Parikh 15 13 0 19 Mar 2019
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks Matthew E. Peters Sebastian Ruder Noah A. Smith 39 433 0 14 Mar 2019
Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition Vered Shwartz Ido Dagan CoGe 27 78 0 27 Feb 2019
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference R. Thomas McCoy Ellie Pavlick Tal Linzen 69 1,214 0 04 Feb 2019
No Training Required: Exploring Random Encoders for Sentence Classification John Wieting Douwe Kiela 32 98 0 29 Jan 2019
Linguistic Analysis of Pretrained Sentence Encoders with Acceptability Judgments Alex Warstadt Samuel R. Bowman 22 23 0 11 Jan 2019
What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models Fahim Dalvi Nadir Durrani Hassan Sajjad Yonatan Belinkov A. Bau James R. Glass MILM 25 186 0 21 Dec 2018
To Reverse the Gradient or Not: An Empirical Comparison of Adversarial and Multi-task Learning in Speech Recognition Yossi Adi Neil Zeghidour R. Collobert Nicolas Usunier Vitaliy Liptchinsky Gabriel Synnaeve 29 39 0 09 Dec 2018
The Best of Both Worlds: Lexical Resources To Improve Low-Resource Part-of-Speech Tagging Barbara Plank Sigrid Klerke Zeljko Agic NAI 52 4 0 21 Nov 2018
Generating Multiple Diverse Responses for Short-Text Conversation Jun Gao Wei Bi Xiaojiang Liu Junhui Li Shuming Shi 30 56 0 14 Nov 2018
Identifying and Controlling Important Neurons in Neural Machine Translation A. Bau Yonatan Belinkov Hassan Sajjad Nadir Durrani Fahim Dalvi James R. Glass MILM 21 180 0 03 Nov 2018
Language Modeling Teaches You More Syntax than Translation Does: Lessons Learned Through Auxiliary Task Analysis Kelly W. Zhang Samuel R. Bowman 32 70 0 26 Sep 2018
Frame-level speaker embeddings for text-independent speaker recognition and analysis of end-to-end model Suwon Shon Hao Tang James R. Glass 11 88 0 12 Sep 2018
Assessing Composition in Sentence Vector Representations Allyson Ettinger Ahmed Elgohary C. Phillips Philip Resnik CoGe 20 78 0 11 Sep 2018
82 Treebanks, 34 Models: Universal Dependency Parsing with Multi-Treebank Models Aaron Smith Bernd Bohnet Miryam de Lhoneux Joakim Nivre Yan Shao Sara Stymne 30 67 0 06 Sep 2018
Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information Mario Giulianelli J. Harding Florian Mohnert Dieuwke Hupkes Willem H. Zuidema 27 189 0 24 Aug 2018
Neural Network Acceptability Judgments Alex Warstadt Amanpreet Singh Samuel R. Bowman 86 1,372 0 31 May 2018
LSTMs Exploit Linguistic Attributes of Data Nelson F. Liu Omer Levy Roy Schwartz Chenhao Tan Noah A. Smith 17 15 0 29 May 2018
Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context Urvashi Khandelwal He He Peng Qi Dan Jurafsky RALM 16 293 0 12 May 2018
Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning Sandeep Subramanian Adam Trischler Yoshua Bengio C. Pal SSL 27 328 0 30 Mar 2018
Colorless green recurrent networks dream hierarchically Kristina Gulordava Piotr Bojanowski Edouard Grave Tal Linzen Marco Baroni 25 502 0 29 Mar 2018
SentEval: An Evaluation Toolkit for Universal Sentence Representations Alexis Conneau Douwe Kiela 37 633 0 14 Mar 2018
Visualisation and 'diagnostic classifiers' reveal how recurrent and recursive neural networks process hierarchical structure Dieuwke Hupkes Sara Veldhoen Willem H. Zuidema 24 274 0 28 Nov 2017
What do Neural Machine Translation Models Learn about Morphology? Yonatan Belinkov Nadir Durrani Fahim Dalvi Hassan Sajjad James R. Glass 61 410 0 11 Apr 2017
Representations of language in a model of visually grounded speech signal Grzegorz Chrupała Lieke Gelderloos A. Alishahi 41 131 0 07 Feb 2017
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 41 2,730 0 26 Sep 2016
Representation of linguistic form and function in recurrent neural networks Ákos Kádár Grzegorz Chrupała A. Alishahi 27 162 0 29 Feb 2016
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,639 0 03 Jul 2012