What do Neural Machine Translation Models Learn about Morphology?

11 April 2017

Papers citing "What do Neural Machine Translation Models Learn about Morphology?"

50 / 242 papers shown

Title
Similarity Analysis of Contextual Word Representation Models John M. Wu Yonatan Belinkov Hassan Sajjad Nadir Durrani Fahim Dalvi James R. Glass 46 73 0 03 May 2020
Emergence of Syntax Needs Minimal Supervision Raphaël Bailly Kata Gábor 18 5 0 03 May 2020
Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance? Abhilasha Ravichander Yonatan Belinkov Eduard H. Hovy 18 123 0 02 May 2020
A Matter of Framing: The Impact of Linguistic Formalism on Probing Results Ilia Kuznetsov Iryna Gurevych 9 26 0 30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual Representations Julian Michael Jan A. Botha Ian Tenney 14 42 0 29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning? Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 6 176 0 29 Apr 2020
Do Neural Language Models Show Preferences for Syntactic Formalisms? Artur Kulmizev Vinit Ravishankar Mostafa Abdou Joakim Nivre MILM 6 43 0 29 Apr 2020
Assessing the Bilingual Knowledge Learned by Neural Machine Translation Models Shilin He Xing Wang Shuming Shi M. Lyu Zhaopeng Tu 8 5 0 28 Apr 2020
Word Interdependence Exposes How LSTMs Compose Representations Naomi Saphra Adam Lopez 23 3 0 27 Apr 2020
Probing Linguistic Features of Sentence-Level Representations in Neural Relation Extraction Christoph Alt Aleksandra Gabryszak Leonhard Hennig NAI 11 34 0 17 Apr 2020
On the Effect of Dropping Layers of Pre-trained Transformer Models Hassan Sajjad Fahim Dalvi Nadir Durrani Preslav Nakov 23 132 0 08 Apr 2020
A Systematic Analysis of Morphological Content in BERT Models for Multiple Languages Daniel Edmiston 20 32 0 06 Apr 2020
On the Integration of LinguisticFeatures into Statistical and Neural Machine Translation Eva Vanmassenhove 6 0 0 31 Mar 2020
Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural Networks Prajit Dhar Arianna Bisazza 4 10 0 31 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,450 0 18 Mar 2020
On the impressive performance of randomly weighted encoders in summarization tasks Jonathan Pilault Jaehong Park C. Pal BDL 15 5 0 21 Feb 2020
Bi-Decoder Augmented Network for Neural Machine Translation Boyuan Pan Yazheng Yang Zhou Zhao Yueting Zhuang Deng Cai 11 5 0 14 Jan 2020
Neural Machine Translation: A Review and Survey Felix Stahlberg 3DV AI4TS MedIm 15 311 0 04 Dec 2019
COSTRA 1.0: A Dataset of Complex Sentence Transformations P. Barancíková Ondrej Bojar 11 7 0 03 Dec 2019
How Can We Know What Language Models Know? Zhengbao Jiang Frank F. Xu Jun Araki Graham Neubig KELM 4 1,371 0 28 Nov 2019
On the Linguistic Representational Power of Neural Machine Translation Models Yonatan Belinkov Nadir Durrani Fahim Dalvi Hassan Sajjad James R. Glass MILM 22 68 0 01 Nov 2019
Whatcha lookin' at? DeepLIFTing BERT's Attention in Question Answering Ekaterina Arkhangelskaia Sourav Dutta AIMat 9 9 0 14 Oct 2019
How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations Betty van Aken B. Winter Alexander Loser Felix Alexander Gers 11 152 0 11 Sep 2019
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 19 522 0 08 Sep 2019
Investigating Multilingual NMT Representations at Scale Sneha Kudugunta Ankur Bapna Isaac Caswell N. Arivazhagan Orhan Firat LRM 136 120 0 05 Sep 2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 190 181 0 03 Sep 2019
Towards Understanding Neural Machine Translation with Word Importance Shilin He Zhaopeng Tu Xing Wang Longyue Wang Michael R. Lyu Shuming Shi AAML 18 39 0 01 Sep 2019
Encoders Help You Disambiguate Word Senses in Neural Machine Translation Gongbo Tang Rico Sennrich Joakim Nivre 11 22 0 30 Aug 2019
Visual Interaction with Deep Learning Models through Collaborative Semantic Inference Sebastian Gehrmann Hendrik Strobelt Robert Krüger Hanspeter Pfister Alexander M. Rush HAI 13 57 0 24 Jul 2019
What Should/Do/Can LSTMs Learn When Parsing Auxiliary Verb Constructions? Miryam de Lhoneux Sara Stymne Joakim Nivre 10 3 0 18 Jul 2019
An Intrinsic Nearest Neighbor Analysis of Neural Machine Translation Architectures Hamidreza Ghader Christof Monz 22 2 0 08 Jul 2019
Widening the Representation Bottleneck in Neural Machine Translation with Lexical Shortcuts Denis Emelin Ivan Titov Rico Sennrich 8 10 0 28 Jun 2019
Tabula nearly rasa: Probing the Linguistic Knowledge of Character-Level Neural Language Models Trained on Unsegmented Text Michael Hahn Marco Baroni LMTD 12 15 0 17 Jun 2019
Scalable Syntax-Aware Language Models Using Knowledge Distillation A. Kuncoro Chris Dyer Laura Rimell S. Clark Phil Blunsom 25 26 0 14 Jun 2019
Probing Multilingual Sentence Representations With X-Probe Vinit Ravishankar Lilja Øvrelid Erik Velldal 6 20 0 12 Jun 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 19 1,578 0 11 Jun 2019
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification Tu Vu Mohit Iyyer 14 2 0 09 Jun 2019
Better Character Language Modeling Through Morphology Terra Blevins Luke Zettlemoyer 11 8 0 03 Jun 2019
Assessing the Ability of Self-Attention Networks to Learn Word Order Baosong Yang Longyue Wang Derek F. Wong Lidia S. Chao Zhaopeng Tu 11 31 0 03 Jun 2019
Pretraining Methods for Dialog Context Representation Learning Shikib Mehri E. Razumovskaia Tiancheng Zhao M. Eskénazi 6 84 0 02 Jun 2019
Examining Structure of Word Embeddings with PCA Tomáš Musil 11 12 0 31 May 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned Elena Voita David Talbot F. Moiseev Rico Sennrich Ivan Titov 8 1,095 0 23 May 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 47 848 0 15 May 2019
Contextualization of Morphological Inflection Ekaterina Vylomova Ryan Cotterell Timothy Baldwin Trevor Cohn Jason Eisner 14 3 0 04 May 2019
Multi-Head Multi-Layer Attention to Deep Language Representations for Grammatical Error Detection Masahiro Kaneko Mamoru Komachi 14 31 0 15 Apr 2019
LINSPECTOR: Multilingual Probing Tasks for Word Representations Gözde Gül Sahin Clara Vania Ilia Kuznetsov Iryna Gurevych 14 43 0 22 Mar 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 35 717 0 21 Mar 2019
Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition Vered Shwartz Ido Dagan CoGe 11 78 0 27 Feb 2019
Discovery of Natural Language Concepts in Individual Units of CNNs Seil Na Yo Joong Choe Dong-Hyun Lee Gunhee Kim MILM 14 21 0 18 Feb 2019
No Training Required: Exploring Random Encoders for Sentence Classification John Wieting Douwe Kiela 6 98 0 29 Jan 2019