When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?

17 April 2018

Ye Qi

Devendra Singh Sachan

Matthieu Felix

Sarguna Padmanabhan

Graham Neubig

ArXiv PDF HTML

Papers citing "When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?"

50 / 203 papers shown

Title
CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB Holger Schwenk Guillaume Wenzek Sergey Edunov Edouard Grave Armand Joulin 17 253 0 10 Nov 2019
CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairs Ahmed El-Kishky Vishrav Chaudhary Francisco Guzman Philipp Koehn 12 196 0 10 Nov 2019
Should All Cross-Lingual Embeddings Speak English? Antonios Anastasopoulos Graham Neubig 6 31 0 08 Nov 2019
Word Embedding Algorithms as Generalized Low Rank Models and their Canonical Form Kian Kenyon-Dean 4 3 0 06 Nov 2019
Masked Language Model Scoring Julian Salazar Davis Liang Toan Q. Nguyen Katrin Kirchhoff 8 13 0 31 Oct 2019
Adapting Multilingual Neural Machine Translation to Unseen Languages Surafel Melaku Lakew Alina Karakanta Marcello Federico Matteo Negri Marco Turchi 31 20 0 30 Oct 2019
Transformers without Tears: Improving the Normalization of Self-Attention Toan Q. Nguyen Julian Salazar 19 223 0 14 Oct 2019
Riposte! A Large Corpus of Counter-Arguments Paul Reisert Benjamin Heinzerling Naoya Inoue Shun Kiyono Kentaro Inui HAI LRM 16 2 0 08 Oct 2019
On Dimensional Linguistic Properties of the Word Embedding Space Maosen Li Siheng Chen Ya-Qin Zhang Florian Metze 12 3 0 05 Oct 2019
A Universal Parent Model for Low-Resource Neural Machine Translation Transfer Mozhdeh Gheini Jonathan May 4 21 0 14 Sep 2019
VizSeq: A Visual Analysis Toolkit for Text Generation Tasks Changhan Wang Anirudh Jain Danlu Chen Jiatao Gu 6 29 0 12 Sep 2019
Dynamic Fusion: Attentional Language Model for Neural Machine Translation Michiki Kurosawa Mamoru Komachi 14 0 0 11 Sep 2019
Transformer to CNN: Label-scarce distillation for efficient text classification Yew Ken Chia Sam Witteveen Martin Andrews 11 37 0 08 Sep 2019
Neural Machine Translation with Byte-Level Subwords Changhan Wang Kyunghyun Cho Jiatao Gu 10 170 0 07 Sep 2019
Bilingual Lexicon Induction with Semi-supervision in Non-Isometric Embedding Spaces Barun Patra Joel Ruben Antony Moniz Sarthak Garg Matthew R. Gormley Graham Neubig 21 99 0 19 Aug 2019
Language Graph Distillation for Low-Resource Machine Translation Tianyu He Jiale Chen Xu Tan Tao Qin 9 7 0 17 Aug 2019
Towards Making the Most of BERT in Neural Machine Translation Jiacheng Yang Mingxuan Wang Hao Zhou Chengqi Zhao Yong Yu Weinan Zhang Lei Li CLL 11 156 0 15 Aug 2019
Exploring the Robustness of NMT Systems to Nonsensical Inputs Akshay Chaturvedi K. Abijith Utpal Garain AAML 8 12 0 03 Aug 2019
Fusing location and text features for sentiment classification W. L. Lim C. Ho Choo-Yee Ting 14 0 0 28 Jul 2019
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges N. Arivazhagan Ankur Bapna Orhan Firat Dmitry Lepikhin Melvin Johnson ... George F. Foster Colin Cherry Wolfgang Macherey Z. Chen Yonghui Wu 12 420 0 11 Jul 2019
WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia Holger Schwenk Vishrav Chaudhary Shuo Sun Hongyu Gong Francisco Guzmán CVBM 13 397 0 10 Jul 2019
The Impact of Preprocessing on Arabic-English Statistical and Neural Machine Translation Mai Oudah Amjad Almahairi Nizar Habash 20 34 0 27 Jun 2019
Evaluating the Supervised and Zero-shot Performance of Multi-lingual Translation Models Chris Hokamp John Glover D. Ghalandari 13 14 0 24 Jun 2019
Generalized Data Augmentation for Low-Resource Translation Mengzhou Xia X. Kong Antonios Anastasopoulos Graham Neubig 8 117 0 10 Jun 2019
Unsupervised Pivot Translation for Distant Languages Yichong Leng Xu Tan Tao Qin Xiang-Yang Li Tie-Yan Liu 14 29 0 06 Jun 2019
Choosing Transfer Languages for Cross-Lingual Learning Yu-Hsiang Lin Chian-Yu Chen Jean Lee Zirui Li Yuyan Zhang ... Zhisong Zhang Xuezhe Ma Antonios Anastasopoulos Patrick Littell Graham Neubig 13 230 0 29 May 2019
Debiasing Word Embeddings Improves Multimodal Machine Translation Tosho Hirasawa Mamoru Komachi 6 6 0 24 May 2019
A Call for Prudent Choice of Subword Merge Operations in Neural Machine Translation Shuoyang Ding Adithya Renduchintala Kevin Duh 11 63 0 24 May 2019
Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation Xinyi Wang Graham Neubig 12 26 0 20 May 2019
Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies Yunsu Kim Yingbo Gao Hermann Ney VLM 13 88 0 14 May 2019
Using Multi-Sense Vector Embeddings for Reverse Dictionaries Michael A. Hedderich Andrew Yates Dietrich Klakow Gerard de Melo 9 20 0 02 Apr 2019
Multimodal Machine Translation with Embedding Prediction Tosho Hirasawa Hayahide Yamagishi Yukio Matsumura Mamoru Komachi 14 16 0 01 Apr 2019
Learning semantic sentence representations from visually grounded language without lexical knowledge Danny Merkx S. Frank SSL 6 13 0 27 Mar 2019
compare-mt: A Tool for Holistic Comparison of Language Generation Systems Graham Neubig Zi-Yi Dou Junjie Hu Paul Michel Danish Pruthi Xinyi Wang John Wieting ELM 11 113 0 19 Mar 2019
Massively Multilingual Neural Machine Translation Roee Aharoni Melvin Johnson Orhan Firat LRM AI4CE 15 478 0 28 Feb 2019
Multilingual Neural Machine Translation with Knowledge Distillation Xu Tan Yi Ren Di He Tao Qin Zhou Zhao Tie-Yan Liu 6 248 0 27 Feb 2019
Improving Robustness of Machine Translation with Synthetic Noise Vaibhav Sumeet Singh Craig Alan Stewart Graham Neubig 11 82 0 25 Feb 2019
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing Tal Schuster Ori Ram Regina Barzilay Amir Globerson 29 208 0 25 Feb 2019
PAC-Bayes Analysis of Sentence Representation Kento Nozawa Issei Sato 19 3 0 12 Feb 2019
Multilingual Neural Machine Translation With Soft Decoupled Encoding Xinyi Wang Hieu H. Pham Philip Arthur Graham Neubig 11 59 0 09 Feb 2019
Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques Joel Escudé Font Marta R. Costa-jussá 16 166 0 10 Jan 2019
Transfer Learning in Multilingual Neural Machine Translation with Dynamic Vocabulary Surafel Melaku Lakew A. Erofeeva Matteo Negri Marcello Federico Marco Turchi 10 62 0 03 Nov 2018
Unsupervised Neural Text Simplification S. Surya Abhijit Mishra Anirban Laha Parag Jain Karthik Sankaranarayanan 22 85 0 18 Oct 2018
Parameter Sharing Methods for Multilingual Self-Attentional Translation Models Devendra Singh Sachan Graham Neubig MoE 14 114 0 01 Sep 2018
Context Mover's Distance & Barycenters: Optimal Transport of Contexts for Building Representations Sidak Pal Singh Andreas Hug Aymeric Dieuleveut Martin Jaggi OT 17 26 0 29 Aug 2018
Adapting Word Embeddings to New Languages with Morphological and Phonological Subword Representations Aditi Chaudhary Chunting Zhou Lori S. Levin Graham Neubig David R. Mortensen J. Carbonell 9 62 0 28 Aug 2018
Rapid Adaptation of Neural Machine Translation to New Languages Graham Neubig Junjie Hu AI4CE 11 207 0 13 Aug 2018
Training Neural Machine Translation using Word Embedding-based Loss Katsuki Chousa Katsuhito Sudoh Satoshi Nakamura 17 11 0 30 Jul 2018
Effective Use of Bidirectional Language Modeling for Transfer Learning in Biomedical Named Entity Recognition Devendra Singh Sachan P. Xie Mrinmaya Sachan Eric P. Xing MedIm 20 56 0 21 Nov 2017
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 161 1,630 0 11 Oct 2017