When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?

17 April 2018

Ye Qi

Devendra Singh Sachan

Matthieu Felix

Sarguna Padmanabhan

Graham Neubig

ArXiv PDF HTML

Papers citing "When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?"

50 / 203 papers shown

Title
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation Mozhdeh Gheini Xiang Ren Jonathan May LRM 18 105 0 18 Apr 2021
Adaptive Sparse Transformer for Multilingual Translation Hongyu Gong Xian Li Dmitriy Genzel 20 14 0 15 Apr 2021
Family of Origin and Family of Choice: Massively Parallel Lexiconized Iterative Pretraining for Severely Low Resource Machine Translation Zhong Zhou Alexander Waibel 4 4 0 12 Apr 2021
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets Julia Kreutzer Isaac Caswell Lisa Wang Ahsan Wahab D. Esch ... Duygu Ataman Orevaoghene Ahia Oghenefego Ahia Sweta Agrawal Mofetoluwa Adeyemi 18 265 0 22 Mar 2021
Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution Xavier Garcia Noah Constant Ankur P. Parikh Orhan Firat 34 42 0 11 Mar 2021
Unsupervised Transfer Learning in Multilingual Neural Machine Translation with Cross-Lingual Word Embeddings Carlos Mullov Ngoc-Quan Pham A. Waibel 11 3 0 11 Mar 2021
Self-Learning for Zero Shot Neural Machine Translation Surafel Melaku Lakew Matteo Negri Marco Turchi 13 1 0 10 Mar 2021
An empirical analysis of phrase-based and neural machine translation Hamidreza Ghader 11 1 0 04 Mar 2021
Meta Back-translation Hieu H. Pham Xinyi Wang Yiming Yang Graham Neubig 17 25 0 15 Feb 2021
Censorship of Online Encyclopedias: Implications for NLP Models Eddie Yang Margaret E. Roberts 16 16 0 22 Jan 2021
Look Before You Leap: Detecting Phishing Web Pages by Exploiting Raw URL And HTML Characteristics C. Opara Yingke Chen Bo.wei 6 39 0 06 Nov 2020
Optimizing Transformer for Low-Resource Neural Machine Translation Ali Araabi Christof Monz VLM 19 76 0 04 Nov 2020
Cross-lingual Word Embeddings beyond Zero-shot Machine Translation Shifei Chen A. Basirat 11 1 0 03 Nov 2020
Investigating Catastrophic Forgetting During Continual Training for Neural Machine Translation Shuhao Gu Yang Feng CLL 11 21 0 02 Nov 2020
Beyond English-Centric Multilingual Machine Translation Angela Fan Shruti Bhosale Holger Schwenk Zhiyi Ma Ahmed El-Kishky ... Vitaliy Liptchinsky Sergey Edunov Edouard Grave Michael Auli Armand Joulin LRM 27 818 0 21 Oct 2020
It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT Hila Gonen Shauli Ravfogel Yanai Elazar Yoav Goldberg 10 50 0 16 Oct 2020
Look It Up: Bilingual Dictionaries Improve Neural Machine Translation X. Zhong David Chiang 12 1 0 12 Oct 2020
Collective Wisdom: Improving Low-resource Neural Machine Translation using Adaptive Knowledge Distillation Fahimeh Saleh Wray L. Buntine Gholamreza Haffari 9 9 0 12 Oct 2020
On Long-Tailed Phenomena in Neural Machine Translation Vikas Raunak Siddharth Dalmia Vivek Gupta Florian Metze 9 30 0 10 Oct 2020
Query-Key Normalization for Transformers Alex Henry Prudhvi Raj Dachapally S. Pawar Yuxuan Chen 12 73 0 08 Oct 2020
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information Zehui Lin Xiao Pan Mingxuan Wang Xipeng Qiu Jiangtao Feng Hao Zhou Lei Li 10 125 0 07 Oct 2020
Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages W. Nekoto Vukosi Marivate T. Matsila Timi E. Fasubaa T. Kolawole ... A. Olabiyi A. Ramkilowan A. Oktem Adewale Akinfaderin Abdallah Bashir 16 197 0 05 Oct 2020
Improving Target-side Lexical Transfer in Multilingual Neural Machine Translation Luyu Gao Xinyi Wang Graham Neubig 59 6 0 04 Oct 2020
Enriching Word Embeddings with Temporal and Spatial Information Hongyu Gong S. Bhat Pramod Viswanath 6 12 0 02 Oct 2020
Nearest Neighbor Machine Translation Urvashi Khandelwal Angela Fan Dan Jurafsky Luke Zettlemoyer M. Lewis RALM 8 280 0 01 Oct 2020
Development of Word Embeddings for Uzbek Language B. Mansurov A. Mansurov 6 4 0 30 Sep 2020
Improving Low Compute Language Modeling with In-Domain Embedding Initialisation Charles F Welch Rada Mihalcea Jonathan K. Kummerfeld AI4CE 6 4 0 29 Sep 2020
Deep Transformers with Latent Depth Xian Li Asa Cooper Stickland Yuqing Tang X. Kong 11 22 0 28 Sep 2020
Revisiting LSTM Networks for Semi-Supervised Text Classification via Mixed Objective Function Devendra Singh Sachan Manzil Zaheer Ruslan Salakhutdinov 6 129 0 08 Sep 2020
Language-agnostic BERT Sentence Embedding Fangxiaoyu Feng Yinfei Yang Daniel Matthew Cer N. Arivazhagan Wei Wang 6 863 0 03 Jul 2020
TICO-19: the Translation Initiative for Covid-19 Antonios Anastasopoulos A. Cattelan Zi-Yi Dou Marcello Federico C. Federman ... Mengmeng Niu A. Oktem Eric Paquin G. Tang Sylwia Tur 11 89 0 03 Jul 2020
Cross-lingual Retrieval for Iterative Self-Supervised Training C. Tran Y. Tang Xian Li Jiatao Gu RALM 12 72 0 16 Jun 2020
Cross-Cultural Similarity Features for Cross-Lingual Transfer Learning of Pragmatically Motivated Tasks Jimin Sun Hwijeen Ahn Chan Young Park Yulia Tsvetkov David R. Mortensen 6 3 0 16 Jun 2020
Contextual Embeddings: When Are They Worth It? Simran Arora Avner May Jian Zhang Christopher Ré 6 57 0 18 May 2020
Dynamic Knowledge embedding and tracing Liangbei Xu Mark A. Davenport 13 8 0 18 May 2020
JASS: Japanese-specific Sequence to Sequence Pre-training for Neural Machine Translation Zhuoyuan Mao Fabien Cromierès Raj Dabre Haiyue Song Sadao Kurohashi 8 4 0 07 May 2020
Predicting Performance for Natural Language Processing Tasks Mengzhou Xia Antonios Anastasopoulos Ruochen Xu Yiming Yang Graham Neubig 4 59 0 02 May 2020
Bridging Linguistic Typology and Multilingual Machine Translation with Multi-View Language Representations Arturo Oncevay Barry Haddow Alexandra Birch 6 34 0 30 Apr 2020
Balancing Training for Multilingual Neural Machine Translation Xinyi Wang Yulia Tsvetkov Graham Neubig 6 98 0 14 Apr 2020
Incorporating Bilingual Dictionaries for Low Resource Semi-Supervised Neural Machine Translation Sreyashi Nag Mihir Kale Varun Lakshinarasimhan Swapnil Singhavi 12 11 0 05 Apr 2020
Better Sign Language Translation with STMC-Transformer Kayo Yin Jesse Read SLR 22 24 0 01 Apr 2020
Low Resource Neural Machine Translation: A Benchmark for Five African Languages Surafel Melaku Lakew Matteo Negri Marco Turchi AIMat 4 27 0 31 Mar 2020
Text classification with word embedding regularization and soft similarity measure Vít Novotný E. F. Ayetiran Michal Štefánik Petr Sojka 6 12 0 10 Mar 2020
Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation Mitchell A. Gordon Kevin Duh CLL VLM 11 13 0 05 Mar 2020
Pre-training via Leveraging Assisting Languages and Data Selection for Neural Machine Translation Haiyue Song Raj Dabre Zhuoyuan Mao Fei Cheng Sadao Kurohashi Eiichiro Sumita 6 2 0 23 Jan 2020
Multilingual Denoising Pre-training for Neural Machine Translation Yinhan Liu Jiatao Gu Naman Goyal Xian Li Sergey Edunov Marjan Ghazvininejad M. Lewis Luke Zettlemoyer AI4CE AIMat 17 1,761 0 22 Jan 2020
Exploring Benefits of Transfer Learning in Neural Machine Translation Tom Kocmi 11 17 0 06 Jan 2020
A Study of Multilingual Neural Machine Translation Xu Tan Yichong Leng Jiale Chen Yi Ren Tao Qin Tie-Yan Liu 14 8 0 25 Dec 2019
Deconstructing and reconstructing word embedding algorithms Edward Newell Kian Kenyon-Dean Jackie C.K. Cheung 23 4 0 29 Nov 2019
Optimizing Data Usage via Differentiable Rewards Xinyi Wang Hieu H. Pham Paul Michel Antonios Anastasopoulos J. Carbonell Graham Neubig 11 57 0 22 Nov 2019