When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?

17 April 2018

Ye Qi

Devendra Singh Sachan

Matthieu Felix

Sarguna Padmanabhan

Graham Neubig

ArXiv PDF HTML

Papers citing "When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?"

50 / 203 papers shown

Title
Deterministic Reversible Data Augmentation for Neural Machine Translation Jiashu Yao Heyan Huang Zeming Liu Yuhang Guo 49 0 0 21 Feb 2025
MoCE: Adaptive Mixture of Contextualization Experts for Byte-based Neural Machine Translation Langlin Huang Mengyu Bu Yang Feng 21 0 0 03 Nov 2024
Optimizing the Training Schedule of Multilingual NMT using Reinforcement Learning Alexis Allemann Àlex R. Atrio Andrei Popescu-Belis 19 0 0 08 Oct 2024
Efficient transformer with reinforced position embedding for language models Yen-Che Hsiao Abhishek Dutta 21 0 0 07 Oct 2024
Can the Variation of Model Weights be used as a Criterion for Self-Paced Multilingual NMT? Àlex R. Atrio Alexis Allemann Ljiljana Dolamic Andrei Popescu-Belis 19 1 0 05 Oct 2024
Decoupled Vocabulary Learning Enables Zero-Shot Translation from Unseen Languages Carlos Mullov Ngoc-Quan Pham Alexander Waibel 16 1 0 05 Aug 2024
On Initializing Transformers with Pre-trained Embeddings Ha Young Kim Niranjan Balasubramanian Byungkon Kang 19 0 0 17 Jul 2024
Investigating the potential of Sparse Mixtures-of-Experts for multi-domain neural machine translation Nadezhda Chirkova Vassilina Nikoulina Jean-Luc Meunier Alexandre Berard MoE 30 0 0 01 Jul 2024
Complexity of Symbolic Representation in Working Memory of Transformer Correlates with the Complexity of a Task Alsu Sagirova Mikhail Burtsev 21 3 0 20 Jun 2024
ProxyLM: Predicting Language Model Performance on Multilingual Tasks via Proxy Models David Anugraha Genta Indra Winata Chenyue Li Patrick Amadeus Irawan En-Shiun Annie Lee 28 7 0 13 Jun 2024
Languages Transferred Within the Encoder: On Representation Transfer in Zero-Shot Multilingual Translation Zhi Qu Chenchen Ding Taro Watanabe 72 1 0 12 Jun 2024
LCS: A Language Converter Strategy for Zero-Shot Neural Machine Translation Zengkui Sun Yijin Liu Fandong Meng Jinan Xu Yufeng Chen Jie Zhou 32 2 0 05 Jun 2024
Integrating Multi-scale Contextualized Information for Byte-based Neural Machine Translation Langlin Huang Yang Feng 23 1 0 29 May 2024
Context-Aware Machine Translation with Source Coreference Explanation Huy Hien Vu Hidetaka Kamigaito Taro Watanabe LRM 22 1 0 30 Apr 2024
Automated Multi-Language to English Machine Translation Using Generative Pre-Trained Transformers Elijah Pelofske Vincent Urias L. Liebrock 21 0 0 23 Apr 2024
How Lexical is Bilingual Lexicon Induction? Harsh Kohli Helian Feng Nicholas Dronen Calvin McCarter Sina Moeini Ali Kebarighotbi 20 1 0 05 Apr 2024
Examining Forgetting in Continual Pre-training of Aligned Large Language Models Chen An Li Hung-Yi Lee CLL KELM 18 8 0 06 Jan 2024
Clustering Pseudo Language Family in Multilingual Translation Models with Fisher Information Matrix Xinyu Ma Xuebo Liu Min Zhang 19 1 0 05 Dec 2023
Prompt Optimization via Adversarial In-Context Learning Do Xuan Long Yiran Zhao Hannah Brown Yuxi Xie James Xu Zhao Nancy F. Chen Kenji Kawaguchi Michael Qizhe Xie Junxian He 32 11 0 05 Dec 2023
Optimizing Context-Enhanced Relational Joins Viktor Sanca Manos Chatzakis Anastasia Ailamaki 17 2 0 03 Dec 2023
Mergen: The First Manchu-Korean Machine Translation Model Trained on Augmented Data Jean Seo Sungjoo Byun Minha Kang Sangah Lee 16 3 0 29 Nov 2023
How Vocabulary Sharing Facilitates Multilingualism in LLaMA? Fei Yuan Shuai Yuan Zhiyong Wu Lei Li 20 9 0 15 Nov 2023
Is Robustness Transferable across Languages in Multilingual Neural Machine Translation? Leiyu Pan Supryadi Supryadi Deyi Xiong AAML 6 0 0 31 Oct 2023
M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models Wai-Chung Kwan Xingshan Zeng Yufei Wang Yusen Sun Liangyou Li Lifeng Shang Qun Liu Kam-Fai Wong ELM 89 10 0 30 Oct 2023
GlotLID: Language Identification for Low-Resource Languages Amir Hossein Kargaran Ayyoob Imani François Yvon Hinrich Schütze 20 10 0 24 Oct 2023
Multilingual k-Nearest-Neighbor Machine Translation David Stap Christof Monz 19 3 0 23 Oct 2023
Matrix Compression via Randomized Low Rank and Low Precision Factorization R. Saha Varun Srivastava Mert Pilanci 13 18 0 17 Oct 2023
Unlikelihood Tuning on Negative Samples Amazingly Improves Zero-Shot Translation Junjie Yang Liang Ding Li Shen Matthieu Labeau Yibing Zhan Weifeng Liu Dacheng Tao VLM 13 4 0 28 Sep 2023
MADLAD-400: A Multilingual And Document-Level Large Audited Dataset Sneha Kudugunta Isaac Caswell Biao Zhang Xavier Garcia Christopher A. Choquette-Choo ... Derrick Xin Aditya Kusupati Romi Stella Ankur Bapna Orhan Firat 53 117 0 09 Sep 2023
A deep Natural Language Inference predictor without language-specific training data Lorenzo Corradi Alessandro Manenti Francesca Del Bonifro Francesco Setti D. Sorbo 8 0 0 06 Sep 2023
Experience and Prediction: A Metric of Hardness for a Novel Litmus Test Nicos Isaak Loizos Michael 16 3 0 05 Sep 2023
Sparks of Large Audio Models: A Survey and Outlook S. Latif Moazzam Shoukat Fahad Shamshad Muhammad Usama Yi Ren ... Wenwu Wang Xulong Zhang Roberto Togneri Erik Cambria Björn W. Schuller LM&MA AuLLM 29 36 0 24 Aug 2023
Joint Dropout: Improving Generalizability in Low-Resource Neural Machine Translation through Phrase Pair Variables Ali Araabi Vlad Niculae Christof Monz 29 1 0 24 Jul 2023
AudioPaLM: A Large Language Model That Can Speak and Listen Paul Kishan Rubenstein Chulayuth Asawaroengchai D. Nguyen Ankur Bapna Zalan Borsos ... Neil Zeghidour Yu Zhang Zhishuai Zhang Lukás Zilka Christian Frank LM&MA AuLLM VLM 35 256 0 22 Jun 2023
Multilingual Pixel Representations for Translation and Effective Cross-lingual Transfer Elizabeth Salesky Neha Verma Philipp Koehn Matt Post 13 14 0 23 May 2023
An Open Dataset and Model for Language Identification Laurie Burchell Alexandra Birch Nikolay Bogoychev Kenneth Heafield 6 32 0 23 May 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 20 2 0 22 May 2023
Viewing Knowledge Transfer in Multilingual Machine Translation Through a Representational Lens David Stap Vlad Niculae Christof Monz 17 10 0 19 May 2023
Train Global, Tailor Local: Minimalist Multilingual Translation into Endangered Languages Zhong Zhou J. Niehues Alexander Waibel 14 0 0 05 May 2023
kNN-BOX: A Unified Framework for Nearest Neighbor Generation Wenhao Zhu Qianfeng Zhao Yunzhe Lv Shujian Huang Siheng Zhao Sizhe Liu Jiajun Chen 12 7 0 27 Feb 2023
Attention Link: An Efficient Attention-Based Low Resource Machine Translation Architecture Zeping Min 8 0 0 01 Feb 2023
Optimizing Deep Transformers for Chinese-Thai Low-Resource Translation Wenjie Hao Hongfei Xu Lingling Mu Hongying Zan MoE 8 4 0 24 Dec 2022
NusaCrowd: Open Source Initiative for Indonesian NLP Resources Samuel Cahyawijaya Holy Lovenia Alham Fikri Aji Genta Indra Winata Bryan Wilie ... Timothy Baldwin Sebastian Ruder Herry Sujaini S. Sakti Ayu Purwarianti 19 47 0 19 Dec 2022
$Mu$^{2}$SLAM: Multitask, Multilingual Speech and Language Models$ Mu $^{2}$ SLAM: Multitask, Multilingual Speech and Language Models Yong Cheng Yu Zhang Melvin Johnson Wolfgang Macherey Ankur Bapna 20 8 0 19 Dec 2022
Frustratingly Easy Label Projection for Cross-lingual Transfer Yang Chen Chao Jiang Alan Ritter Wei-ping Xu 19 29 0 28 Nov 2022
Using Large Pre-Trained Language Model to Assist FDA in Premarket Medical Device Zongzhe Xu LM&MA MedIm 19 0 0 03 Nov 2022
Improving Bilingual Lexicon Induction with Cross-Encoder Reranking Yaoyiran Li Fangyu Liu Ivan Vulić Anna Korhonen 29 10 0 30 Oct 2022
Finding Memo: Extractive Memorization in Constrained Sequence Generation Tasks Vikas Raunak Arul Menezes 27 13 0 24 Oct 2022
RuCoLA: Russian Corpus of Linguistic Acceptability Vladislav Mikhailov T. Shamardina Max Ryabinin A. Pestova I. Smurov Ekaterina Artemova 14 28 0 23 Oct 2022
Language-Family Adapters for Low-Resource Multilingual Neural Machine Translation Alexandra Chronopoulou Dario Stojanovski Alexander M. Fraser 18 17 0 30 Sep 2022