Simple, Scalable Adaptation for Neural Machine Translation

18 September 2019

Papers citing "Simple, Scalable Adaptation for Neural Machine Translation"

50 / 256 papers shown

Title
Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling Hongyu Gong Yun Tang J. Pino Xian Li 23 11 0 21 Jun 2021
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks Rabeeh Karimi Mahabadi Sebastian Ruder Mostafa Dehghani James Henderson MoE 16 294 0 08 Jun 2021
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation Ruidan He Linlin Liu Hai Ye Qingyu Tan Bosheng Ding Liying Cheng Jia-Wei Low Lidong Bing Luo Si 28 196 0 06 Jun 2021
Lightweight Adapter Tuning for Multilingual Speech Translation Hang Le J. Pino Changhan Wang Jiatao Gu D. Schwab Laurent Besacier 21 88 0 02 Jun 2021
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation Xiao Pan Mingxuan Wang Liwei Wu Lei Li 13 200 0 20 May 2021
Learning Language Specific Sub-network for Multilingual Machine Translation Zehui Lin Liwei Wu Mingxuan Wang Lei Li 21 80 0 19 May 2021
Exploiting Adapters for Cross-lingual Low-resource Speech Recognition Wenxin Hou Hanlin Zhu Yidong Wang Jindong Wang Tao Qin Renjun Xu T. Shinozaki 27 63 0 18 May 2021
Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter Wei Liu Xiyan Fu Yueqian Zhang Wenming Xiao 14 155 0 15 May 2021
Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters Yan Xu Etsuko Ishii Samuel Cahyawijaya Zihan Liu Genta Indra Winata Andrea Madotto Dan Su Pascale Fung RALM 25 44 0 13 May 2021
End-to-End Speech Translation with Pre-trained Models and Adapters: UPC at IWSLT 2021 Gerard I. Gállego Ioannis Tsiamas Carlos Escolano José A. R. Fonollosa Marta R. Costa-jussá 25 30 0 10 May 2021
Efficient Weight factorization for Multilingual Speech Recognition Ngoc-Quan Pham Tuan-Nam Nguyen S. Stueker A. Waibel 40 19 0 07 May 2021
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation Mozhdeh Gheini Xiang Ren Jonathan May LRM 20 105 0 18 Apr 2021
Counter-Interference Adapter for Multilingual Machine Translation Yaoming Zhu Jiangtao Feng Chengqi Zhao Mingxuan Wang Lei Li 19 57 0 16 Apr 2021
MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning Mengzhou Xia Guoqing Zheng Subhabrata Mukherjee Milad Shokouhi Graham Neubig Ahmed Hassan Awadallah 13 31 0 16 Apr 2021
Adaptive Sparse Transformer for Multilingual Translation Hongyu Gong Xian Li Dmitriy Genzel 20 14 0 15 Apr 2021
Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey Danielle Saunders AI4CE 17 85 0 14 Apr 2021
BASE Layers: Simplifying Training of Large, Sparse Models M. Lewis Shruti Bhosale Tim Dettmers Naman Goyal Luke Zettlemoyer MoE 33 273 0 30 Mar 2021
Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation Shuhao Gu Yang Feng Wanying Xie CLL AI4CE 25 27 0 25 Mar 2021
Attribute Alignment: Controlling Text Generation from Pre-trained Language Models Dian Yu Zhou Yu Kenji Sagae 13 37 0 20 Mar 2021
Learning Policies for Multilingual Training of Neural Machine Translation Systems G. Kumar Philipp Koehn Sanjeev Khudanpur 12 1 0 11 Mar 2021
Hierarchical Transformer for Multilingual Machine Translation A. Khusainova A. Khan Adín Ramirez Rivera V. Romanov MoE 17 2 0 05 Mar 2021
Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task Badr AlKhamissi Mohamed Gabr Muhammad N. ElNokrashy Khaled Essam 18 17 0 01 Mar 2021
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 24 126 0 31 Dec 2020
Improving Zero-Shot Translation by Disentangling Positional Information Danni Liu J. Niehues James Cross Francisco Guzmán Xian Li 40 48 0 30 Dec 2020
Finding Sparse Structures for Domain Specific Neural Machine Translation Jianze Liang Chengqi Zhao Mingxuan Wang Xipeng Qiu Lei Li CLL 21 4 0 19 Dec 2020
Continual Lifelong Learning in Natural Language Processing: A Survey Magdalena Biesialska Katarzyna Biesialska Marta R. Costa-jussá KELM CLL 16 215 0 17 Dec 2020
Enabling Zero-shot Multilingual Spoken Language Translation with Language-Specific Encoders and Decoders Carlos Escolano Marta R. Costa-jussá José A. R. Fonollosa Carlos Segura 18 18 0 02 Nov 2020
Emergent Communication Pretraining for Few-Shot Machine Translation Yaoyiran Li E. Ponti Ivan Vulić Anna Korhonen 25 19 0 02 Nov 2020
The LMU Munich System for the WMT 2020 Unsupervised Machine Translation Shared Task Alexandra Chronopoulou Dario Stojanovski Viktor Hangya Alexander M. Fraser 37 5 0 25 Oct 2020
AdapterDrop: On the Efficiency of Adapters in Transformers Andreas Rucklé Gregor Geigle Max Glockner Tilman Beck Jonas Pfeiffer Nils Reimers Iryna Gurevych 46 254 0 22 Oct 2020
Beyond English-Centric Multilingual Machine Translation Angela Fan Shruti Bhosale Holger Schwenk Zhiyi Ma Ahmed El-Kishky ... Vitaliy Liptchinsky Sergey Edunov Edouard Grave Michael Auli Armand Joulin LRM 27 824 0 21 Oct 2020
Revisiting Modularized Multilingual NMT to Meet Industrial Demands Sungwon Lyu Bokyung Son Kichang Yang Jaekyoung Bae MoE 15 20 0 19 Oct 2020
Incorporating BERT into Parallel Sequence Decoding with Adapters Junliang Guo Zhirui Zhang Linli Xu Hao-Ran Wei Boxing Chen Enhong Chen 48 69 0 13 Oct 2020
Multi-Stage Pre-training for Low-Resource Domain Adaptation Rong Zhang Revanth Reddy Gangi Reddy Md Arafat Sultan Vittorio Castelli Anthony Ferritto Radu Florian Efsun Sarioglu Kayi Salim Roukos Avirup Sil T. Ward 6 42 0 12 Oct 2020
Plug-and-Play Conversational Models Andrea Madotto Etsuko Ishii Zhaojiang Lin Sumanth Dathathri Pascale Fung 17 51 0 09 Oct 2020
On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment Zirui Wang Zachary Chase Lipton Yulia Tsvetkov 18 31 0 06 Oct 2020
Multi-task Learning for Multilingual Neural Machine Translation Yiren Wang Chengxiang Zhai Hany Awadalla 27 68 0 06 Oct 2020
Efficient Meta Lifelong-Learning with Limited Memory Zirui Wang Sanket Vaibhav Mehta Barnabás Póczós J. Carbonell CLL KELM 19 74 0 06 Oct 2020
Deep Transformers with Latent Depth Xian Li Asa Cooper Stickland Yuqing Tang X. Kong 19 22 0 28 Sep 2020
Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT Alexandra Chronopoulou Dario Stojanovski Alexander M. Fraser 13 33 0 16 Sep 2020
Revisiting Low Resource Status of Indian Languages in Machine Translation Jerin Philip Shashank Siripragada Vinay P. Namboodiri C. V. Jawahar 13 26 0 11 Aug 2020
CoCon: A Self-Supervised Approach for Controlled Text Generation Alvin Chan Yew-Soon Ong B. Pung Aston Zhang Jie Fu 8 84 0 05 Jun 2020
AdapterFusion: Non-Destructive Task Composition for Transfer Learning Jonas Pfeiffer Aishwarya Kamath Andreas Rucklé Kyunghyun Cho Iryna Gurevych CLL MoMe 21 816 0 01 May 2020
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 28 610 0 30 Apr 2020
Recipes for Adapting Pre-trained Monolingual and Multilingual Models to Machine Translation Asa Cooper Stickland Xian Li Marjan Ghazvininejad 23 44 0 30 Apr 2020
Vocabulary Adaptation for Distant Domain Adaptation in Neural Machine Translation Shoetsu Sato Jin Sakuma Naoki Yoshinaga Masashi Toyoda M. Kitsuregawa 12 3 0 30 Apr 2020
Fine-tuning Multi-hop Question Answering with Hierarchical Graph Network Guanming Xiong 21 0 0 20 Apr 2020
Exploring Versatile Generative Language Model Via Parameter-Efficient Transfer Learning Zhaojiang Lin Andrea Madotto Pascale Fung 26 155 0 08 Apr 2020
Meta-Learning for Few-Shot NMT Adaptation Amr Sharaf Hany Hassan Hal Daumé 11 35 0 06 Apr 2020
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity Ivan Vulić Simon Baker E. Ponti Ulla Petti Ira Leviant ... Eden Bar Matt Malone Thierry Poibeau Roi Reichart Anna Korhonen 16 82 0 10 Mar 2020