Regularization techniques for fine-tuning in neural machine translation

31 July 2017

Antonio Valerio Miceli Barone

Papers citing "Regularization techniques for fine-tuning in neural machine translation"

28 / 28 papers shown

Title
Adapters for Altering LLM Vocabularies: What Languages Benefit the Most? HyoJung Han Akiko Eriguchi Haoran Xu Hieu T. Hoang Marine Carpuat Huda Khayrallah VLM 40 2 0 12 Oct 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 80 3 0 30 Jul 2024
Unlocking Parameter-Efficient Fine-Tuning for Low-Resource Language Translation Tong Su Xin Peng Sarubi Thillainathan David Guzmán Surangika Ranathunga En-Shiun Annie Lee 43 2 0 05 Apr 2024
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation Zhiwei Cao Baosong Yang Huan Lin Suhang Wu Xiangpeng Wei Dayiheng Liu Jun Xie Min Zhang Jinsong Su 31 2 0 26 May 2023
The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation Mutian He Philip N. Garner 44 4 0 16 May 2023
Life-long Learning for Multilingual Neural Machine Translation with Knowledge Distillation Yang Zhao Junnan Zhu Lu Xiang Jiajun Zhang Yu Zhou Feifei Zhai Chengqing Zong CLL 47 6 0 06 Dec 2022
Continual Learning of Neural Machine Translation within Low Forgetting Risk Regions Shuhao Gu Bojie Hu Yang Feng CLL 41 12 0 03 Nov 2022
When does Parameter-Efficient Transfer Learning Work for Machine Translation? Ahmet Üstün Asa Cooper Stickland 37 7 0 23 May 2022
Nearest Neighbor Knowledge Distillation for Neural Machine Translation Zhixian Yang Renliang Sun Xiaojun Wan 18 12 0 01 May 2022
Improving Scheduled Sampling with Elastic Weight Consolidation for Neural Machine Translation Michalis Korakakis Andreas Vlachos CLL 31 2 0 13 Sep 2021
Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey Danielle Saunders AI4CE 27 85 0 14 Apr 2021
Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation Shuhao Gu Yang Feng Wanying Xie CLL AI4CE 25 27 0 25 Mar 2021
Parameter-Efficient Transfer Learning with Diff Pruning Demi Guo Alexander M. Rush Yoon Kim 13 385 0 14 Dec 2020
Multilingual Speech Translation with Efficient Finetuning of Pretrained Models Xian Li Changhan Wang Yun Tang C. Tran Yuqing Tang J. Pino Alexei Baevski Alexis Conneau Michael Auli 21 6 0 24 Oct 2020
Softmax Tempering for Training Neural Machine Translation Models Raj Dabre Atsushi Fujita 28 11 0 20 Sep 2020
Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting Sanyuan Chen Yutai Hou Yiming Cui Wanxiang Che Ting Liu Xiangzhan Yu KELM CLL 21 213 0 27 Apr 2020
Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem Danielle Saunders Bill Byrne AI4CE 27 137 0 09 Apr 2020
Exploring Benefits of Transfer Learning in Neural Machine Translation Tom Kocmi 29 17 0 06 Jan 2020
Tag-less Back-Translation Idris Abdulmumin B. Galadanci Aliyu Dadan Garba 19 11 0 22 Dec 2019
Neural Machine Translation: A Review and Survey Felix Stahlberg 3DV AI4TS MedIm 20 312 0 04 Dec 2019
A Constructive Prediction of the Generalization Error Across Scales Jonathan S. Rosenfeld Amir Rosenfeld Yonatan Belinkov Nir Shavit 36 205 0 27 Sep 2019
Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models Cheolhyoung Lee Kyunghyun Cho Wanmo Kang MoE 249 205 0 25 Sep 2019
Simple, Scalable Adaptation for Neural Machine Translation Ankur Bapna N. Arivazhagan Orhan Firat AI4CE 44 408 0 18 Sep 2019
Improving Robustness of Machine Translation with Synthetic Noise Vaibhav Sumeet Singh Craig Alan Stewart Graham Neubig 16 83 0 25 Feb 2019
Freezing Subnetworks to Analyze Domain Adaptation in Neural Machine Translation Brian Thompson Huda Khayrallah Antonios Anastasopoulos Arya D. McCarthy Kevin Duh Rebecca Marvin Paul McNamee Jeremy Gwinnup Tim Anderson Philipp Koehn 16 54 0 14 Sep 2018
Extreme Adaptation for Personalized Neural Machine Translation Paul Michel Graham Neubig 21 103 0 04 May 2018
Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Task Marcin Junczys-Dowmunt Roman Grundkiewicz Shubha Guha Kenneth Heafield 33 192 0 16 Apr 2018
Explicit Inductive Bias for Transfer Learning with Convolutional Networks Xuhong Li Yves Grandvalet Franck Davoine SSL 21 348 0 05 Feb 2018