Scaling Laws for Multilingual Neural Machine Translation

19 February 2023

Papers citing "Scaling Laws for Multilingual Neural Machine Translation"

24 / 24 papers shown

Title
Florenz: Scaling Laws for Systematic Generalization in Vision-Language Models Julian Spravil Sebastian Houben Sven Behnke VLM 65 0 0 12 Mar 2025
(Mis)Fitting: A Survey of Scaling Laws Margaret Li Sneha Kudugunta Luke Zettlemoyer 63 2 0 26 Feb 2025
Scaling Laws for Downstream Task Performance in Machine Translation Berivan Isik Natalia Ponomareva Hussein Hazimeh Dimitris Paparas Sergei Vassilvitskii Sanmi Koyejo 100 3 0 24 Feb 2025
Scaling Laws for Multilingual Language Models Yifei He Alon Benhaim Barun Patra Praneetha Vaddamanu Sanchit Ahuja Parul Chopra Vishrav Chaudhary Han Zhao Xia Song 13 3 0 15 Oct 2024
Scaling Optimal LR Across Token Horizons Johan Bjorck Alon Benhaim Vishrav Chaudhary Furu Wei Xia Song 41 4 0 30 Sep 2024
EuroLLM: Multilingual Language Models for Europe Pedro Henrique Martins Patrick Fernandes Joao Alves Nuno M. Guerreiro Ricardo Rei ... Pierre Colombo Barry Haddow José G. C. de Souza Alexandra Birch André F. T. Martins 18 16 0 24 Sep 2024
Do Neural Scaling Laws Exist on Graph Self-Supervised Learning? Qian Ma Haitao Mao Jingzhe Liu Zhehua Zhang Chunlin Feng Yu Song Yihan Shao Yao Ma 25 3 0 20 Aug 2024
Reconciling Kaplan and Chinchilla Scaling Laws Tim Pearce Jinyeop Song 29 5 0 12 Jun 2024
LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation Yongjing Yin Jiali Zeng Yafu Li Fandong Meng Yue Zhang 26 1 0 03 Jun 2024
When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method Biao Zhang Zhongtao Liu Colin Cherry Orhan Firat LRM 39 119 0 27 Feb 2024
Selecting Large Language Model to Fine-tune via Rectified Scaling Law Haowei Lin Baizhou Huang Haotian Ye Qinyu Chen Zihao Wang Sujian Li Jianzhu Ma Xiaojun Wan James Y. Zou Yitao Liang 82 20 0 04 Feb 2024
CroissantLLM: A Truly Bilingual French-English Language Model Manuel Faysse Patrick Fernandes Nuno M. Guerreiro António Loison Duarte M. Alves ... François Yvon André F.T. Martins Gautier Viaud C´eline Hudelot Pierre Colombo 34 33 0 01 Feb 2024
The Universal Statistical Structure and Scaling Laws of Chaos and Turbulence Noam Levi Yaron Oz AI4CE 8 1 0 02 Nov 2023
A Benchmark for Learning to Translate a New Language from One Grammar Book Garrett Tanzer Mirac Suzgun Chenguang Xi Dan Jurafsky Luke Melas-Kyriazi 6 51 0 28 Sep 2023
The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets Noam Levi Yaron Oz 14 4 0 26 Jun 2023
Multilingual Large Language Models Are Not (Yet) Code-Switchers Ruochen Zhang Samuel Cahyawijaya Jan Christian Blaise Cruz Genta Indra Winata Alham Fikri Aji LRM 20 49 0 23 May 2023
When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale Christos Baziotis Biao Zhang Alexandra Birch Barry Haddow 17 2 0 23 May 2023
On the Pareto Front of Multilingual Neural Machine Translation Liang Chen Shuming Ma Dongdong Zhang Furu Wei Baobao Chang MoE 11 5 0 06 Apr 2023
Causes and Cures for Interference in Multilingual Translation Uri Shaham Maha Elbayad Vedanuj Goswami Omer Levy Shruti Bhosale 23 18 0 14 Dec 2022
Do Current Multi-Task Optimization Methods in Deep Learning Even Help? Derrick Xin Behrooz Ghorbani Ankush Garg Orhan Firat Justin Gilmer MoMe 61 61 0 23 Sep 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 203 1,651 0 15 Oct 2021
Learning Curve Theory Marcus Hutter 128 56 0 08 Feb 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 220 3,054 0 23 Jan 2020
Six Challenges for Neural Machine Translation Philipp Koehn Rebecca Knowles AAML AIMat 205 1,202 0 12 Jun 2017