Title
EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models Shaoxiong Ji Zihao Li Indraneil Paul Jaakko Paavola Peiqin Lin ... Dayyán O'Brien Hengyu Luo Hinrich Schütze Jörg Tiedemann Barry Haddow CLL 35 3 0 26 Sep 2024
Goldfish: Monolingual Language Models for 350 Languages Tyler A. Chang Catherine Arnett Zhuowen Tu Benjamin Bergen LRM 36 4 0 19 Aug 2024
Recent Advancements and Challenges of Turkic Central Asian Language Processing Yana Veitsman 31 2 0 06 Jul 2024
DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languages Fahim Faisal Orevaoghene Ahia Aarohi Srivastava Kabir Ahuja David Chiang Yulia Tsvetkov Antonios Anastasopoulos 56 26 0 16 Mar 2024
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model A. Ustun Viraat Aryabumi Zheng-Xin Yong Wei-Yin Ko Daniel D'souza ... Shayne Longpre Niklas Muennighoff Marzieh Fadaee Julia Kreutzer Sara Hooker ALM ELM SyDa LRM 27 192 0 12 Feb 2024
GlotLID: Language Identification for Low-Resource Languages Amir Hossein Kargaran Ayyoob Imani François Yvon Hinrich Schütze 20 10 0 24 Oct 2023
Benchmarking Multilabel Topic Classification in the Kyrgyz Language Anton M. Alekseev Sergey I. Nikolenko Gulnara Kabaeva 16 3 0 30 Aug 2023
An Open Dataset and Model for Language Identification Laurie Burchell Alexandra Birch Nikolay Bogoychev Kenneth Heafield 6 32 0 23 May 2023
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages Ayyoob Imani Peiqin Lin Amir Hossein Kargaran Silvia Severini Masoud Jalili Sabet ... Chunlan Ma Helmut Schmid André F. T. Martins François Yvon Hinrich Schütze ALM LRM 29 95 0 20 May 2023
Fixing MoE Over-Fitting on Low-Resource Languages in Multilingual Machine Translation Maha Elbayad Anna Y. Sun Shruti Bhosale MoE 33 8 0 15 Dec 2022
What a Creole Wants, What a Creole Needs Heather Lent Kelechi Ogueji Miryam de Lhoneux Orevaoghene Ahia Anders Søgaard 13 25 0 01 Jun 2022
Building Machine Translation Systems for the Next Thousand Languages Ankur Bapna Isaac Caswell Julia Kreutzer Orhan Firat D. Esch ... Apurva Shah Yanping Huang Z. Chen Yonghui Wu Macduff Hughes 49 98 0 09 May 2022
Quantifying Synthesis and Fusion and their Impact on Machine Translation Arturo Oncevay Duygu Ataman N. V. Berkel Barry Haddow Alexandra Birch Johannes Bjerva 12 3 0 06 May 2022
Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval Robert Litschko Ivan Vulić Goran Glavavs LRM 19 13 0 05 Apr 2022
Evaluating Multiway Multilingual NMT in the Turkic Languages Jamshidbek Mirzakhalov A. Babu Aigiz Kunafin Ahsan Wahab Behzodbek Moydinboyev ... Julia Kreutzer Francis M. Tyers Orhan Firat John Licato Sriram Chellappan ELM 23 9 0 13 Sep 2021
The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MT Jörg Tiedemann 160 163 0 13 Oct 2020