Breaking the Curse of Multilinguality with Cross-lingual Expert Language
Models

Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models

19 January 2024

Tomasz Limisiewicz

Suchin Gururangan

Luke Zettlemoyer

Papers citing "Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models"

5 / 5 papers shown

Title
AdaCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Chain-of-Thought Xin Huang Tarun K. Vangani Zhengyuan Liu Bowei Zou A. Aw LRM AI4CE 43 0 0 27 Jan 2025
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models Terra Blevins Hila Gonen Luke Zettlemoyer LRM 31 26 0 24 May 2022
Phylogeny-Inspired Adaptation of Multilingual Models to New Languages Fahim Faisal Antonios Anastasopoulos AI4CE LRM 23 26 0 19 May 2022
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference Sneha Kudugunta Yanping Huang Ankur Bapna M. Krikun Dmitry Lepikhin Minh-Thang Luong Orhan Firat MoE 116 87 0 24 Sep 2021
Larger-Scale Transformers for Multilingual Masked Language Modeling Naman Goyal Jingfei Du Myle Ott Giridhar Anantharaman Alexis Conneau 88 125 0 02 May 2021