Breaking the Curse of Multilinguality with Cross-lingual Expert Language
Models

Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models

19 January 2024

Tomasz Limisiewicz

Suchin Gururangan

Luke Zettlemoyer

Papers citing "Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models"

6 / 6 papers shown

Title
AdaCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Chain-of-Thought Xin Huang Tarun K. Vangani Zhengyuan Liu Bowei Zou A. Aw LRM AI4CE 45 0 0 27 Jan 2025
Modular Sentence Encoders: Separating Language Specialization from Cross-Lingual Alignment Yongxin Huang Kexin Wang Goran Glavavs Iryna Gurevych 26 0 0 20 Jul 2024
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models Terra Blevins Hila Gonen Luke Zettlemoyer LRM 34 26 0 24 May 2022
Phylogeny-Inspired Adaptation of Multilingual Models to New Languages Fahim Faisal Antonios Anastasopoulos AI4CE LRM 23 26 0 19 May 2022
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference Sneha Kudugunta Yanping Huang Ankur Bapna M. Krikun Dmitry Lepikhin Minh-Thang Luong Orhan Firat MoE 119 87 0 24 Sep 2021
Larger-Scale Transformers for Multilingual Masked Language Modeling Naman Goyal Jingfei Du Myle Ott Giridhar Anantharaman Alexis Conneau 88 125 0 02 May 2021