Language Contamination Helps Explain the Cross-lingual Capabilities of
English Pretrained Models

Language Contamination Helps Explain the Cross-lingual Capabilities of English Pretrained Models

17 April 2022

Luke Zettlemoyer

Papers citing "Language Contamination Helps Explain the Cross-lingual Capabilities of English Pretrained Models"

11 / 11 papers shown

Title
Enhancing LLM Language Adaption through Cross-lingual In-Context Pre-training Linjuan Wu H. Wei Huan Lin Tianhao Li Baosong Yang Weiming Lu 26 0 0 29 Apr 2025
GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languages Amir Hossein Kargaran François Yvon Hinrich Schutze VLM 31 5 0 31 Oct 2024
Towards Robust Knowledge Representations in Multilingual LLMs for Equivalence and Inheritance based Consistent Reasoning Gaurav Arora Srujana Merugu Shreya Jain Vaibhav Saxena LRM 22 0 0 18 Oct 2024
Understanding and Mitigating Language Confusion in LLMs Kelly Marchisio Wei-Yin Ko Alexandre Berard Théo Dehaze Sebastian Ruder 49 23 0 28 Jun 2024
Benchmark Data Contamination of Large Language Models: A Survey Cheng Xu Shuhao Guan Derek Greene Mohand-Tahar Kechadi ELM ALM 34 38 0 06 Jun 2024
TIGQA:An Expert Annotated Question Answering Dataset in Tigrinya Hailay Teklehaymanot Dren Fazlija Niloy Ganguly Gourab K. Patro Wolfgang Nejdl 21 0 0 26 Apr 2024
CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment Geyu Lin Bin Wang Zhengyuan Liu Nancy F. Chen 32 7 0 18 Apr 2024
Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models J. Michaelov Catherine Arnett Tyler A. Chang Benjamin Bergen 34 12 0 15 Nov 2023
How Good are Commercial Large Language Models on African Languages? Jessica Ojo Kelechi Ogueji 19 5 0 11 May 2023
Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection Suchin Gururangan Dallas Card Sarah K. Drier E. K. Gade Leroy Z. Wang Zeyu Wang Luke Zettlemoyer Noah A. Smith 160 72 0 25 Jan 2022
Cross-lingual Transfer of Monolingual Models Evangelia Gogoulou Ariel Ekgren T. Isbister Magnus Sahlgren 27 16 0 15 Sep 2021