v1v2 (latest)

LLaMA Beyond English: An Empirical Study on Language Capability Transfer

2 January 2024

Xuanjing Huang

ArXiv (abs)PDF HTML HuggingFace (56 upvotes)

Papers citing "LLaMA Beyond English: An Empirical Study on Language Capability Transfer"

29 / 29 papers shown

Title
Tracing Multilingual Knowledge Acquisition Dynamics in Domain Adaptation: A Case Study of English-Japanese Biomedical Adaptation Xin Zhao Naoki Yoshinaga Yuma Tsuta Akiko Aizawa 96 0 0 14 Oct 2025
Social Bias in Multilingual Language Models: A Survey Lance Calvin Lim Gamboa Yue Feng Mark Lee 219 0 0 27 Aug 2025
Multilingual Self-Taught Faithfulness Evaluators Carlo Alfano Aymen Al Marjani Zeno Jonke Amin Mantrach Saab Mansour Marcello Federico 118 0 0 28 Jul 2025
How and Where to Translate? The Impact of Translation Strategies in Cross-lingual LLM Prompting Aman Gupta Yingying Zhuang Zhou Yu Ziji Zhang Anurag Beniwal 106 0 0 21 Jul 2025
From Neurons to Semantics: Evaluating Cross-Linguistic Alignment Capabilities of Large Language Models via Neurons AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Chongxuan Huang Yongshi Ye Biao Fu Qifeng Su Xiaodong Shi 306 1 0 20 Jul 2025
ixi-GEN: Efficient Industrial sLLMs through Domain Adaptive Continual Pretraining Seonwu Kim Yohan Na Kihun Kim Hanhee Cho Geun Lim Mintae Kim Seongik Park Ki Hyun Kim Youngsub Han Byoung-Ki Jeon CLL 214 0 0 09 Jul 2025
Just Go Parallel: Improving the Multilingual Capabilities of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Muhammad Reza Qorib Junyi Li Hwee Tou Ng LRM 212 3 0 16 Jun 2025
Beyond Text Compression: Evaluating Tokenizers Across ScalesAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Jonas F. Lotz António V. Lopes Stephan Peitz Hendra Setiawan Leonardo Emili 255 2 0 03 Jun 2025
How does Alignment Enhance LLMs' Multilingual Capabilities? A Language Neurons Perspective Shimao Zhang Z. Lai Xiang Liu Shuaijie She Xiao Liu Yeyun Gong Shujian Huang Jiajun Chen 238 0 0 27 May 2025
Mechanistic Understanding and Mitigation of Language Confusion in English-Centric Large Language Models Ercong Nie Helmut Schmid Hinrich Schutze 313 3 0 22 May 2025
Enhancing Non-English Capabilities of English-Centric Large Language Models through Deep Supervision Fine-TuningAAAI Conference on Artificial Intelligence (AAAI), 2025 Wenshuai Huo Xiaocheng Feng Yichong Huang Chengpeng Fu Baohang Li ... Dandan Tu Duyu Tang Yunfei Lu Hui Wang Bing Qin 355 7 0 03 Mar 2025
Steering into New Embedding Spaces: Analyzing Cross-Lingual Alignment Induced by Model Interventions in Multilingual Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Anirudh Sundar Sinead Williamson Katherine Metcalf B. Theobald Skyler Seto Masha Fedzechkina LLMSV 319 5 0 21 Feb 2025
TituLLMs: A Family of Bangla LLMs with Comprehensive BenchmarkingAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Shahriar Kabir Nahin R. N. Nandi Sagor Sarker Quazi Sarwar Muhtaseem Md. Kowsher Apu Chandraw Shill Md Ibrahim Mehadi Hasan Menon Tareq Al Muntasir Firoj Alam 445 2 0 16 Feb 2025
Pipeline Analysis for Developing Instruct LLMs in Low-Resource Languages: A Case Study on Basque Ander Corral Ixak Sarasua Xabier Saralegi 155 2 0 18 Dec 2024
Code-Switching Curriculum Learning for Multilingual Transfer in LLMsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Haneul Yoo Cheonbok Park Sangdoo Yun Alice Oh Hwaran Lee 296 12 0 04 Nov 2024
Language Imbalance Driven Rewarding for Multilingual Self-improvingInternational Conference on Learning Representations (ICLR), 2024 Wen Yang Junhong Wu Chen Wang Chengqing Zong J.N. Zhang ALM LRM 490 21 0 11 Oct 2024
Extracting and Combining Abilities For Building Multi-lingual Ability-enhanced Large Language Models Zhipeng Chen Liang Song K. Zhou Wayne Xin Zhao Binghai Wang Weipeng Chen Ji-Rong Wen 314 0 0 10 Oct 2024
From Tokens to Words: On the Inner Lexicon of LLMsInternational Conference on Learning Representations (ICLR), 2024 Guy Kaplan Matanel Oren Yuval Reif Roy Schwartz 380 28 0 08 Oct 2024
sPhinX: Sample Efficient Multilingual Instruction Fine-Tuning Through N-shot Guided Prompting Sanchit Ahuja Kumar Tanmay Hardik Hansrajbhai Chauhan Barun Patra Kriti Aggarwal ... Tejas I. Dhamecha Ahmed Awadallah Monojit Choudhary Vishrav Chaudhary Sunayana Sitaram 394 4 0 13 Jul 2024
Understanding and Mitigating Language Confusion in LLMs Kelly Marchisio Wei-Yin Ko Alexandre Berard Théo Dehaze Sebastian Ruder 490 54 0 28 Jun 2024
Chumor 1.0: A Truly Funny and Challenging Chinese Humor Understanding Dataset from Ruo Zhi Ba Ruiqi He Yushu He Longju Bai Jiarui Liu Zhenjie Sun Zenghao Tang He Wang Hanchen Xia Naihao Deng 149 3 0 18 Jun 2024
Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs Weixuan Wang Barry Haddow Minghao Wu Alexandra Birch Alexandra Birch MILM 309 28 0 13 Jun 2024
Evaluating Contextually Personalized Programming Exercises Created with Generative AI E. Logacheva Arto Hellas James Prather Sami Sarsa Juho Leinonen 246 31 0 11 Jun 2024
Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities Kazuki Fujii Taishi Nakamura Mengsay Loem Hiroki Iida Masanari Ohi Kakeru Hattori Hirai Shota Sakae Mizuki Rio Yokota Naoaki Okazaki CLL 268 108 0 27 Apr 2024
Poro 34B and the Blessing of Multilinguality Risto Luukkonen Jonathan Burdge Elaine Zosa Aarne Talman Ville Komulainen Vaino Hatanpaa Peter Sarlin S. Pyysalo AI4CE 263 18 0 02 Apr 2024
Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language Models Seungduk Kim Seungtaek Choi Myeongho Jeong 200 9 0 22 Feb 2024
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages Yuan Zhang Yile Wang Zijun Liu Shuo Wang Xiaolong Wang Peng Li Maosong Sun Yang Liu LRM 255 31 0 19 Feb 2024
LEIA: Facilitating Cross-lingual Knowledge Transfer in Language Models with Entity-based Data Augmentation Ikuya Yamada Ryokan Ri KELM 234 3 0 18 Feb 2024
MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Divyanshu Aggarwal Ashutosh Sathe Ishaan Watts Sunayana Sitaram 193 3 0 15 Jan 2024