Enhancing Multilingual Capabilities of Large Language Models through
Self-Distillation from Resource-Rich Languages

Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages

19 February 2024

Shuo Wang

Xiaolong Wang

Peng Li

Maosong Sun

Papers citing "Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages"

6 / 6 papers shown

Title
Enhancing LLM Language Adaption through Cross-lingual In-Context Pre-training Linjuan Wu H. Wei Huan Lin Tianhao Li Baosong Yang Weiming Lu 23 0 0 29 Apr 2025
AdaCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Chain-of-Thought Xin Huang Tarun K. Vangani Zhengyuan Liu Bowei Zou A. Aw LRM AI4CE 53 2 0 27 Jan 2025
Language Imbalance Driven Rewarding for Multilingual Self-improving Wen Yang Junhong Wu Chen Wang Chengqing Zong J. Zhang ALM LRM 52 4 0 11 Oct 2024
DEPT: Decoupled Embeddings for Pre-training Language Models Alex Iacob Lorenzo Sani Meghdad Kurmanji William F. Shen Xinchi Qiu Dongqi Cai Yan Gao Nicholas D. Lane VLM 43 0 0 07 Oct 2024
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
DirectQuote: A Dataset for Direct Quotation Extraction and Attribution in News Articles Yuan Zhang Yang Liu 27 11 0 15 Oct 2021