Empowering Cross-lingual Abilities of Instruction-tuned Large Language Models by Translation-following demonstrations

27 August 2023

Papers citing "Empowering Cross-lingual Abilities of Instruction-tuned Large Language Models by Translation-following demonstrations"

28 / 28 papers shown

Title
Understanding LLMs' Cross-Lingual Context Retrieval: How Good It Is And Where It Comes From Changjiang Gao Hankun Lin Shujian Huang Xin Huang Xue Han Junlan Feng Chao Deng Jiajun Chen LRM 44 0 0 15 Apr 2025
Rethinking Multilingual Continual Pretraining: Data Mixing for Adapting LLMs Across Languages and Resources Zihao Li Shaoxiong Ji Hengyu Luo Jörg Tiedemann CLL 45 0 0 05 Apr 2025
Facilitating large language model Russian adaptation with Learned Embedding Propagation Mikhail Tikhomirov D. Chernyshev 25 1 0 31 Dec 2024
LLM-based Translation Inference with Iterative Bilingual Understanding Andong Chen Kehai Chen Yang Xiang Xuefeng Bai Muyun Yang Yang Feng T. Zhao Min Zhang LRM 79 5 0 31 Dec 2024
LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Reasoning Hongbin Zhang K. Chen Xuefeng Bai Yang Xiang Min Zhang 74 0 0 17 Dec 2024
Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languages Hoang Nguyen Khyati Mahajan Vikas Yadav Philip S. Yu Masoud Hashemi Rishabh Maheshwary Rishabh Maheshwary 43 0 0 04 Nov 2024
Bridging the Language Gaps in Large Language Models with Inference-Time Cross-Lingual Intervention Weixuan Wang Minghao Wu Barry Haddow Alexandra Birch LRM 21 2 0 16 Oct 2024
M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models Rishabh Maheshwary Vikas Yadav Hoang Nguyen Khyati Mahajan Sathwik Tejaswi Madhusudhan 37 3 0 24 Jun 2024
Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models Lynn Chua Badih Ghazi Yangsibo Huang Pritish Kamath Ravi Kumar Pasin Manurangsi Amer Sinha Chulin Xie Chiyuan Zhang 49 1 0 23 Jun 2024
Fine-tuning with HED-IT: The impact of human post-editing for dialogical language models Daniela Occhipinti Michele Marchi Irene Mondella Huiyuan Lai F. Dell’Orletta Malvina Nissim Marco Guerini 16 1 0 11 Jun 2024
Self-Refine Instruction-Tuning for Aligning Reasoning in Language Models Leonardo Ranaldi André Freitas LRM ReLM 29 8 0 01 May 2024
Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities Kazuki Fujii Taishi Nakamura Mengsay Loem Hiroki Iida Masanari Ohi Kakeru Hattori Hirai Shota Sakae Mizuki Rio Yokota Naoaki Okazaki CLL 22 53 0 27 Apr 2024
Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers Libo Qin Qiguang Chen Yuhang Zhou Zhi Chen Yinghui Li Lizi Liao Min Li Wanxiang Che Philip S. Yu LRM 47 35 0 07 Apr 2024
Teaching Llama a New Language Through Cross-Lingual Knowledge Transfer Hele-Andra Kuulmets Taido Purason Agnes Luhtaru Mark Fishel 21 17 0 05 Apr 2024
WangchanLion and WangchanX MRC Eval Wannaphong Phatthiyaphaibun Surapon Nonesung Patomporn Payoungkhamdee Peerat Limkonchotiwat Can Udomcharoenchaikit Jitkapat Sawatphol Chompakorn Chaksangchaichot E. Chuangsuwanich Sarana Nutanong 45 0 0 24 Mar 2024
Zero-shot cross-lingual transfer in instruction tuning of large language models Nadezhda Chirkova Vassilina Nikoulina LRM 35 3 0 22 Feb 2024
How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs? Ehsan Doostmohammadi Oskar Holmstrom Marco Kuhlmann 27 8 0 16 Feb 2024
PLUG: Leveraging Pivot Language in Cross-Lingual Instruction Tuning Zhihan Zhang Dong-Ho Lee Yuwei Fang W. Yu Mengzhao Jia Meng-Long Jiang Francesco Barbieri ALM 41 27 0 15 Nov 2023
Empowering Multi-step Reasoning across Languages via Tree-of-Thoughts Leonardo Ranaldi Giulia Pucci Federico Ranaldi Elena Sofia Ruzzetti Fabio Massimo Zanzotto LRM 16 12 0 14 Nov 2023
Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment Chong Li Shaonan Wang Jiajun Zhang Chengqing Zong 13 15 0 14 Nov 2023
HANS, are you clever? Clever Hans Effect Analysis of Neural Systems Leonardo Ranaldi Fabio Massimo Zanzotto 18 1 0 21 Sep 2023
Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca Pinzhen Chen Shaoxiong Ji Nikolay Bogoychev Andrey Kutuzov Barry Haddow Kenneth Heafield 15 43 0 16 Sep 2023
BayLing: Bridging Cross-lingual Alignment and Instruction Following through Interactive Translation for Large Language Models Shaolei Zhang Qingkai Fang Zhuocheng Zhang Zhengrui Ma Yan Zhou ... Mengyu Bu Shangtong Gui Yunji Chen Xilin Chen Yang Feng ALM 66 39 0 19 Jun 2023
Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages Elena Sofia Ruzzetti Federico Ranaldi F. Logozzo Michele Mastromattei Leonardo Ranaldi Fabio Massimo Zanzotto 19 8 0 03 May 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 245 1,977 0 31 Dec 2020
MLQA: Evaluating Cross-lingual Extractive Question Answering Patrick Lewis Barlas Oğuz Ruty Rinott Sebastian Riedel Holger Schwenk ELM 239 489 0 16 Oct 2019
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,791 0 17 Sep 2019