Title
Just Go Parallel: Improving the Multilingual Capabilities of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Muhammad Reza Qorib Junyi Li Hwee Tou Ng LRM 172 3 0 16 Jun 2025
An Empirical Study of Many-to-Many Summarization with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Jiaan Wang Fandong Meng Zengkui Sun Yunlong Liang Yuxuan Cao Jiarong Xu Haoxiang Shi Jie Zhou 176 0 0 19 May 2025
Large Language Models for UAVs: Current State and Pathways to the FutureIEEE Open Journal of Vehicular Technology (OJVT), 2024 Shumaila Javaid Nasir Saeed Bin He 239 66 0 02 May 2024
SumTra: A Differentiable Pipeline for Few-Shot Cross-Lingual Summarization Jacob Parnell Inigo Jauregi Unanue Massimo Piccardi 136 4 0 20 Mar 2024
Fast Training of NMT Model with Data Sorting Daniela N. Rim Kimera Richard Heeyoul Choi 66 0 0 16 Aug 2023
Towards Effective Ancient Chinese Translation: Dataset, Model, and EvaluationNatural Language Processing and Chinese Computing (NLPCC), 2023 Geyang Guo Jiarong Yang Fengyuan Lu Jiaxin Qin Tianyi Tang Wayne Xin Zhao 97 10 0 01 Aug 2023
Cross-Lingual Supervision improves Large Language Models Pre-training Andrea Schioppa Xavier Garcia Orhan Firat LRM 120 12 0 19 May 2023
The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech TranslationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Mutian He Philip N. Garner 295 5 0 16 May 2023
Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue GenerationAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023 Lei Liu J. Huang CLL 173 5 0 12 May 2023
PEACH: Pre-Training Sequence-to-Sequence Multilingual Models for Translation with Semi-Supervised Pseudo-Parallel Document Generation Alireza Salemi Amirhossein Abaskohi Sara Tavakoli Yadollah Yaghoobzadeh A. Shakery AIMat 197 0 0 03 Apr 2023
XWikiGen: Cross-lingual Summarization for Encyclopedic Text Generation in Low Resource LanguagesThe Web Conference (WWW), 2023 Dhaval Taunk Shivprasad Sagare Anupam Patil Shivansh Subramanian Manish Gupta Vasudeva Varma 149 3 0 22 Mar 2023
Towards Zero-Shot Functional Compositionality of Language Models Hangyeol Yu Myeongho Jeong Jamin Shin Hyeongdon Moon Juneyoung Park Seungtaek Choi 196 2 0 06 Mar 2023
Zero-Shot Cross-Lingual Summarization via Large Language Models Jiaan Wang Yunlong Liang Fandong Meng Beiqi Zou Zhixu Li Jianfeng Qu Jie Zhou ELM 265 37 0 28 Feb 2023
GanLM: Encoder-Decoder Pre-training with an Auxiliary DiscriminatorAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Jian Yang Shuming Ma Li Dong Shaohan Huang Haoyang Huang Yuwei Yin Dongdong Zhang Liqun Yang Furu Wei Zhoujun Li SyDa AI4CE 149 27 0 20 Dec 2022
Advancing Multilingual Pre-training: TRIP Triangular Document-level Pre-training for Multilingual Language Models Hongyuan Lu Haoyang Huang Shuming Ma Dongdong Zhang W. Lam Furu Wei 172 4 0 15 Dec 2022
Understanding Translationese in Cross-Lingual SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Jiaan Wang Fandong Meng Yunlong Liang Tingyi Zhang Jiarong Xu Zhixu Li Jie Zhou 185 19 0 14 Dec 2022
Event Extraction: A Survey Viet Dac Lai 277 10 0 07 Oct 2022
XF2T: Cross-lingual Fact-to-Text Generation for Low-Resource LanguagesInternational Conference on Natural Language Generation (INLG), 2022 Shivprasad Sagare Tushar Abhishek Bhavyajeet Singh Anubhav Sharma Manish Gupta Vasudeva Varma 102 2 0 22 Sep 2022
Polyglot Prompt: Multilingual Multitask PrompTrainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Jinlan Fu See-Kiong Ng Pengfei Liu 154 11 0 29 Apr 2022
Cross-Lingual Query-Based Summarization of Crisis-Related Social Media: An Abstractive Approach Using TransformersACM Conference on Hypertext & Social Media (HT), 2022 Fedor Vitiugin Carlos Castillo 163 12 0 21 Apr 2022
Cross-Lingual Phrase RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Heqi Zheng Xiao Zhang Zewen Chi Heyan Huang T. Yan Tian Lan Wei Wei Xian-Ling Mao RALM LRM 136 3 0 19 Apr 2022
A Survey on Cross-Lingual SummarizationTransactions of the Association for Computational Linguistics (TACL), 2022 Jiaan Wang Fandong Meng Duo Zheng Yunlong Liang Zhixu Li Jianfeng Qu Jie Zhou AILaw 153 73 0 23 Mar 2022
ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Jiaan Wang Fandong Meng Ziyao Lu Duo Zheng Zhixu Li Jianfeng Qu Jie Zhou ELM 280 38 0 11 Feb 2022
CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Yuan-Fang Li Yong-Bin Kang Rifat Shahriyar RALM ELM 153 48 0 16 Dec 2021
DOCmT5: Document-Level Pretraining of Multilingual Language Models Chia-Hsuan Lee Aditya Siddhant Viresh Ratnakar Melvin Johnson LRM 128 13 0 16 Dec 2021
Cross-Lingual Language Model Meta-Pretraining Zewen Chi Heyan Huang Luyang Liu Yu Bai Xian-Ling Mao LRM 362 0 0 23 Sep 2021
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training Bo Zheng Li Dong Shaohan Huang Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei VLM 138 25 0 15 Sep 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 267 307 0 12 Aug 2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining Machel Reid Mikel Artetxe VLM 183 30 0 04 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing Surveys (CSUR), 2021 Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 724 4,744 0 28 Jul 2021
XLM-E: Cross-lingual Language Model Pre-training via ELECTRAAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Zewen Chi Shaohan Huang Li Dong Shuming Ma Bo Zheng ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei 207 127 0 30 Jun 2021
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders Shuming Ma Li Dong Shaohan Huang Dongdong Zhang Alexandre Muzio Saksham Singhal Hany Awadalla Xia Song Furu Wei SLR AI4CE 179 88 0 25 Jun 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 764 3,332 0 15 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 181 79 0 11 Jun 2021
Tailoring and Evaluating the Wikipedia for in-Domain Comparable Corpora ExtractionKnowledge and Information Systems (KAIS), 2020 C. España-Bonet Alberto Barrón-Cedeño Lluís Marquez 106 9 0 03 May 2020
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse LanguagesTransactions of the Association for Computational Linguistics (TACL), 2020 J. Clark Eunsol Choi Michael Collins Dan Garrette Tom Kwiatkowski Vitaly Nikolaev J. Palomaki 524 683 0 10 Mar 2020

Home
Papers
2104.08692
Cited By

v1v2 (latest)

MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021

18 April 2021

Zewen Chi

Li Dong

Shuming Ma

Shaohan Huang Xian-Ling Mao

Papers citing "MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs"

36 / 36 papers shown

Title
Just Go Parallel: Improving the Multilingual Capabilities of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Muhammad Reza Qorib Junyi Li Hwee Tou Ng LRM 172 3 0 16 Jun 2025
An Empirical Study of Many-to-Many Summarization with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Jiaan Wang Fandong Meng Zengkui Sun Yunlong Liang Yuxuan Cao Jiarong Xu Haoxiang Shi Jie Zhou 176 0 0 19 May 2025
Large Language Models for UAVs: Current State and Pathways to the FutureIEEE Open Journal of Vehicular Technology (OJVT), 2024 Shumaila Javaid Nasir Saeed Bin He 239 66 0 02 May 2024
SumTra: A Differentiable Pipeline for Few-Shot Cross-Lingual Summarization Jacob Parnell Inigo Jauregi Unanue Massimo Piccardi 136 4 0 20 Mar 2024
Fast Training of NMT Model with Data Sorting Daniela N. Rim Kimera Richard Heeyoul Choi 66 0 0 16 Aug 2023
Towards Effective Ancient Chinese Translation: Dataset, Model, and EvaluationNatural Language Processing and Chinese Computing (NLPCC), 2023 Geyang Guo Jiarong Yang Fengyuan Lu Jiaxin Qin Tianyi Tang Wayne Xin Zhao 97 10 0 01 Aug 2023
Cross-Lingual Supervision improves Large Language Models Pre-training Andrea Schioppa Xavier Garcia Orhan Firat LRM 120 12 0 19 May 2023
The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech TranslationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Mutian He Philip N. Garner 295 5 0 16 May 2023
Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue GenerationAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023 Lei Liu J. Huang CLL 173 5 0 12 May 2023
PEACH: Pre-Training Sequence-to-Sequence Multilingual Models for Translation with Semi-Supervised Pseudo-Parallel Document Generation Alireza Salemi Amirhossein Abaskohi Sara Tavakoli Yadollah Yaghoobzadeh A. Shakery AIMat 197 0 0 03 Apr 2023
XWikiGen: Cross-lingual Summarization for Encyclopedic Text Generation in Low Resource LanguagesThe Web Conference (WWW), 2023 Dhaval Taunk Shivprasad Sagare Anupam Patil Shivansh Subramanian Manish Gupta Vasudeva Varma 149 3 0 22 Mar 2023
Towards Zero-Shot Functional Compositionality of Language Models Hangyeol Yu Myeongho Jeong Jamin Shin Hyeongdon Moon Juneyoung Park Seungtaek Choi 196 2 0 06 Mar 2023
Zero-Shot Cross-Lingual Summarization via Large Language Models Jiaan Wang Yunlong Liang Fandong Meng Beiqi Zou Zhixu Li Jianfeng Qu Jie Zhou ELM 265 37 0 28 Feb 2023
GanLM: Encoder-Decoder Pre-training with an Auxiliary DiscriminatorAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Jian Yang Shuming Ma Li Dong Shaohan Huang Haoyang Huang Yuwei Yin Dongdong Zhang Liqun Yang Furu Wei Zhoujun Li SyDa AI4CE 149 27 0 20 Dec 2022
Advancing Multilingual Pre-training: TRIP Triangular Document-level Pre-training for Multilingual Language Models Hongyuan Lu Haoyang Huang Shuming Ma Dongdong Zhang W. Lam Furu Wei 172 4 0 15 Dec 2022
Understanding Translationese in Cross-Lingual SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Jiaan Wang Fandong Meng Yunlong Liang Tingyi Zhang Jiarong Xu Zhixu Li Jie Zhou 185 19 0 14 Dec 2022
Event Extraction: A Survey Viet Dac Lai 277 10 0 07 Oct 2022
XF2T: Cross-lingual Fact-to-Text Generation for Low-Resource LanguagesInternational Conference on Natural Language Generation (INLG), 2022 Shivprasad Sagare Tushar Abhishek Bhavyajeet Singh Anubhav Sharma Manish Gupta Vasudeva Varma 102 2 0 22 Sep 2022
Polyglot Prompt: Multilingual Multitask PrompTrainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Jinlan Fu See-Kiong Ng Pengfei Liu 154 11 0 29 Apr 2022
Cross-Lingual Query-Based Summarization of Crisis-Related Social Media: An Abstractive Approach Using TransformersACM Conference on Hypertext & Social Media (HT), 2022 Fedor Vitiugin Carlos Castillo 163 12 0 21 Apr 2022
Cross-Lingual Phrase RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Heqi Zheng Xiao Zhang Zewen Chi Heyan Huang T. Yan Tian Lan Wei Wei Xian-Ling Mao RALM LRM 136 3 0 19 Apr 2022
A Survey on Cross-Lingual SummarizationTransactions of the Association for Computational Linguistics (TACL), 2022 Jiaan Wang Fandong Meng Duo Zheng Yunlong Liang Zhixu Li Jianfeng Qu Jie Zhou AILaw 153 73 0 23 Mar 2022
ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Jiaan Wang Fandong Meng Ziyao Lu Duo Zheng Zhixu Li Jianfeng Qu Jie Zhou ELM 280 38 0 11 Feb 2022
CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Yuan-Fang Li Yong-Bin Kang Rifat Shahriyar RALM ELM 153 48 0 16 Dec 2021
DOCmT5: Document-Level Pretraining of Multilingual Language Models Chia-Hsuan Lee Aditya Siddhant Viresh Ratnakar Melvin Johnson LRM 128 13 0 16 Dec 2021
Cross-Lingual Language Model Meta-Pretraining Zewen Chi Heyan Huang Luyang Liu Yu Bai Xian-Ling Mao LRM 362 0 0 23 Sep 2021
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training Bo Zheng Li Dong Shaohan Huang Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei VLM 138 25 0 15 Sep 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 267 307 0 12 Aug 2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining Machel Reid Mikel Artetxe VLM 183 30 0 04 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing Surveys (CSUR), 2021 Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 724 4,744 0 28 Jul 2021
XLM-E: Cross-lingual Language Model Pre-training via ELECTRAAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Zewen Chi Shaohan Huang Li Dong Shuming Ma Bo Zheng ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei 207 127 0 30 Jun 2021
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders Shuming Ma Li Dong Shaohan Huang Dongdong Zhang Alexandre Muzio Saksham Singhal Hany Awadalla Xia Song Furu Wei SLR AI4CE 179 88 0 25 Jun 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 764 3,332 0 15 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 181 79 0 11 Jun 2021
Tailoring and Evaluating the Wikipedia for in-Domain Comparable Corpora ExtractionKnowledge and Information Systems (KAIS), 2020 C. España-Bonet Alberto Barrón-Cedeño Lluís Marquez 106 9 0 03 May 2020
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse LanguagesTransactions of the Association for Computational Linguistics (TACL), 2020 J. Clark Eunsol Choi Michael Collins Dan Garrette Tom Kwiatkowski Vitaly Nikolaev J. Palomaki 524 683 0 10 Mar 2020