XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 659 papers shown

Title
Transformers for Headline Selection for Russian News Clusters Pavel Voropaev Olga Sopilnyak 11 0 0 19 Jun 2021
GEM: A General Evaluation Benchmark for Multimodal Tasks Lin Su Nan Duan Edward Cui Lei Ji Chenfei Wu Huaishao Luo Yongfei Liu Ming Zhong Taroon Bharti Arun Sacheti VLM 11 19 0 18 Jun 2021
X-FACT: A New Benchmark Dataset for Multilingual Fact Checking Ashim Gupta Vivek Srikumar HILM 4 95 0 17 Jun 2021
Automatic Construction of Evaluation Suites for Natural Language Generation Datasets Simon Mille Kaustubh D. Dhole Saad Mahamood Laura Perez-Beltrachini Varun Gangal Mihir Kale Emiel van Miltenburg Sebastian Gehrmann ELM 21 22 0 16 Jun 2021
Consistency Regularization for Cross-Lingual Fine-Tuning Bo Zheng Li Dong Shaohan Huang Wenhui Wang Zewen Chi Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei 9 58 0 15 Jun 2021
Challenges and Considerations with Code-Mixed NLP for Multilingual Societies Vivek Srivastava M. Singh 4 5 0 15 Jun 2021
Modeling Profanity and Hate Speech in Social Media with Semantic Subspaces Vanessa Hahn Dana Ruiter Thomas Kleinbauer Dietrich Klakow 8 7 0 14 Jun 2021
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning Bill Yuchen Lin Seyeon Lee Xiaoyang Qiao Xiang Ren ReLM LRM 22 61 0 13 Jun 2021
Assessing Multilingual Fairness in Pre-trained Multimodal Representations Jialu Wang Yang Liu X. Wang EGVM 11 35 0 12 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 45 67 0 11 Jun 2021
A Discussion on Building Practical NLP Leaderboards: The Case of Machine Translation Sebastin Santy Prasanta Bhattacharya LLMAG 25 2 0 11 Jun 2021
Learning Multilingual Representation for Natural Language Understanding with Enhanced Cross-Lingual Supervision Yinpeng Guo Liangyou Li Xin Jiang Qun Liu 11 0 0 09 Jun 2021
Probing Multilingual Language Models for Discourse Murathan Kurfali Robert Östling 17 17 0 09 Jun 2021
VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation Linjie Li Jie Lei Zhe Gan Licheng Yu Yen-Chun Chen ... Tamara L. Berg Mohit Bansal Jingjing Liu Lijuan Wang Zicheng Liu VLM 24 100 0 08 Jun 2021
Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study Yash Khemchandani Sarvesh Mehtani Vaidehi Patil Abhijeet Awasthi Partha P. Talukdar Sunita Sarawagi 14 32 0 07 Jun 2021
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation Ruidan He Linlin Liu Hai Ye Qingyu Tan Bosheng Ding Liying Cheng Jia-Wei Low Lidong Bing Luo Si 19 196 0 06 Jun 2021
MergeDistill: Merging Pre-trained Language Models using Distillation Simran Khanuja Melvin Johnson Partha P. Talukdar 19 16 0 05 Jun 2021
nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models? Mihir Kale Aditya Siddhant Noah Constant Melvin Johnson Rami Al-Rfou Linting Xue LRM 21 25 0 03 Jun 2021
Syntax-augmented Multilingual BERT for Cross-lingual Transfer Wasi Uddin Ahmad Haoran Li Kai-Wei Chang Yashar Mehdad 31 34 0 03 Jun 2021
How to Adapt Your Pretrained Multilingual Model to 1600 Languages Abteen Ebrahimi Katharina Kann LRM VLM 17 67 0 03 Jun 2021
Language Embeddings for Typology and Cross-lingual Transfer Learning Dian Yu Taiqi He Kenji Sagae 19 12 0 03 Jun 2021
A Dataset and Baselines for Multilingual Reply Suggestion Mozhi Zhang Wei Wang Budhaditya Deb Guoqing Zheng Milad Shokouhi Ahmed Hassan Awadallah LRM 9 8 0 03 Jun 2021
Self-Guided Contrastive Learning for BERT Sentence Representations Taeuk Kim Kang Min Yoo Sang-goo Lee SSL 20 202 0 03 Jun 2021
ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language Generation Kaushal Kumar Maurya M. Desarkar Yoshinobu Kano K. Deepshikha 8 38 0 03 Jun 2021
NewsEmbed: Modeling News through Pre-trained Document Representations Jialu Liu Tianqi Liu Cong Yu VLM 162 12 0 01 Jun 2021
Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking Fangyu Liu Ivan Vulić Anna Korhonen Nigel Collier 20 49 0 30 May 2021
ByT5: Towards a token-free future with pre-trained byte-to-byte models Linting Xue Aditya Barua Noah Constant Rami Al-Rfou Sharan Narang Mihir Kale Adam Roberts Colin Raffel 14 464 0 28 May 2021
Deception detection in text and its relation to the cultural dimension of individualism/collectivism Katerina Papantoniou P. Papadakos T. Patkos G. Flouris Ion Androutsopoulos Dimitris Plexousakis 30 7 0 26 May 2021
Cross-lingual Text Classification with Heterogeneous Graph Neural Network ZiYun Wang Xuan Liu Pei-Yin Yang Shixing Liu Zhisheng Wang 23 32 0 24 May 2021
KLUE: Korean Language Understanding Evaluation Sungjoon Park Jihyung Moon Sungdong Kim Won Ik Cho Jiyoon Han ... Seonghyun Kim Lucy Park Alice H. Oh Jung-Woo Ha Kyunghyun Cho ELM VLM 14 191 0 20 May 2021
Analysing The Impact Of Linguistic Features On Cross-Lingual Transfer B. Dolički Gerasimos Spanakis 13 16 0 12 May 2021
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models Laura Pérez-Mayos Alba Táboas García Simon Mille Leo Wanner ELM LRM 8 8 0 10 May 2021
XeroAlign: Zero-Shot Cross-lingual Transformer Alignment Milan Gritta Ignacio Iacobacci 17 19 0 06 May 2021
MOROCCO: Model Resource Comparison Framework Valentin Malykh Alexander Kukushkin Ekaterina Artemova Vladislav Mikhailov Maria Tikhonova Tatiana Shavrina 11 0 0 29 Apr 2021
Morph Call: Probing Morphosyntactic Content of Multilingual Transformers Vladislav Mikhailov O. Serikov Ekaterina Artemova 12 9 0 26 Apr 2021
XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond Francesco Barbieri Luis Espinosa Anke Jose Camacho-Collados 79 213 0 25 Apr 2021
Problems and Countermeasures in Natural Language Processing Evaluation Qingxiu Dong Zhifang Sui W. Zhan Baobao Chang ELM 11 2 0 20 Apr 2021
X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering Meryem M'hamdi Doo Soon Kim Franck Dernoncourt Trung Bui Xiang Ren Jonathan May 14 20 0 20 Apr 2021
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training Chenyi Lei Shixian Luo Yong-jin Liu Wanggui He Jiamang Wang Guoxin Wang Haihong Tang C. Miao Houqiang Li 28 41 0 19 Apr 2021
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding Yiheng Xu Tengchao Lv Lei Cui Guoxin Wang Yijuan Lu D. Florêncio Cha Zhang Furu Wei MLLM VLM 10 127 0 18 Apr 2021
Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders Guanhua Chen Shuming Ma Yun-Nung Chen Li Dong Dongdong Zhang Jianxiong Pan Wenping Wang Furu Wei 24 39 0 18 Apr 2021
AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages Abteen Ebrahimi Manuel Mager Arturo Oncevay Vishrav Chaudhary Luis Chiruzzo ... Graham Neubig Alexis Palmer Rolando A. Coto Solano Ngoc Thang Vu Katharina Kann 102 71 0 18 Apr 2021
A Simple and Effective Positional Encoding for Transformers Pu-Chin Chen Henry Tsai Srinadh Bhojanapalli Hyung Won Chung Yin-Wen Chang Chun-Sung Ferng 59 62 0 18 Apr 2021
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs Zewen Chi Li Dong Shuming Ma Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei LRM 45 71 0 18 Apr 2021
Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training Kuan-Hao Huang Wasi Uddin Ahmad Nanyun Peng Kai-Wei Chang AAML 89 33 0 17 Apr 2021
Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems E. Razumovskaia Goran Glavavs Olga Majewska E. Ponti Anna Korhonen Ivan Vulić 13 32 0 17 Apr 2021
Multilingual and Cross-Lingual Intent Detection from Spoken Data D. Gerz Pei-hao Su Razvan Kusztos Avishek Mondal M. Lis Eshan Singhal N. Mrksic Tsung-Hsien Wen Ivan Vulić 10 35 0 17 Apr 2021
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation Sebastian Ruder Noah Constant Jan A. Botha Aditya Siddhant Orhan Firat ... Pengfei Liu Junjie Hu Dan Garrette Graham Neubig Melvin Johnson ELM AAML LRM 8 183 0 15 Apr 2021
ExplainaBoard: An Explainable Leaderboard for NLP Pengfei Liu Jinlan Fu Yanghua Xiao Weizhe Yuan Shuaichen Chang Junqi Dai Yixin Liu Zihuiwen Ye Zi-Yi Dou Graham Neubig XAI LRM ELM 15 54 0 13 Apr 2021
Sentiment-based Candidate Selection for NMT Alex Jones Derry Wijaya 8 2 0 10 Apr 2021