XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 659 papers shown

Title
Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering Arij Riabi Thomas Scialom Rachel Keraron Benoît Sagot Djamé Seddah Jacopo Staiano 140 52 0 23 Oct 2020
DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries Aditi Chaudhary K. Raman Krishna Srinivasan Jiecao Chen 27 24 0 23 Oct 2020
Multilingual BERT Post-Pretraining Alignment Lin Pan Chung-Wei Hang Haode Qi Abhishek Shah Saloni Potdar Mo Yu 96 44 0 23 Oct 2020
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond Xin Li Lidong Bing Wenxuan Zhang Zheng Li Wai Lam 42 25 0 23 Oct 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 191 286 0 23 Oct 2020
KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi Andre Niyongabo Rubungo Hong Qu Julia Kreutzer Li Huang 16 38 0 23 Oct 2020
Towards Zero-Shot Multilingual Synthetic Question and Answer Generation for Cross-Lingual Reading Comprehension Siamak Shakeri Noah Constant Mihir Kale Linting Xue SyDa 13 28 0 22 Oct 2020
mT5: A massively multilingual pre-trained text-to-text transformer Linting Xue Noah Constant Adam Roberts Mihir Kale Rami Al-Rfou Aditya Siddhant Aditya Barua Colin Raffel 8 2,436 0 22 Oct 2020
Looking for Clues of Language in Multilingual BERT to Improve Cross-lingual Generalization Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Chung-Yi Li Hung-yi Lee 15 3 0 20 Oct 2020
Explicit Alignment Objectives for Multilingual Bidirectional Encoders Junjie Hu Melvin Johnson Orhan Firat Aditya Siddhant Graham Neubig 10 56 0 15 Oct 2020
XL-WiC: A Multilingual Benchmark for Evaluating Semantic Contextualization Alessandro Raganato Tommaso Pasini Jose Camacho-Collados Mohammad Taher Pilehvar 6 60 0 13 Oct 2020
Multilingual Argument Mining: Datasets and Analysis Orith Toledo-Ronen Matan Orbach Yonatan Bilu Artem Spector Noam Slonim 29 34 0 13 Oct 2020
X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models Zhengbao Jiang Antonios Anastasopoulos Jun Araki Haibo Ding Graham Neubig HILM KELM 13 136 0 13 Oct 2020
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models Zirui Wang Yulia Tsvetkov Orhan Firat Yuan Cao 17 195 0 12 Oct 2020
Probing Pretrained Language Models for Lexical Semantics Ivan Vulić E. Ponti Robert Litschko Goran Glavas Anna Korhonen KELM 6 232 0 12 Oct 2020
Localizing Open-Ontology QA Semantic Parsers in a Day Using Machine Translation M. Moradshahi Giovanni Campagna Sina J. Semnani Silei Xu M. Lam 6 1 0 10 Oct 2020
Cross-lingual Extended Named Entity Classification of Wikipedia Articles Viet The Bui Hong Phuong Le 6 2 0 07 Oct 2020
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages Michael A. Hedderich David Ifeoluwa Adelani D. Zhu Jesujoba Oluwadara Alabi Udia Markus Dietrich Klakow 9 71 0 07 Oct 2020
On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment Zirui Wang Zachary Chase Lipton Yulia Tsvetkov 10 31 0 06 Oct 2020
Do Explicit Alignments Robustly Improve Multilingual Encoders? Shijie Wu Mark Dredze 12 7 0 06 Oct 2020
Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages W. Nekoto Vukosi Marivate T. Matsila Timi E. Fasubaa T. Kolawole ... A. Olabiyi A. Ramkilowan A. Oktem Adewale Akinfaderin Abdallah Bashir 24 198 0 05 Oct 2020
UNISON: Unpaired Cross-lingual Image Captioning Jiahui Gao Yi Zhou Philip L. H. Yu Shafiq R. Joty Jiuxiang Gu 8 16 0 03 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders Patrick Xia Shijie Wu Benjamin Van Durme 18 50 0 02 Oct 2020
Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study Saurabh Kulshreshtha José Luis Redondo García Ching-Yun Chang 22 46 0 29 Sep 2020
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding Yuwei Fang Shuohang Wang Zhe Gan S. Sun Jingjing Liu VLM 15 58 0 10 Sep 2020
MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmark Haoran Li Abhinav Arora Shuohui Chen Anchit Gupta Sonal Gupta Yashar Mehdad 29 170 0 21 Aug 2020
Inducing Language-Agnostic Multilingual Representations Wei-Ye Zhao Steffen Eger Johannes Bjerva Isabelle Augenstein 14 63 0 20 Aug 2020
Finding Fast Transformers: One-Shot Neural Architecture Search by Component Composition Henry Tsai Jayden Ooi Chun-Sung Ferng Hyung Won Chung Jason Riesa ViT 18 21 0 15 Aug 2020
Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation Goran Glavas Ivan Vulić 19 67 0 15 Aug 2020
Multilingual Translation with Extensible Multilingual Pretraining and Finetuning Y. Tang C. Tran Xian Li Peng-Jen Chen Naman Goyal Vishrav Chaudhary Jiatao Gu Angela Fan CLL 40 445 0 02 Aug 2020
On Learning Universal Representations Across Languages Xiangpeng Wei Rongxiang Weng Yue Hu Luxi Xing Heng Yu Weihua Luo SSL VLM 20 85 0 31 Jul 2020
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering Shayne Longpre Yi Lu Joachim Daiber ELM HILM 19 151 0 30 Jul 2020
Language-agnostic BERT Sentence Embedding Fangxiaoyu Feng Yinfei Yang Daniel Matthew Cer N. Arivazhagan Wei Wang 14 866 0 03 Jul 2020
A Bayesian Multilingual Document Model for Zero-shot Topic Identification and Discovery Santosh Kesiraju Sangeet Sagar Ondvrej Glembek Lukávs Burget Ján Černocký S. Gangashetty 13 0 0 02 Jul 2020
Pre-training via Paraphrasing M. Lewis Marjan Ghazvininejad Gargi Ghosh Armen Aghajanyan Sida I. Wang Luke Zettlemoyer AIMat 17 158 0 26 Jun 2020
Cross-lingual Retrieval for Iterative Self-Supervised Training C. Tran Y. Tang Xian Li Jiatao Gu RALM 23 72 0 16 Jun 2020
English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too Jason Phang Iacer Calixto Phu Mon Htut Yada Pruksachatkun Haokun Liu Clara Vania Katharina Kann Samuel R. Bowman LRM 25 66 0 26 May 2020
From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of Parsing Morphologically-Rich Languages (MRLs)? Reut Tsarfaty Dan Bareket Stav Klein Amit Seker 6 39 0 04 May 2020
On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation Wei-Ye Zhao Goran Glavavs Maxime Peyrard Yang Gao Robert West Steffen Eger ELM 13 63 0 03 May 2020
How Can We Accelerate Progress Towards Human-like Linguistic Generalization? Tal Linzen 216 188 0 03 May 2020
From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers Anne Lauscher Vinit Ravishankar Ivan Vulić Goran Glavas 6 56 0 01 May 2020
Identifying Necessary Elements for BERT's Multilinguality Philipp Dufter Hinrich Schütze 12 17 0 01 May 2020
XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning E. Ponti Goran Glavavs Olga Majewska Qianchu Liu Ivan Vulić Anna Korhonen LRM 4 301 0 01 May 2020
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 17 609 0 30 Apr 2020
Don't Use English Dev: On the Zero-Shot Cross-Lingual Evaluation of Contextual Embeddings Phillip Keung Y. Lu Julian Salazar Vikas Bhardwaj 19 14 0 30 Apr 2020
A Call for More Rigor in Unsupervised Cross-lingual Learning Mikel Artetxe Sebastian Ruder Dani Yogatama Gorka Labaka Eneko Agirre 8 72 0 30 Apr 2020
MLSUM: The Multilingual Summarization Corpus Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 17 172 0 30 Apr 2020
UXLA: A Robust Unsupervised Data Augmentation Framework for Zero-Resource Cross-Lingual NLP M Saiful Bari Tasnim Mohiuddin Shafiq R. Joty 18 24 0 28 Apr 2020
LAReQA: Language-agnostic answer retrieval from a multilingual pool Uma Roy Noah Constant Rami Al-Rfou Aditya Barua Aaron B. Phillips Yinfei Yang RALM 6 55 0 11 Apr 2020
On the Language Neutrality of Pre-trained Multilingual Representations Jindrich Libovický Rudolf Rosa Alexander M. Fraser 17 99 0 09 Apr 2020