XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 659 papers shown

Title
Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation Tu Vu Aditya Barua Brian Lester Daniel Matthew Cer Mohit Iyyer Noah Constant CLL 16 64 0 25 May 2022
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer A. Ustun Arianna Bisazza G. Bouma Gertjan van Noord Sebastian Ruder 46 32 0 24 May 2022
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models Terra Blevins Hila Gonen Luke Zettlemoyer LRM 54 26 0 24 May 2022
Utilizing Language-Image Pretraining for Efficient and Robust Bilingual Word Alignment Tuan Dinh Jy-yong Sohn Shashank Rajput Timothy Ossowski Yifei Ming Junjie Hu Dimitris Papailiopoulos Kangwook Lee 16 0 0 23 May 2022
Local Byte Fusion for Neural Machine Translation Makesh Narsimhan Sreedhar Xiangpeng Wan Yu-Jie Cheng Junjie Hu 22 4 0 23 May 2022
RuNNE-2022 Shared Task: Recognizing Nested Named Entities Ekaterina Artemova Maxim Zmeev Natalia V. Loukachevitch I. Rozhkov Tatiana Batura V. Ivanov E. Tutubalina 9 8 0 23 May 2022
Please, Don't Forget the Difference and the Confidence Interval when Seeking for the State-of-the-Art Status Yves Bestgen 24 3 0 23 May 2022
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Rifat Shahriyar AIMat LM&MA 26 28 0 23 May 2022
The Geometry of Multilingual Language Model Representations Tyler A. Chang Z. Tu Benjamin Bergen 16 56 0 22 May 2022
Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog Chia-Chien Hung Anne Lauscher Ivan Vulić Simone Paolo Ponzetto Goran Glavavs 23 34 0 20 May 2022
Persian Natural Language Inference: A Meta-learning approach Heydar Soudani Mohammadreza Mojab H. Beigy 32 1 0 18 May 2022
OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrieval Tong Niu Kazuma Hashimoto Yingbo Zhou Caiming Xiong VLM 27 5 0 17 May 2022
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT Beiduo Chen Wu Guo Quan Liu Kun Tao 29 1 0 17 May 2022
Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages Kabir Ahuja Sandipan Dandapat Sunayana Sitaram Monojit Choudhury LRM 39 16 0 12 May 2022
On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data Kabir Ahuja Monojit Choudhury Sandipan Dandapat 21 3 0 12 May 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers Jonas Pfeiffer Naman Goyal Xi Victoria Lin Xian Li James Cross Sebastian Riedel Mikel Artetxe LRM 40 138 0 12 May 2022
Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models Kabir Ahuja Shanu Kumar Sandipan Dandapat Monojit Choudhury 9 25 0 12 May 2022
EASE: Entity-Aware Contrastive Learning of Sentence Embedding Sosuke Nishikawa Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka Isao Echizen 20 29 0 09 May 2022
Enhancing Cross-lingual Transfer by Manifold Mixup Huiyun Yang Huadong Chen Hao Zhou Lei Li AAML 12 44 0 09 May 2022
A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank Daniel Malkin Tomasz Limisiewicz Gabriel Stanovsky 8 24 0 09 May 2022
Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification Yanghua Xiao Jinlan Fu See-Kiong Ng Pengfei Liu 15 2 0 04 May 2022
Meta Learning for Natural Language Processing: A Survey Hung-yi Lee Shang-Wen Li Ngoc Thang Vu 49 42 0 03 May 2022
Polyglot Prompt: Multilingual Multitask PrompTraining Jinlan Fu See-Kiong Ng Pengfei Liu 17 7 0 29 Apr 2022
Czech Dataset for Cross-lingual Subjectivity Classification Pavel Přibáň J. Steinberger 34 4 0 29 Apr 2022
Por Qué Não Utiliser Alla Språk? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer Haoran Xu Kenton W. Murray 24 12 0 29 Apr 2022
A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformer Ayan Sengupta Tharun Suresh Md. Shad Akhtar Tanmoy Chakraborty 11 7 0 27 Apr 2022
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks Ruixiang Cui Daniel Hershcovich Anders Søgaard 15 13 0 22 Apr 2022
On the Representation Collapse of Sparse Mixture of Experts Zewen Chi Li Dong Shaohan Huang Damai Dai Shuming Ma ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei MoMe MoE 37 96 0 20 Apr 2022
Cross-Lingual Phrase Retrieval Heqi Zheng Xiao Zhang Zewen Chi Heyan Huang T. Yan Tian Lan Wei Wei Xian-Ling Mao RALM LRM 27 3 0 19 Apr 2022
IndicXNLI: Evaluating Multilingual Inference for Indian Languages Divyanshu Aggarwal V. Gupta Anoop Kunchukuttan 23 27 0 19 Apr 2022
MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages Jack G. M. FitzGerald C. Hench Charith Peris Scott Mackie Kay Rottmann ... Laurie Crist Misha Britan Wouter Leeuwis Gökhan Tür Premkumar Natarajan 6 126 0 18 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 38 148 0 15 Apr 2022
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer Pavel Efimov Leonid Boytsov E. Arslanova Pavel Braslavski 22 7 0 13 Apr 2022
Uniform Complexity for Text Generation Joseph Marvin Imperial Harish Tayyar Madabushi 16 3 0 11 Apr 2022
Assessment of Massively Multilingual Sentiment Classifiers Krzysztof Rajda Lukasz Augustyniak Piotr Gramacki Marcin Gruza Szymon Wo'zniak Tomasz Kajdanowicz 20 5 0 11 Apr 2022
Global Readiness of Language Technology for Healthcare: What would it Take to Combat the Next Pandemic? Ishani Mondal Kabir Ahuja Mohit Jain Jacki O Neil Kalika Bali Monojit Choudhury ELM LM&MA 24 4 0 06 Apr 2022
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency Yanyang Li Fuli Luo Runxin Xu Songfang Huang Fei Huang Liwei Wang 25 3 0 06 Apr 2022
Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval Robert Litschko Ivan Vulić Goran Glavavs LRM 27 13 0 05 Apr 2022
Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehension injuan Wu Shaojuan Wu Xiaowang Zhang Deyi Xiong Shizhan Chen Zhiqiang Zhuang Zhiyong Feng 14 13 0 03 Apr 2022
CL-XABSA: Contrastive Learning for Cross-lingual Aspect-based Sentiment Analysis Nankai Lin Yingwen Fu Xiaotian Lin Aimin Yang Shengyi Jiang 32 16 0 02 Apr 2022
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia Alham Fikri Aji Genta Indra Winata Fajri Koto Samuel Cahyawijaya Ade Romadhony ... David Moeljadi Radityo Eko Prasojo Timothy Baldwin Jey Han Lau Sebastian Ruder 38 98 0 24 Mar 2022
Multilingual CheckList: Generation and Evaluation Karthikeyan K Shaily Bhatt Pankaj Singh Somak Aditya Sandipan Dandapat Sunayana Sitaram Monojit Choudhary ELM 11 1 0 24 Mar 2022
Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability Yoshinari Fujinuma Jordan L. Boyd-Graber Katharina Kann AAML 51 23 0 21 Mar 2022
XTREME-S: Evaluating Cross-lingual Speech Representations Alexis Conneau Ankur Bapna Yu Zhang Min Ma Patrick von Platen ... Orhan Firat Michael Auli Sebastian Ruder Jason Riesa Melvin Johnson VLM AILaw ELM 50 22 0 21 Mar 2022
$Meta-X$_{NLG}$: A Meta-Learning Approach Based on Language Clustering for Zero-Shot Cross-Lingual Transfer and Generation$ Meta-X $_{NLG}$ : A Meta-Learning Approach Based on Language Clustering for Zero-Shot Cross-Lingual Transfer and Generation Kaushal Kumar Maurya M. Desarkar 14 8 0 19 Mar 2022
Challenges and Strategies in Cross-Cultural NLP Daniel Hershcovich Stella Frank Heather Lent Miryam de Lhoneux Mostafa Abdou ... Ruixiang Cui Constanza Fierro Katerina Margatina Phillip Rust Anders Søgaard 41 162 0 18 Mar 2022
CrossAligner & Co: Zero-Shot Transfer Methods for Task-Oriented Cross-lingual Natural Language Understanding Milan Gritta Ruoyu Hu Ignacio Iacobacci 31 12 0 18 Mar 2022
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation Xinyi Wang Sebastian Ruder Graham Neubig 21 60 0 17 Mar 2022
Combining Static and Contextualised Multilingual Embeddings Katharina Hämmerl Jindrich Libovický Alexander M. Fraser 25 10 0 17 Mar 2022
Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? E. Lee Sarubi Thillainathan Shravan Nayak Surangika Ranathunga David Ifeoluwa Adelani Ruisi Su Arya D. McCarthy VLM 21 43 0 16 Mar 2022