XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 659 papers shown

Title
DiTTO: A Feature Representation Imitation Approach for Improving Cross-Lingual Transfer Shanu Kumar Abbaraju Soujanya Sandipan Dandapat Sunayana Sitaram Monojit Choudhury VLM 25 1 0 04 Mar 2023
CLICKER: Attention-Based Cross-Lingual Commonsense Knowledge Transfer Ruolin Su Zhongkai Sun Sixing Lu Chengyuan Ma Chenlei Guo LRM 21 0 0 26 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić E. Ponti MoMe OOD 19 73 0 22 Feb 2023
Designing and Evaluating Interfaces that Highlight News Coverage Diversity Using Discord Questions Philippe Laban Chien-Sheng Wu Lidiya Murakhovs'ka Xiang Ánthony' Chen Caiming Xiong 16 8 0 17 Feb 2023
Robust Question Answering against Distribution Shifts with Test-Time Adaptation: An Empirical Study Hai Ye Yuyang Ding Juntao Li Hwee Tou Ng OOD TTA 21 9 0 09 Feb 2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval Shunyu Zhang Yaobo Liang Ming Gong Daxin Jiang Nan Duan 16 4 0 03 Feb 2023
Zero-shot cross-lingual transfer language selection using linguistic similarity J. Eronen M. Ptaszynski Fumito Masui 11 32 0 31 Jan 2023
LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain Joel Niklaus Veton Matoshi Pooja Rani Andrea Galassi Matthias Sturmer Ilias Chalkidis ELM AILaw 19 54 0 30 Jan 2023
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models Davis Liang Hila Gonen Yuning Mao Rui Hou Naman Goyal Marjan Ghazvininejad Luke Zettlemoyer Madian Khabsa 12 72 0 25 Jan 2023
Cross-lingual German Biomedical Information Extraction: from Zero-shot to Human-in-the-Loop Siting Liang Mareike Hartmann Daniel Sonntag 8 3 0 24 Jan 2023
XNLI 2.0: Improving XNLI dataset and performance on Cross Lingual Understanding (XLU) A. Upadhyay Harsit Kumar Upadhya 11 1 0 16 Jan 2023
FUN with Fisher: Improving Generalization of Adapter-Based Cross-lingual Transfer with Scheduled Unfreezing Chen Cecilia Liu Jonas Pfeiffer Ivan Vulić Iryna Gurevych CLL 24 9 0 13 Jan 2023
Boosting Neural Networks to Decompile Optimized Binaries Ying Cao Ruigang Liang Kai Chen Peiwei Hu 26 16 0 03 Jan 2023
CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT Dan DeGenaro Jugal Kalita 22 0 0 22 Dec 2022
ORCA: A Challenging Benchmark for Arabic Language Understanding AbdelRahim Elmadany El Moatez Billah Nagoudi Muhammad Abdul-Mageed ELM 9 40 0 21 Dec 2022
T-Projection: High Quality Annotation Projection for Sequence Labeling Tasks Iker García-Ferrero Rodrigo Agerri German Rigau 33 13 0 20 Dec 2022
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue Nikita Moghe E. Razumovskaia Liane Guillou Ivan Vulić Anna Korhonen Alexandra Birch 19 13 0 20 Dec 2022
Extrinsic Evaluation of Machine Translation Metrics Nikita Moghe Tom Sherborne Mark Steedman Alexandra Birch ELM 18 18 0 20 Dec 2022
Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages A. Mhaske Harsh Kedia Sumanth Doddapaneni Mitesh M. Khapra Pratyush Kumar V. Rudramurthy Anoop Kunchukuttan 41 26 0 20 Dec 2022
Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages Ercong Nie Sheng Liang Helmut Schmid Hinrich Schütze VLM RALM LRM 20 22 0 19 Dec 2022
NusaCrowd: Open Source Initiative for Indonesian NLP Resources Samuel Cahyawijaya Holy Lovenia Alham Fikri Aji Genta Indra Winata Bryan Wilie ... Timothy Baldwin Sebastian Ruder Herry Sujaini S. Sakti Ayu Purwarianti 19 47 0 19 Dec 2022
$Mu$^{2}$SLAM: Multitask, Multilingual Speech and Language Models$ Mu $^{2}$ SLAM: Multitask, Multilingual Speech and Language Models Yong Cheng Yu Zhang Melvin Johnson Wolfgang Macherey Ankur Bapna 20 8 0 19 Dec 2022
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue William B. Held Christopher Hidey Fei Liu Eric Zhu Rahul Goel Diyi Yang Rushin Shah 11 0 0 15 Dec 2022
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages Sumanth Doddapaneni Rahul Aralikatte Gowtham Ramesh Shreyansh Goyal Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar ELM 38 79 0 11 Dec 2022
Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer Benjamin Muller Deepanshu Gupta Siddharth Patwardhan J. Fauconnier David Vandyke Sachin Agarwal 22 5 0 04 Dec 2022
TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse Languages A. Srinivasan Eunsol Choi 21 14 0 29 Nov 2022
Beyond Counting Datasets: A Survey of Multilingual Dataset Construction and Necessary Resources Xinyan Velocity Yu Akari Asai Trina Chatterjee Junjie Hu Eunsol Choi 16 21 0 28 Nov 2022
Frustratingly Easy Label Projection for Cross-lingual Transfer Yang Chen Chao Jiang Alan Ritter Wei-ping Xu 19 31 0 28 Nov 2022
TESSP: Text-Enhanced Self-Supervised Speech Pre-training Zhuoyuan Yao Shuo Ren Sanyuan Chen Ziyang Ma Pengcheng Guo Linfu Xie 22 5 0 24 Nov 2022
This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polish Lukasz Augustyniak Kamil Tagowski Albert Sawczyn Denis Janiak Roman Bartusiak ... Arkadiusz Janz Piotr Szymañski M. Morzy Tomasz Kajdanowicz Maciej Piasecki 18 10 0 23 Nov 2022
Towards Robust Low-Resource Fine-Tuning with Multi-View Compressed Representations Linlin Liu Xingxuan Li Megh Thakkar Xin Li Shafiq R. Joty Luo Si Lidong Bing 27 2 0 16 Nov 2022
Disentangling Task Relations for Few-shot Text Classification via Self-Supervised Hierarchical Task Clustering Juan Zha Zheng Li Ying Wei Yu Zhang 15 5 0 16 Nov 2022
ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training Henry Tang A. Deshpande Karthik Narasimhan 19 5 0 15 Nov 2022
DualNER: A Dual-Teaching framework for Zero-shot Cross-lingual Named Entity Recognition Jiali Zeng Yu Jiang Yongjing Yin Xu Wang Binghuai Lin Yunbo Cao 10 2 0 15 Nov 2022
English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings Yau-Shian Wang Ashley Wu Graham Neubig SSL 22 31 0 11 Nov 2022
Casual Conversations v2: Designing a large consent-driven dataset to measure algorithmic bias and robustness C. Hazirbas Yejin Bang Tiezheng Yu Parisa Assar Bilal Porgali ... Jacqueline Pan Emily McReynolds Miranda Bogen Pascale Fung Cristian Canton Ferrer 11 8 0 10 Nov 2022
Assistive Completion of Agrammatic Aphasic Sentences: A Transfer Learning Approach using Neurolinguistics-based Synthetic Dataset Rohit Misra S. Mishra Tapan K. Gandhi 14 2 0 10 Nov 2022
Local Structure Matters Most in Most Languages Louis Clouâtre Prasanna Parthasarathi Amal Zouaq Sarath Chandar 26 1 0 09 Nov 2022
Detecting Languages Unintelligible to Multilingual Models through Local Structure Probes Louis Clouâtre Prasanna Parthasarathi Amal Zouaq Sarath Chandar 33 3 0 09 Nov 2022
Discord Questions: A Computational Approach To Diversity Analysis in News Coverage Philippe Laban Chien-Sheng Wu Lidiya Murakhovs'ka Xiang Ánthony' Chen Caiming Xiong 13 12 0 09 Nov 2022
Third-Party Aligner for Neural Word Alignments Jinpeng Zhang C. Dong Xiangyu Duan Yuqi Zhang M. Zhang 17 0 0 08 Nov 2022
Intriguing Properties of Compression on Multilingual Models Kelechi Ogueji Orevaoghene Ahia Gbemileke Onilude Sebastian Gehrmann Sara Hooker Julia Kreutzer 21 12 0 04 Nov 2022
Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model Mingqi Li Fei Ding Dan Zhang Long Cheng Hongxin Hu Feng Luo 25 6 0 02 Nov 2022
token2vec: A Joint Self-Supervised Pre-training Framework Using Unpaired Speech and Text Xianghu Yue Junyi Ao Xiaoxue Gao Haizhou Li SSL 26 8 0 30 Oct 2022
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Chantal Amrhein Nikita Moghe Liane Guillou ELM 26 22 0 27 Oct 2022
What Language Model to Train if You Have One Million GPU Hours? Teven Le Scao Thomas Wang Daniel Hesslow Lucile Saulnier Stas Bekman ... Lintang Sutawika Jaesung Tae Zheng-Xin Yong Julien Launay Iz Beltagy MoE AI4CE 225 103 0 27 Oct 2022
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning Barun Patra Saksham Singhal Shaohan Huang Zewen Chi Li Dong Furu Wei Vishrav Chaudhary Xia Song 56 23 0 26 Oct 2022
Adapters for Enhanced Modeling of Multilingual Knowledge and Text Yifan Hou Wenxiang Jiao Mei-Jun Liu Carl Allen Zhaopeng Tu Mrinmaya Sachan 19 11 0 24 Oct 2022
EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching Chenxi Whitehouse Fenia Christopoulou Ignacio Iacobacci 29 9 0 22 Oct 2022
Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLU Fenia Christopoulou Gerasimos Lampouras Ignacio Iacobacci 24 3 0 22 Oct 2022