XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 659 papers shown

Title
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition David Ifeoluwa Adelani Graham Neubig Sebastian Ruder Shruti Rijhwani Michael Beukman ... Idris Abdulmumin Odunayo Ogundepo Oreen Yousuf Tatiana Moteu Ngoli Dietrich Klakow 36 43 0 22 Oct 2022
Prompt-Tuning Can Be Much Better Than Fine-Tuning on Cross-lingual Understanding With Multilingual Language Models Lifu Tu Caiming Xiong Yingbo Zhou VLM AAML LRM 92 27 0 22 Oct 2022
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages Paul Röttger Debora Nozza Federico Bianchi Dirk Hovy 18 10 0 20 Oct 2022
LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation Hongcheng Guo Jiaheng Liu Haoyang Huang Jian Yang Zhoujun Li Dongdong Zhang Zheng Cui Furu Wei 37 22 0 19 Oct 2022
Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languages Xinyu Crystina Zhang Nandan Thakur Odunayo Ogundepo Ehsan Kamalloo David Alfonso-Hermelo Xiaoguang Li Qun Liu Mehdi Rezagholizadeh Jimmy J. Lin 14 53 0 18 Oct 2022
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning Kunbo Ding Weijie Liu Yuejian Fang Weiquan Mao Zhe Zhao Tao Zhu Haoyan Liu Rong Tian Yiren Chen 27 8 0 18 Oct 2022
Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representation Deng Cai Xin Li Jackie Chun-Sing Ho Lidong Bing W. Lam 12 6 0 18 Oct 2022
Synergy with Translation Artifacts for Training and Inference in Multilingual Tasks Jaehoon Oh Jongwoo Ko Se-Young Yun 42 9 0 18 Oct 2022
Some Languages are More Equal than Others: Probing Deeper into the Linguistic Disparity in the NLP World Surangika Ranathunga Nisansa de Silva 21 34 0 16 Oct 2022
Bootstrapping Multilingual Semantic Parsers using Large Language Models Abhijeet Awasthi Nitish Gupta Bidisha Samanta Shachi Dave Sunita Sarawagi Partha P. Talukdar 24 7 0 13 Oct 2022
You Can Have Your Data and Balance It Too: Towards Balanced and Efficient Multilingual Models Tomasz Limisiewicz Daniel Malkin Gabriel Stanovsky 6 4 0 13 Oct 2022
A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models Jimin Sun Patrick Fernandes Xinyi Wang Graham Neubig 20 9 0 13 Oct 2022
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation Jian Yang Shaohan Huang Shuming Ma Yuwei Yin Li Dong Dongdong Zhang Hongcheng Guo Zhoujun Li Furu Wei 31 24 0 13 Oct 2022
Shapley Head Pruning: Identifying and Removing Interference in Multilingual Transformers William B. Held Diyi Yang VLM 32 5 0 11 Oct 2022
Multilingual BERT has an accent: Evaluating English influences on fluency in multilingual models Isabel Papadimitriou Kezia Lopez Daniel Jurafsky 21 0 0 11 Oct 2022
Multilingual Representation Distillation with Contrastive Learning Weiting Tan Kevin Heffernan Holger Schwenk Philipp Koehn 35 16 0 10 Oct 2022
Robustification of Multilingual Language Models to Real-world Noise in Crosslingual Zero-shot Settings with Robust Contrastive Pretraining Asa Cooper Stickland Sailik Sengupta Jason Krone Saab Mansour He He 44 7 0 10 Oct 2022
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment Siyu Lai Zhen Yang Fandong Meng Yufeng Chen Jinan Xu Jie Zhou 31 6 0 09 Oct 2022
Language Models are Multilingual Chain-of-Thought Reasoners Freda Shi Mirac Suzgun Markus Freitag Xuezhi Wang Suraj Srivats ... Yi Tay Sebastian Ruder Denny Zhou Dipanjan Das Jason W. Wei ReLM LRM 170 325 0 06 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 106 92 0 06 Oct 2022
Meta-Learning a Cross-lingual Manifold for Semantic Parsing Tom Sherborne Mirella Lapata 38 13 0 26 Sep 2022
MonoByte: A Pool of Monolingual Byte-level Language Models Hugo Queiroz Abonizio Leandro Rodrigues de Souza R. Lotufo Rodrigo Nogueira 23 1 0 22 Sep 2022
PaLI: A Jointly-Scaled Multilingual Language-Image Model Xi Chen Xiao Wang Soravit Changpinyo A. Piergiovanni Piotr Padlewski ... Andreas Steiner A. Angelova Xiaohua Zhai N. Houlsby Radu Soricut MLLM VLM 18 682 0 14 Sep 2022
Parameter-Efficient Finetuning for Robust Continual Multilingual Learning Kartikeya Badola Shachi Dave Partha P. Talukdar CLL KELM 39 7 0 14 Sep 2022
Language Chameleon: Transformation analysis between languages using Cross-lingual Post-training based on Pre-trained language models Suhyune Son Chanjun Park Jungseob Lee Midan Shim Chanhee Lee Yoonna Jang Jaehyung Seo Heu-Jeoung Lim 10 0 0 14 Sep 2022
T-NER: An All-Round Python Library for Transformer-based Named Entity Recognition Asahi Ushio Jose Camacho-Collados 12 72 0 09 Sep 2022
Making Intelligence: Ethical Values in IQ and ML Benchmarks Borhane Blili-Hamelin Leif Hancox-Li 27 16 0 01 Sep 2022
MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languages Qingyuan Zhang Xiaoyu Shen Ernie Chang Jidong Ge Peng-Jen Chen 16 14 0 27 Aug 2022
IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languages Tahir Javed Kaushal Bhogale A. Raman Anoop Kunchukuttan Pratyush Kumar Mitesh M. Khapra ELM 17 20 0 24 Aug 2022
MuMUR : Multilingual Multimodal Universal Retrieval Avinash Madasu Estelle Aflalo Gabriela Ben-Melech Stan Shachar Rosenman Shao-Yen Tseng Gedas Bertasius Vasudev Lal 37 3 0 24 Aug 2022
Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task Stan Weixian Lei Difei Gao Jay Zhangjie Wu Yuxuan Wang Wei Liu Meng Zhang Mike Zheng Shou 17 35 0 24 Aug 2022
BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification Vinura Dhananjaya Piyumal Demotte Surangika Ranathunga Sanath Jayasena 19 13 0 16 Aug 2022
Cross-Lingual Knowledge Transfer for Clinical Phenotyping Jens-Michalis Papaioannou Paul Grundmann Betty van Aken A. Samaras Ilias Kyparissidis G. Giannakoulas Felix Alexander Gers Alexander Loser 15 6 0 03 Aug 2022
What can we Learn by Predicting Accuracy? Olivier Risser-Maroix Benjamin Chamand 10 4 0 02 Aug 2022
QuoteKG: A Multilingual Knowledge Graph of Quotes Tin Kuculo Simon Gottschalk Elena Demidova HILM SLR 8 2 0 19 Jul 2022
Zero-shot Cross-lingual Transfer is Under-specified Optimization Shijie Wu Benjamin Van Durme Mark Dredze 17 6 0 12 Jul 2022
MIA 2022 Shared Task: Evaluating Cross-lingual Open-Retrieval Question Answering for 16 Diverse Languages Akari Asai Shayne Longpre Jungo Kasai Chia-Hsuan Lee Rui Zhang Junjie Hu Ikuya Yamada J. Clark Eunsol Choi LRM 17 14 0 02 Jul 2022
A Multilingual Dataset of COVID-19 Vaccination Attitudes on Twitter Ninghan Chen Xihui Chen Jun Pang 39 16 0 27 Jun 2022
Endowing Language Models with Multimodal Knowledge Graph Representations Ningyuan Huang Y. Deshpande Yibo Liu Houda Alberts Kyunghyun Cho Clara Vania Iacer Calixto VLM 28 14 0 27 Jun 2022
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold Sebastian Ruder Ivan Vulić Anders Søgaard 33 25 0 20 Jun 2022
Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detection J. Eronen M. Ptaszynski Fumito Masui Masaki Arata Gniewosz Leliwa Michal Wroczynski 14 31 0 02 Jun 2022
NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages Genta Indra Winata Alham Fikri Aji Samuel Cahyawijaya Rahmad Mahendra Fajri Koto ... Pascale Fung Timothy Baldwin Jey Han Lau Rico Sennrich Sebastian Ruder 29 77 0 31 May 2022
EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning Zhuoyuan Mao Chenhui Chu Sadao Kurohashi 29 1 0 31 May 2022
VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models Wangchunshu Zhou Yan Zeng Shizhe Diao Xinsong Zhang CoGe VLM 19 13 0 30 May 2022
X-SCITLDR: Cross-Lingual Extreme Summarization of Scholarly Documents Sotaro Takeshita Tommaso Green Niklas Friedrich Kai Eckert Simone Paolo Ponzetto 11 13 0 30 May 2022
CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behavior Eldar David Abraham Karel DÓosterlinck Amir Feder Y. Gat Atticus Geiger Christopher Potts Roi Reichart Zhengxuan Wu CML 23 43 0 27 May 2022
Language Anisotropic Cross-Lingual Model Editing Yang Xu Yutai Hou Wanxiang Che Min Zhang KELM 92 24 0 25 May 2022
Evaluating the Diversity, Equity and Inclusion of NLP Technology: A Case Study for Indian Languages Simran Khanuja Sebastian Ruder Partha P. Talukdar 32 16 0 25 May 2022
Discovering Language-neutral Sub-networks in Multilingual Language Models Negar Foroutan Mohammadreza Banaei R. Lebret Antoine Bosselut Karl Aberer LRM 39 25 0 25 May 2022
Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages Kevin Heffernan Onur cCelebi Holger Schwenk 25 53 0 25 May 2022