Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2104.07412
Cited By
v1
v2 (latest)
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
15 April 2021
Sebastian Ruder
Noah Constant
Jan A. Botha
Aditya Siddhant
Orhan Firat
Jinlan Fu
Pengfei Liu
Junjie Hu
Dan Garrette
Graham Neubig
Melvin Johnson
ELM
AAML
LRM
Re-assign community
ArXiv (abs)
PDF
HTML
Github (644★)
Papers citing
"XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation"
50 / 147 papers shown
Title
A Material Lens on Coloniality in NLP
William B. Held
Camille Harris
Michael Best
Diyi Yang
309
21
0
14 Nov 2023
Sharing, Teaching and Aligning: Knowledgeable Transfer Learning for Cross-Lingual Machine Reading Comprehension
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Tingfeng Cao
Chengyu Wang
Chuanqi Tan
Jun Huang
Jinhui Zhu
173
0
0
12 Nov 2023
mahaNLP: A Marathi Natural Language Processing Library
International Joint Conference on Natural Language Processing (IJCNLP), 2023
Vidula Magdum
Omkar Dhekane
Sharayu Hiwarkhedkar
Saloni Mittal
Raviraj Joshi
219
5
0
05 Nov 2023
EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning
Neural Information Processing Systems (NeurIPS), 2023
Ping Guo
Xiangpeng Wei
Yue Hu
Baosong Yang
Dayiheng Liu
Fei Huang
Jun Xie
241
3
0
26 Oct 2023
Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLU
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Fajri Koto
Nurul Aisyah
Jinyan Su
Timothy Baldwin
AI4Ed
LRM
ELM
293
57
0
07 Oct 2023
Self-Augmentation Improves Zero-Shot Cross-Lingual Transfer
International Joint Conference on Natural Language Processing (IJCNLP), 2023
Fei Wang
Kuan-Hao Huang
Kai-Wei Chang
Muhao Chen
137
6
0
19 Sep 2023
Contextual Label Projection for Cross-Lingual Structured Prediction
North American Chapter of the Association for Computational Linguistics (NAACL), 2023
Tanmay Parekh
I-Hung Hsu
Kuan-Hao Huang
Kai-Wei Chang
Nanyun Peng
316
9
0
16 Sep 2023
Multilingual Sentence-Level Semantic Search using Meta-Distillation Learning
Meryem M'hamdi
Jonathan May
Franck Dernoncourt
Trung Bui
Seunghyun Yoon
FedML
195
2
0
15 Sep 2023
SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
David Ifeoluwa Adelani
Hannah Liu
Xiaoyu Shen
Nikita Vassilyev
Jesujoba Oluwadara Alabi
Yanke Mao
Haonan Gao
Annie En-Shiun Lee
ELM
340
123
0
14 Sep 2023
Multilingual Text Representation
Fahim Faisal
181
0
0
02 Sep 2023
Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understanding
Conference on Natural Language Processing (NLP), 2023
Bolei Ma
Ercong Nie
Helmut Schmid
Hinrich Schütze
AAML
VLM
LRM
211
11
0
15 Jul 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Ester Hlavnova
Sebastian Ruder
229
7
0
11 Jul 2023
Lost in Translation: Large Language Models in Non-English Content Analysis
Gabriel Nicholas
Aliya Bhatia
ELM
265
54
0
12 Jun 2023
M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language Models
Neural Information Processing Systems (NeurIPS), 2023
Wenxuan Zhang
Sharifah Mahani Aljunied
Chang Gao
Yew Ken Chia
Lidong Bing
ELM
294
123
0
08 Jun 2023
bgGLUE: A Bulgarian General Language Understanding Evaluation Benchmark
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Momchil Hardalov
Pepa Atanasova
Todor Mihaylov
G. Angelova
K. Simov
P. Osenova
Ves Stoyanov
Ivan Koychev
Preslav Nakov
Dragomir R. Radev
ELM
FedML
254
9
0
04 Jun 2023
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Fabian David Schmidt
Ivan Vulić
Goran Glavaš
185
11
0
26 May 2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer
North American Chapter of the Association for Computational Linguistics (NAACL), 2023
Akari Asai
Sneha Kudugunta
Xinyan Velocity Yu
Terra Blevins
Hila Gonen
Machel Reid
Yulia Tsvetkov
Sebastian Ruder
Hannaneh Hajishirzi
299
80
0
24 May 2023
GlobalBench: A Benchmark for Global Progress in Natural Language Processing
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Yueqi Song
Catherine Cui
Simran Khanuja
Pengfei Liu
Fahim Faisal
...
Alham Fikri Aji
Samuel Cahyawijaya
Yulia Tsvetkov
Antonios Anastasopoulos
Graham Neubig
276
10
0
24 May 2023
Revisiting Machine Translation for Cross-lingual Classification
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Mikel Artetxe
Vedanuj Goswami
Shruti Bhosale
Angela Fan
Luke Zettlemoyer
LRM
196
46
0
23 May 2023
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Jonas Pfeiffer
Francesco Piccinno
Massimo Nicosia
Xinyi Wang
Machel Reid
Sebastian Ruder
VLM
LRM
256
32
0
23 May 2023
DUMB: A Benchmark for Smart Evaluation of Dutch Models
Wietse de Vries
Martijn B. Wieling
Malvina Nissim
ELM
ALM
MoE
221
8
0
22 May 2023
Multilingual Simplification of Medical Texts
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Sebastian Antony Joseph
Kathryn Kazanas
Keziah Reina
Vishnesh J. Ramanathan
Wei Xu
Byron C. Wallace
Junyi Jessy Li
278
17
0
21 May 2023
Is Translation Helpful? An Empirical Analysis of Cross-Lingual Transfer in Low-Resource Dialog Generation
Lei Shen
Shuai Yu
Xiaoyu Shen
120
0
0
21 May 2023
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Sebastian Ruder
J. Clark
Alexander Gutkin
Mihir Kale
Min Ma
...
Dan Garrette
R. Ingle
Melvin Johnson
Dmitry Panteleev
Partha P. Talukdar
ELM
306
46
0
19 May 2023
Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses
IEEE Games Entertainment Media Conference (IEEE GEM), 2023
Xenia Ohmer
Elia Bruni
Dieuwke Hupkes
LRM
279
17
0
19 May 2023
What's the Meaning of Superhuman Performance in Today's NLU?
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Simone Tedeschi
Johan Bos
T. Declerck
Jan Hajic
Daniel Hershcovich
...
Simon Krek
Steven Schockaert
Rico Sennrich
Ekaterina Shutova
Roberto Navigli
ELM
LM&MA
VLM
ReLM
LRM
288
37
0
15 May 2023
MEGA: Multilingual Evaluation of Generative AI
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Kabir Ahuja
Harshita Diddee
Rishav Hada
Millicent Ochieng
Krithika Ramesh
...
T. Ganu
Sameer Segal
Maxamed Axmed
Kalika Bali
Sunayana Sitaram
LM&MA
LRM
ELM
533
343
0
22 Mar 2023
DiTTO: A Feature Representation Imitation Approach for Improving Cross-Lingual Transfer
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Shanu Kumar
Abbaraju Soujanya
Sandipan Dandapat
Sunayana Sitaram
Monojit Choudhury
VLM
178
1
0
04 Mar 2023
Modular Deep Learning
Jonas Pfeiffer
Sebastian Ruder
Ivan Vulić
Edoardo Ponti
MoMe
OOD
421
102
0
22 Feb 2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
International Conference on Learning Representations (ICLR), 2023
Shunyu Zhang
Yaobo Liang
Ming Gong
Daxin Jiang
Nan Duan
355
8
0
03 Feb 2023
Zero-shot cross-lingual transfer language selection using linguistic similarity
Information Processing & Management (IPM), 2023
J. Eronen
M. Ptaszynski
Fumito Masui
218
47
0
31 Jan 2023
Multilingual News Location Detection using an Entity-Based Siamese Network with Semi-Supervised Contrastive Learning and Knowledge Base
Víctor Suárez-Paniagua
Steven Derby
Tri Kurniawan Wijaya
108
0
0
22 Dec 2022
ORCA: A Challenging Benchmark for Arabic Language Understanding
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
AbdelRahim Elmadany
El Moatez Billah Nagoudi
Muhammad Abdul-Mageed
ELM
285
60
0
21 Dec 2022
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Nikita Moghe
E. Razumovskaia
Liane Guillou
Ivan Vulić
Anna Korhonen
Alexandra Birch
264
18
0
20 Dec 2022
Extrinsic Evaluation of Machine Translation Metrics
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Nikita Moghe
Tom Sherborne
Mark Steedman
Alexandra Birch
ELM
236
23
0
20 Dec 2022
Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
A. Mhaske
Harsh Kedia
Sumanth Doddapaneni
Mitesh M. Khapra
Pratyush Kumar
V. Rudramurthy
Anoop Kunchukuttan
274
40
0
20 Dec 2022
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Tianxing He
Jingyu Zhang
Tianle Wang
Sachin Kumar
Dong Wang
James R. Glass
Yulia Tsvetkov
375
59
0
20 Dec 2022
The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Genta Indra Winata
Alham Fikri Aji
Zheng-Xin Yong
Thamar Solorio
301
49
0
19 Dec 2022
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
William B. Held
Christopher Hidey
Fei Liu
Eric Zhu
Rahul Goel
Diyi Yang
Rushin Shah
207
4
0
15 Dec 2022
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Sumanth Doddapaneni
Rahul Aralikatte
Gowtham Ramesh
Shreyansh Goyal
Mitesh M. Khapra
Anoop Kunchukuttan
Pratyush Kumar
ELM
319
113
0
11 Dec 2022
QAmeleon: Multilingual QA with Only 5 Examples
Transactions of the Association for Computational Linguistics (TACL), 2022
Priyanka Agrawal
Chris Alberti
Fantine Huot
Joshua Maynez
Ji Ma
Sebastian Ruder
Kuzman Ganchev
Dipanjan Das
Mirella Lapata
215
32
0
15 Nov 2022
TaTa: A Multilingual Table-to-Text Dataset for African Languages
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Sebastian Gehrmann
Sebastian Ruder
Vitaly Nikolaev
Jan A. Botha
Michael Chavinda
Ankur P. Parikh
Clara E. Rivera
LMTD
244
14
0
31 Oct 2022
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
David Ifeoluwa Adelani
Graham Neubig
Sebastian Ruder
Shruti Rijhwani
Michael Beukman
...
Idris Abdulmumin
Odunayo Ogundepo
Oreen Yousuf
Tatiana Moteu Ngoli
Dietrich Klakow
283
51
0
22 Oct 2022
Prompt-Tuning Can Be Much Better Than Fine-Tuning on Cross-lingual Understanding With Multilingual Language Models
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Lifu Tu
Caiming Xiong
Yingbo Zhou
VLM
AAML
LRM
321
30
0
22 Oct 2022
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Paul Röttger
Debora Nozza
Federico Bianchi
Dirk Hovy
184
12
0
20 Oct 2022
Predicting Fine-Tuning Performance with Probing
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Zining Zhu
Soroosh Shahtalebi
Frank Rudzicz
171
12
0
13 Oct 2022
Multilingual Representation Distillation with Contrastive Learning
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2022
Weiting Tan
Kevin Heffernan
Holger Schwenk
Philipp Koehn
172
22
0
10 Oct 2022
Language Models are Multilingual Chain-of-Thought Reasoners
International Conference on Learning Representations (ICLR), 2022
Freda Shi
Mirac Suzgun
Markus Freitag
Xuezhi Wang
Suraj Srivats
...
Yi Tay
Sebastian Ruder
Denny Zhou
Dipanjan Das
Jason W. Wei
ReLM
LRM
579
483
0
06 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review
Nature Machine Intelligence (Nat. Mach. Intell.), 2022
Dieuwke Hupkes
Mario Giulianelli
Verna Dankers
Mikel Artetxe
Yanai Elazar
...
Leila Khalatbari
Maria Ryskina
Rita Frieske
Robert Bamler
Zhijing Jin
612
131
0
06 Oct 2022
An Empirical Study on Cross-X Transfer for Legal Judgment Prediction
Joel Niklaus
Matthias Sturmer
Ilias Chalkidis
ELM
AILaw
286
20
0
25 Sep 2022
Previous
1
2
3
Next