ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2104.07412
  4. Cited By
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation
v1v2 (latest)

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
15 April 2021
Sebastian Ruder
Noah Constant
Jan A. Botha
Aditya Siddhant
Orhan Firat
Jinlan Fu
Pengfei Liu
Junjie Hu
Dan Garrette
Graham Neubig
Melvin Johnson
    ELMAAMLLRM
ArXiv (abs)PDFHTMLGithub (644★)

Papers citing "XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation"

50 / 147 papers shown
Title
A Material Lens on Coloniality in NLP
A Material Lens on Coloniality in NLP
William B. Held
Camille Harris
Michael Best
Diyi Yang
309
21
0
14 Nov 2023
Sharing, Teaching and Aligning: Knowledgeable Transfer Learning for
  Cross-Lingual Machine Reading Comprehension
Sharing, Teaching and Aligning: Knowledgeable Transfer Learning for Cross-Lingual Machine Reading ComprehensionConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Tingfeng Cao
Chengyu Wang
Chuanqi Tan
Jun Huang
Jinhui Zhu
173
0
0
12 Nov 2023
mahaNLP: A Marathi Natural Language Processing Library
mahaNLP: A Marathi Natural Language Processing LibraryInternational Joint Conference on Natural Language Processing (IJCNLP), 2023
Vidula Magdum
Omkar Dhekane
Sharayu Hiwarkhedkar
Saloni Mittal
Raviraj Joshi
219
5
0
05 Nov 2023
EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual
  Representation Learning
EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation LearningNeural Information Processing Systems (NeurIPS), 2023
Ping Guo
Xiangpeng Wei
Yue Hu
Baosong Yang
Dayiheng Liu
Fei Huang
Jun Xie
241
3
0
26 Oct 2023
Large Language Models Only Pass Primary School Exams in Indonesia: A
  Comprehensive Test on IndoMMLU
Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLUConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Fajri Koto
Nurul Aisyah
Jinyan Su
Timothy Baldwin
AI4EdLRMELM
293
57
0
07 Oct 2023
Self-Augmentation Improves Zero-Shot Cross-Lingual Transfer
Self-Augmentation Improves Zero-Shot Cross-Lingual TransferInternational Joint Conference on Natural Language Processing (IJCNLP), 2023
Fei Wang
Kuan-Hao Huang
Kai-Wei Chang
Muhao Chen
137
6
0
19 Sep 2023
Contextual Label Projection for Cross-Lingual Structured Prediction
Contextual Label Projection for Cross-Lingual Structured PredictionNorth American Chapter of the Association for Computational Linguistics (NAACL), 2023
Tanmay Parekh
I-Hung Hsu
Kuan-Hao Huang
Kai-Wei Chang
Nanyun Peng
316
9
0
16 Sep 2023
Multilingual Sentence-Level Semantic Search using Meta-Distillation
  Learning
Multilingual Sentence-Level Semantic Search using Meta-Distillation Learning
Meryem M'hamdi
Jonathan May
Franck Dernoncourt
Trung Bui
Seunghyun Yoon
FedML
195
2
0
15 Sep 2023
SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic
  Classification in 200+ Languages and Dialects
SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and DialectsConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
David Ifeoluwa Adelani
Hannah Liu
Xiaoyu Shen
Nikita Vassilyev
Jesujoba Oluwadara Alabi
Yanke Mao
Haonan Gao
Annie En-Shiun Lee
ELM
340
123
0
14 Sep 2023
Multilingual Text Representation
Multilingual Text Representation
Fahim Faisal
181
0
0
02 Sep 2023
Is Prompt-Based Finetuning Always Better than Vanilla Finetuning?
  Insights from Cross-Lingual Language Understanding
Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language UnderstandingConference on Natural Language Processing (NLP), 2023
Bolei Ma
Ercong Nie
Helmut Schmid
Hinrich Schütze
AAMLVLMLRM
211
11
0
15 Jul 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with
  Typological Features
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological FeaturesAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Ester Hlavnova
Sebastian Ruder
229
7
0
11 Jul 2023
Lost in Translation: Large Language Models in Non-English Content
  Analysis
Lost in Translation: Large Language Models in Non-English Content Analysis
Gabriel Nicholas
Aliya Bhatia
ELM
265
54
0
12 Jun 2023
M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining
  Large Language Models
M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language ModelsNeural Information Processing Systems (NeurIPS), 2023
Wenxuan Zhang
Sharifah Mahani Aljunied
Chang Gao
Yew Ken Chia
Lidong Bing
ELM
294
123
0
08 Jun 2023
bgGLUE: A Bulgarian General Language Understanding Evaluation Benchmark
bgGLUE: A Bulgarian General Language Understanding Evaluation BenchmarkAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Momchil Hardalov
Pepa Atanasova
Todor Mihaylov
G. Angelova
K. Simov
P. Osenova
Ves Stoyanov
Ivan Koychev
Preslav Nakov
Dragomir R. Radev
ELMFedML
254
9
0
04 Jun 2023
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint AveragingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Fabian David Schmidt
Ivan Vulić
Goran Glavaš
185
11
0
26 May 2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual
  Transfer
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual TransferNorth American Chapter of the Association for Computational Linguistics (NAACL), 2023
Akari Asai
Sneha Kudugunta
Xinyan Velocity Yu
Terra Blevins
Hila Gonen
Machel Reid
Yulia Tsvetkov
Sebastian Ruder
Hannaneh Hajishirzi
299
80
0
24 May 2023
GlobalBench: A Benchmark for Global Progress in Natural Language
  Processing
GlobalBench: A Benchmark for Global Progress in Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Yueqi Song
Catherine Cui
Simran Khanuja
Pengfei Liu
Fahim Faisal
...
Alham Fikri Aji
Samuel Cahyawijaya
Yulia Tsvetkov
Antonios Anastasopoulos
Graham Neubig
276
10
0
24 May 2023
Revisiting Machine Translation for Cross-lingual Classification
Revisiting Machine Translation for Cross-lingual ClassificationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Mikel Artetxe
Vedanuj Goswami
Shruti Bhosale
Angela Fan
Luke Zettlemoyer
LRM
196
46
0
23 May 2023
mmT5: Modular Multilingual Pre-Training Solves Source Language
  Hallucinations
mmT5: Modular Multilingual Pre-Training Solves Source Language HallucinationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Jonas Pfeiffer
Francesco Piccinno
Massimo Nicosia
Xinyi Wang
Machel Reid
Sebastian Ruder
VLMLRM
256
32
0
23 May 2023
DUMB: A Benchmark for Smart Evaluation of Dutch Models
DUMB: A Benchmark for Smart Evaluation of Dutch Models
Wietse de Vries
Martijn B. Wieling
Malvina Nissim
ELMALMMoE
221
8
0
22 May 2023
Multilingual Simplification of Medical Texts
Multilingual Simplification of Medical TextsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Sebastian Antony Joseph
Kathryn Kazanas
Keziah Reina
Vishnesh J. Ramanathan
Wei Xu
Byron C. Wallace
Junyi Jessy Li
278
17
0
21 May 2023
Is Translation Helpful? An Empirical Analysis of Cross-Lingual Transfer
  in Low-Resource Dialog Generation
Is Translation Helpful? An Empirical Analysis of Cross-Lingual Transfer in Low-Resource Dialog Generation
Lei Shen
Shuai Yu
Xiaoyu Shen
120
0
0
21 May 2023
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented
  Languages
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Sebastian Ruder
J. Clark
Alexander Gutkin
Mihir Kale
Min Ma
...
Dan Garrette
R. Ingle
Melvin Johnson
Dmitry Panteleev
Partha P. Talukdar
ELM
306
46
0
19 May 2023
Separating form and meaning: Using self-consistency to quantify task
  understanding across multiple senses
Separating form and meaning: Using self-consistency to quantify task understanding across multiple sensesIEEE Games Entertainment Media Conference (IEEE GEM), 2023
Xenia Ohmer
Elia Bruni
Dieuwke Hupkes
LRM
279
17
0
19 May 2023
What's the Meaning of Superhuman Performance in Today's NLU?
What's the Meaning of Superhuman Performance in Today's NLU?Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Simone Tedeschi
Johan Bos
T. Declerck
Jan Hajic
Daniel Hershcovich
...
Simon Krek
Steven Schockaert
Rico Sennrich
Ekaterina Shutova
Roberto Navigli
ELMLM&MAVLMReLMLRM
288
37
0
15 May 2023
MEGA: Multilingual Evaluation of Generative AI
MEGA: Multilingual Evaluation of Generative AIConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Kabir Ahuja
Harshita Diddee
Rishav Hada
Millicent Ochieng
Krithika Ramesh
...
T. Ganu
Sameer Segal
Maxamed Axmed
Kalika Bali
Sunayana Sitaram
LM&MALRMELM
533
343
0
22 Mar 2023
DiTTO: A Feature Representation Imitation Approach for Improving
  Cross-Lingual Transfer
DiTTO: A Feature Representation Imitation Approach for Improving Cross-Lingual TransferConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Shanu Kumar
Abbaraju Soujanya
Sandipan Dandapat
Sunayana Sitaram
Monojit Choudhury
VLM
178
1
0
04 Mar 2023
Modular Deep Learning
Modular Deep Learning
Jonas Pfeiffer
Sebastian Ruder
Ivan Vulić
Edoardo Ponti
MoMeOOD
421
102
0
22 Feb 2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense RetrievalInternational Conference on Learning Representations (ICLR), 2023
Shunyu Zhang
Yaobo Liang
Ming Gong
Daxin Jiang
Nan Duan
355
8
0
03 Feb 2023
Zero-shot cross-lingual transfer language selection using linguistic
  similarity
Zero-shot cross-lingual transfer language selection using linguistic similarityInformation Processing & Management (IPM), 2023
J. Eronen
M. Ptaszynski
Fumito Masui
218
47
0
31 Jan 2023
Multilingual News Location Detection using an Entity-Based Siamese
  Network with Semi-Supervised Contrastive Learning and Knowledge Base
Multilingual News Location Detection using an Entity-Based Siamese Network with Semi-Supervised Contrastive Learning and Knowledge Base
Víctor Suárez-Paniagua
Steven Derby
Tri Kurniawan Wijaya
108
0
0
22 Dec 2022
ORCA: A Challenging Benchmark for Arabic Language Understanding
ORCA: A Challenging Benchmark for Arabic Language UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
AbdelRahim Elmadany
El Moatez Billah Nagoudi
Muhammad Abdul-Mageed
ELM
285
60
0
21 Dec 2022
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for
  Natural Language Understanding in Task-Oriented Dialogue
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented DialogueAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Nikita Moghe
E. Razumovskaia
Liane Guillou
Ivan Vulić
Anna Korhonen
Alexandra Birch
264
18
0
20 Dec 2022
Extrinsic Evaluation of Machine Translation Metrics
Extrinsic Evaluation of Machine Translation MetricsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Nikita Moghe
Tom Sherborne
Mark Steedman
Alexandra Birch
ELM
236
23
0
20 Dec 2022
Naamapadam: A Large-Scale Named Entity Annotated Data for Indic
  Languages
Naamapadam: A Large-Scale Named Entity Annotated Data for Indic LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
A. Mhaske
Harsh Kedia
Sumanth Doddapaneni
Mitesh M. Khapra
Pratyush Kumar
V. Rudramurthy
Anoop Kunchukuttan
274
40
0
20 Dec 2022
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation
On the Blind Spots of Model-Based Evaluation Metrics for Text GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Tianxing He
Jingyu Zhang
Tianle Wang
Sachin Kumar
Dong Wang
James R. Glass
Yulia Tsvetkov
375
59
0
20 Dec 2022
The Decades Progress on Code-Switching Research in NLP: A Systematic
  Survey on Trends and Challenges
The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and ChallengesAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Genta Indra Winata
Alham Fikri Aji
Zheng-Xin Yong
Thamar Solorio
301
49
0
19 Dec 2022
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented DialogueAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
William B. Held
Christopher Hidey
Fei Liu
Eric Zhu
Rahul Goel
Diyi Yang
Rushin Shah
207
4
0
15 Dec 2022
Towards Leaving No Indic Language Behind: Building Monolingual Corpora,
  Benchmark and Models for Indic Languages
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Sumanth Doddapaneni
Rahul Aralikatte
Gowtham Ramesh
Shreyansh Goyal
Mitesh M. Khapra
Anoop Kunchukuttan
Pratyush Kumar
ELM
319
113
0
11 Dec 2022
QAmeleon: Multilingual QA with Only 5 Examples
QAmeleon: Multilingual QA with Only 5 ExamplesTransactions of the Association for Computational Linguistics (TACL), 2022
Priyanka Agrawal
Chris Alberti
Fantine Huot
Joshua Maynez
Ji Ma
Sebastian Ruder
Kuzman Ganchev
Dipanjan Das
Mirella Lapata
215
32
0
15 Nov 2022
TaTa: A Multilingual Table-to-Text Dataset for African Languages
TaTa: A Multilingual Table-to-Text Dataset for African LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Sebastian Gehrmann
Sebastian Ruder
Vitaly Nikolaev
Jan A. Botha
Michael Chavinda
Ankur P. Parikh
Clara E. Rivera
LMTD
244
14
0
31 Oct 2022
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity
  Recognition
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity RecognitionConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
David Ifeoluwa Adelani
Graham Neubig
Sebastian Ruder
Shruti Rijhwani
Michael Beukman
...
Idris Abdulmumin
Odunayo Ogundepo
Oreen Yousuf
Tatiana Moteu Ngoli
Dietrich Klakow
283
51
0
22 Oct 2022
Prompt-Tuning Can Be Much Better Than Fine-Tuning on Cross-lingual
  Understanding With Multilingual Language Models
Prompt-Tuning Can Be Much Better Than Fine-Tuning on Cross-lingual Understanding With Multilingual Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Lifu Tu
Caiming Xiong
Yingbo Zhou
VLMAAMLLRM
321
30
0
22 Oct 2022
Data-Efficient Strategies for Expanding Hate Speech Detection into
  Under-Resourced Languages
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Paul Röttger
Debora Nozza
Federico Bianchi
Dirk Hovy
184
12
0
20 Oct 2022
Predicting Fine-Tuning Performance with Probing
Predicting Fine-Tuning Performance with ProbingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Zining Zhu
Soroosh Shahtalebi
Frank Rudzicz
171
12
0
13 Oct 2022
Multilingual Representation Distillation with Contrastive Learning
Multilingual Representation Distillation with Contrastive LearningConference of the European Chapter of the Association for Computational Linguistics (EACL), 2022
Weiting Tan
Kevin Heffernan
Holger Schwenk
Philipp Koehn
172
22
0
10 Oct 2022
Language Models are Multilingual Chain-of-Thought Reasoners
Language Models are Multilingual Chain-of-Thought ReasonersInternational Conference on Learning Representations (ICLR), 2022
Freda Shi
Mirac Suzgun
Markus Freitag
Xuezhi Wang
Suraj Srivats
...
Yi Tay
Sebastian Ruder
Denny Zhou
Dipanjan Das
Jason W. Wei
ReLMLRM
579
483
0
06 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review
State-of-the-art generalisation research in NLP: A taxonomy and reviewNature Machine Intelligence (Nat. Mach. Intell.), 2022
Dieuwke Hupkes
Mario Giulianelli
Verna Dankers
Mikel Artetxe
Yanai Elazar
...
Leila Khalatbari
Maria Ryskina
Rita Frieske
Robert Bamler
Zhijing Jin
612
131
0
06 Oct 2022
An Empirical Study on Cross-X Transfer for Legal Judgment Prediction
An Empirical Study on Cross-X Transfer for Legal Judgment Prediction
Joel Niklaus
Matthias Sturmer
Ilias Chalkidis
ELMAILaw
286
20
0
25 Sep 2022
Previous
123
Next