DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and
Closely-Related Languages

DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languages

16 March 2024

Orevaoghene Ahia

Aarohi Srivastava

Antonios Anastasopoulos

Papers citing "DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languages"

15 / 15 papers shown

Title
ReLI: A Language-Agnostic Approach to Human-Robot Interaction Linus Nwankwo Bjoern Ellensohn Ozan Özdenizci Elmar Rueckert LM&Ro 45 0 0 03 May 2025
LAG-MMLU: Benchmarking Frontier LLM Understanding in Latvian and Giriama Naome A. Etori Kevin Lu Randu Karisa Arturs Kanepajs LRM ELM 57 0 0 14 Mar 2025
Open or Closed LLM for Lesser-Resourced Languages? Lessons from Greek John Pavlopoulos Juli Bakagianni K. Pouli M. Gavriilidou 50 0 0 22 Jan 2025
HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings Varun Gumma Anandhita Raghunath Mohit Jain Sunayana Sitaram LM&MA 32 1 0 17 Oct 2024
One Language, Many Gaps: Evaluating Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks Fangru Lin Shaoguang Mao Emanuele La Malfa Valentin Hofmann Adrian de Wynter Jing Yao Si-Qing Chen Michael Wooldridge Furu Wei Furu Wei 46 2 0 14 Oct 2024
Predicting the Target Word of Game-playing Conversations using a Low-Rank Dialect Adapter for Decoder Models Dipankar Srirag Aditya Joshi Jacob Eisenstein 42 1 0 31 Aug 2024
Data-Augmentation-Based Dialectal Adaptation for LLMs Fahim Faisal Antonios Anastasopoulos 25 1 0 11 Apr 2024
We're Calling an Intervention: Exploring Fundamental Hurdles in Adapting Language Models to Nonstandard Text Aarohi Srivastava David Chiang 48 0 0 10 Apr 2024
Quantifying the Dialect Gap and its Correlates Across Languages Anjali Kantharuban Ivan Vulić Anna Korhonen 57 19 0 23 Oct 2023
Language Variety Identification with True Labels Marcos Zampieri Kai North T. Jauhiainen Mariano Felice N. Kumari N. Nair Y. Bangera 38 22 0 02 Mar 2023
Finnish Dialect Identification: The Effect of Audio and Text Mika Hämäläinen Khalid Alnajjar N. Partanen Jack Rueter 51 14 0 06 Nov 2021
Systematic Inequalities in Language Technology Performance across the World's Languages Damián E. Blasi Antonios Anastasopoulos Graham Neubig 103 130 0 13 Oct 2021
SD-QA: Spoken Dialectal Question Answering for the Real World Fahim Faisal Sharlina Keshava ibn Alam Antonios Anastasopoulos 88 29 0 24 Sep 2021
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic Muhammad Abdul-Mageed AbdelRahim Elmadany El Moatez Billah Nagoudi VLM 60 444 0 27 Dec 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 191 283 0 23 Oct 2020