Dolphin: A Challenging and Diverse Benchmark for Arabic NLG

Dolphin: A Challenging and Diverse Benchmark for Arabic NLG

24 May 2023

El Moatez Billah Nagoudi

AbdelRahim Elmadany

Ahmed Oumar El-Shangiti

Muhammad Abdul-Mageed

Papers citing "Dolphin: A Challenging and Diverse Benchmark for Arabic NLG"

14 / 14 papers shown

Title
Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs Fakhraddin Alwajih Abdellah El Mekki Samar Magdy AbdelRahim Elmadany Omer Nacar ... Anis Koubaa Ismail Berrada Mustafa Jarrar Shady Shehata Muhammad Abdul-Mageed 29 1 0 28 Feb 2025
Where Are We? Evaluating LLM Performance on African Languages Ife Adebara Hawau Olamide Toyin Nahom Tesfu Ghebremichael AbdelRahim Elmadany Muhammad Abdul-Mageed 52 0 0 26 Feb 2025
LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in English T. Y. S. S. Santosh Cornelius Weiss Matthias Grabmair AILaw ELM 39 2 0 12 Oct 2024
AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs Basel Mousi Nadir Durrani Fatema Ahmad Md. Arid Hasan Maram Hasanain Tameem Kabbani Fahim Dalvi Shammur A. Chowdhury Firoj Alam 43 8 0 17 Sep 2024
NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Task Muhammad Abdul-Mageed Amr Keleg AbdelRahim Elmadany Chiyu Zhang Injy Hamed Walid Magdy Houda Bouamor Nizar Habash 22 16 0 06 Jul 2024
ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic Fajri Koto Haonan Li Sara Shatnawi Jad Doughman Abdelrahman Boda Sadallah ... Neha Sengupta Shady Shehata Nizar Habash Preslav Nakov Timothy Baldwin ELM LRM 69 30 0 20 Feb 2024
On the importance of Data Scale in Pretraining Arabic Language Models Abbas Ghaddar Philippe Langlais Mehdi Rezagholizadeh Boxing Chen 11 0 0 15 Jan 2024
Octopus: A Multitask Model and Toolkit for Arabic Natural Language Generation AbdelRahim Elmadany El Moatez Billah Nagoudi Muhammad Abdul-Mageed RALM 16 10 0 24 Oct 2023
NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Task Muhammad Abdul-Mageed AbdelRahim Elmadany Chiyu Zhang El Moatez Billah Nagoudi Houda Bouamor Nizar Habash 18 35 0 24 Oct 2023
TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varieties Karima Kadaoui Samar Magdy Abdul Waheed Md. Tawkat Islam Khondaker Ahmed Oumar El-Shangiti El Moatez Billah Nagoudi Muhammad Abdul-Mageed 22 20 0 06 Aug 2023
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Rifat Shahriyar AIMat LM&MA 16 28 0 23 May 2022
AraT5: Text-to-Text Transformers for Arabic Language Generation El Moatez Billah Nagoudi AbdelRahim Elmadany Muhammad Abdul-Mageed 84 117 0 31 Aug 2021
MLQA: Evaluating Cross-lingual Extractive Question Answering Patrick Lewis Barlas Oğuz Ruty Rinott Sebastian Riedel Holger Schwenk ELM 242 489 0 16 Oct 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018