Average Is Not Enough: Caveats of Multilingual Evaluation

3 January 2023

Papers citing "Average Is Not Enough: Caveats of Multilingual Evaluation"

6 / 6 papers shown

Title
A Principled Framework for Evaluating on Typologically Diverse Languages Esther Ploeger Wessel Poelman Andreas Holck Høeg-Petersen Anders Schlichtkrull Miryam de Lhoneux Johannes Bjerva 36 1 0 06 Jul 2024
What is "Typological Diversity" in NLP? Esther Ploeger Wessel Poelman Miryam de Lhoneux Johannes Bjerva 22 2 0 06 Feb 2024
Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learning Genta Indra Winata Lingjue Xie Karthik Radhakrishnan Shijie Wu Xisen Jin Pengxiang Cheng Mayank Kulkarni Daniel Preotiuc-Pietro CLL 10 18 0 25 May 2023
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin P. Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei-ping Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 246 285 0 02 Feb 2021
Morphology Matters: A Multilingual Language Modeling Analysis Hyunji Hayley Park Katherine J. Zhang Coleman Haley K. Steimel Han Liu Lane Schwartz 39 47 0 11 Dec 2020
How Can We Accelerate Progress Towards Human-like Linguistic Generalization? Tal Linzen 218 188 0 03 May 2020