Predicting the Performance of Multilingual NLP Models

Predicting the Performance of Multilingual NLP Models

17 October 2021

Sunayana Sitaram

Sandipan Dandapat

Monojit Choudhury

Papers citing "Predicting the Performance of Multilingual NLP Models"

17 / 17 papers shown

Title
URIEL+: Enhancing Linguistic Inclusion and Usability in a Typological and Multilingual Knowledge Base Aditya Khan Mason Shipton David Anugraha Kaiyao Duan Phuong H. Hoang Eric Khiu A. Seza Doğruöz En-Shiun Annie Lee VLM 43 2 0 17 Feb 2025
On the Evaluation Practices in Multilingual NLP: Can Machine Translation Offer an Alternative to Human Translations? Rochelle Choenni Sara Rajaee Christof Monz Ekaterina Shutova 31 1 0 20 Jun 2024
Decoding the Diversity: A Review of the Indic AI Research Landscape Sankalp KJ Vinija Jain S. Bhaduri Tamoghna Roy Aman Chadha 47 5 0 13 Jun 2024
ProxyLM: Predicting Language Model Performance on Multilingual Tasks via Proxy Models David Anugraha Genta Indra Winata Chenyue Li Patrick Amadeus Irawan En-Shiun Annie Lee 33 7 0 13 Jun 2024
A Reproducibility Study on Quantifying Language Similarity: The Impact of Missing Values in the URIEL Knowledge Base Hasti Toossi Guo Qing Huai Jinyu Liu Eric Khiu A. Seza Doğruöz En-Shiun Annie Lee 22 3 0 17 May 2024
Breaking the Language Barrier: Can Direct Inference Outperform Pre-Translation in Multilingual LLM Applications? Yotam Intrator Matan Halfon Roman Goldenberg Reut Tsarfaty Matan Eyal Ehud Rivlin Yossi Matias Natalia Aizenberg LRM 18 11 0 04 Mar 2024
Evaluation Methodology for Large Language Models for Multilingual Document Question and Answer Adar Kahana Jaya Susan Mathew Said Bleik Jeremy Reynolds Oren Elisha 19 0 0 01 Feb 2024
Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Features Li Zhou Antonia Karamolegkou Wenyu Chen Daniel Hershcovich 43 11 0 10 Oct 2023
Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Review Fred Philippy Siwen Guo Shohreh Haddadan LRM 22 28 0 26 May 2023
Unsupervised Layer-wise Score Aggregation for Textual OOD Detection Maxime Darrin Guillaume Staerman Eduardo Dadalto Camara Gomes Jackie CK Cheung Pablo Piantanida Pierre Colombo OODD 43 11 0 20 Feb 2023
Detecting Languages Unintelligible to Multilingual Models through Local Structure Probes Louis Clouâtre Prasanna Parthasarathi Amal Zouaq Sarath Chandar 33 3 0 09 Nov 2022
On the Calibration of Massively Multilingual Language Models Kabir Ahuja Sunayana Sitaram Sandipan Dandapat Monojit Choudhury 62 16 0 21 Oct 2022
Predicting Fine-Tuning Performance with Probing Zining Zhu Soroosh Shahtalebi Frank Rudzicz 28 9 0 13 Oct 2022
Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages Kabir Ahuja Sandipan Dandapat Sunayana Sitaram Monojit Choudhury LRM 39 16 0 12 May 2022
On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data Kabir Ahuja Monojit Choudhury Sandipan Dandapat 21 3 0 12 May 2022
Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models Kabir Ahuja Shanu Kumar Sandipan Dandapat Monojit Choudhury 9 25 0 12 May 2022
MLQA: Evaluating Cross-lingual Extractive Question Answering Patrick Lewis Barlas Oğuz Ruty Rinott Sebastian Riedel Holger Schwenk ELM 244 491 0 16 Oct 2019