Papers citing 'Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages'

Title
Uncovering inequalities in new knowledge learning by large language models across different languages Chenglong Wang Haoyu Tang Xiyuan Yang Yueqi Xie Jina Suh ... Junming Huang Yu Xie Zhaoya Gong Xing Xie Fangzhao Wu 284 0 0 06 Mar 2025
SMAB: MAB based word Sensitivity Estimation Framework and its Applications in Adversarial Text GenerationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 Saurabh Kumar Pandey S. Vashistha Debrup Das Somak Aditya Monojit Choudhury AAML 389 0 0 10 Feb 2025
PARIKSHA : A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data Ishaan Watts Varun Gumma Aditya Yadavalli Vivek Seshadri Manohar Swaminathan Sunayana Sitaram ELM 259 24 0 21 Jun 2024
METAL: Towards Multilingual Meta-Evaluation Rishav Hada Varun Gumma Mohamed Ahmed Kalika Bali Sunayana Sitaram ELM 207 9 0 02 Apr 2024
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?Findings (Findings), 2023 Rishav Hada Varun Gumma Adrian de Wynter Harshita Diddee Mohamed Ahmed Monojit Choudhury Kalika Bali Sunayana Sitaram ALM LM&MA ELM 298 87 0 14 Sep 2023
MEGA: Multilingual Evaluation of Generative AIConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Kabir Ahuja Harshita Diddee Rishav Hada Millicent Ochieng Krithika Ramesh ... T. Ganu Sameer Segal Maxamed Axmed Kalika Bali Sunayana Sitaram LM&MA LRM ELM 529 343 0 22 Mar 2023
On the Calibration of Massively Multilingual Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Kabir Ahuja Sunayana Sitaram Sandipan Dandapat Monojit Choudhury 208 21 0 21 Oct 2022
i-Code: An Integrative and Composable Multimodal Learning FrameworkAAAI Conference on Artificial Intelligence (AAAI), 2022 Ziyi Yang Yuwei Fang Chenguang Zhu Reid Pryzant DongDong Chen ... Bin Xiao Yuanxun Lu Takuya Yoshioka Michael Zeng Xuedong Huang 264 53 0 03 May 2022
Multilingual CheckList: Generation and Evaluation Karthikeyan K Shaily Bhatt Pankaj Singh Somak Aditya Sandipan Dandapat Sunayana Sitaram Monojit Choudhary ELM 286 2 0 24 Mar 2022
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse LanguagesTransactions of the Association for Computational Linguistics (TACL), 2020 J. Clark Eunsol Choi Michael Collins Dan Garrette Tom Kwiatkowski Vitaly Nikolaev J. Palomaki 536 685 0 10 Mar 2020