Papers citing 'Extrinsic Evaluation of Cultural Competence in Large Language Models'

Title
DIWALI - Diversity and Inclusivity aWare cuLture specific Items for India: Dataset and Assessment of LLMs for Cultural Text Adaptation in Indian Context Pramit Sahoo Maharaj Brahma Maunendra Sankar Desarkar 48 0 0 22 Sep 2025
Culture is Everywhere: A Call for Intentionally Cultural Evaluation Juhyun Oh Inha Cha Michael Saxon Hyunseung Lim Shaily Bhatt Alice Oh 129 0 0 01 Sep 2025
Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generation Arka Mukherjee Shreya Ghosh VLM 68 1 0 22 Aug 2025
Isolating Culture Neurons in Multilingual Large Language Models Danial Namazifard Lukas Galke 111 1 0 04 Aug 2025
SIV-Bench: A Video Benchmark for Social Interaction Understanding and Reasoning Fanqi Kong Weiqin Zu Xinyu Chen Yaodong Yang Song-Chun Zhu Xue Feng VLM 123 1 0 05 Jun 2025
Research Borderlands: Analysing Writing Across Research CulturesAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Shaily Bhatt Tal August Maria Antoniak 253 1 0 01 Jun 2025
Evaluation of Cultural Competence of Vision-Language Models Srishti Yadav Lauren Tilton Maria Antoniak T. Arnold Jiaang Li ... Zhaochong An Negar Rostamzadeh Daniel Hershcovich Serge J. Belongie Ekaterina Shutova VLM CoGe 205 0 0 28 May 2025
MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs Raoyuan Zhao Beiduo Chen Barbara Plank Michael A. Hedderich 156 3 0 27 May 2025
The UD-NewsCrawl Treebank: Reflections and Challenges from a Large-scale Tagalog Syntactic Annotation ProjectAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Angelina A. Aquino Lester James V. Miranda Elsie Marie T. Or 210 1 0 26 May 2025
LLM-Evaluation Tropes: Perspectives on the Validity of LLM-Evaluations Laura Dietz Oleg Zendel P. Bailey Charles L. A. Clarke Ellese Cotterill Jeff Dalton Faegheh Hasibi Mark Sanderson Nick Craswell ELM 231 9 0 27 Apr 2025
Stereotype or Personalization? User Identity Biases Chatbot RecommendationsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Anjali Kantharuban Jeremiah Milbauer Emma Strubell Emma Strubell Graham Neubig 247 25 0 08 Oct 2024
Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art Chen Cecilia Liu Iryna Gurevych Anna Korhonen 446 14 0 06 Jun 2024