The Case for "Thick Evaluations" of Cultural Representation in AI

The Case for "Thick Evaluations" of Cultural Representation in AI

24 March 2025

ArXiv (abs)PDF HTML

Papers citing "The Case for "Thick Evaluations" of Cultural Representation in AI"

10 / 10 papers shown

Title
TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Stories Kirti Bhagat Shaily Bhatt Athul Velagapudi Aditya Vashistha Shachi Dave Danish Pruthi 50 0 0 26 Nov 2025
CURE: Cultural Understanding and Reasoning Evaluation - A Framework for "Thick" Culture Alignment Evaluation in LLMs Truong Vo Sanmi Koyejo ELM 84 0 0 15 Nov 2025
Camellia: Benchmarking Cultural Biases in LLMs for Asian Languages Tarek Naous Anagha Savit Carlos Rafael Catalan Geyang Guo Jaehyeok Lee ... JinYeong Bak Keisuke Sakaguchi Tanmoy Chakraborty Yuki Arase Wei Xu 72 0 0 06 Oct 2025
Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settings Hamna G. Bhat Sourabrata Mukherjee Faisal Lalani Evan Hadfield Divya Siddarth Kalika Bali Sunayana Sitaram LM&MA AI4MH 116 0 0 29 Sep 2025
Decentralising LLM Alignment: A Case for Context, Pluralism, and Participation Oriane Peter Kate Devlin 65 0 0 09 Sep 2025
Culture is Everywhere: A Call for Intentionally Cultural Evaluation Juhyun Oh Inha Cha Michael Saxon Hyunseung Lim Shaily Bhatt Alice Oh 133 0 0 01 Sep 2025
Research Borderlands: Analysing Writing Across Research CulturesAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Shaily Bhatt Tal August Maria Antoniak 261 1 0 01 Jun 2025
Meaning Is Not A Metric: Using LLMs to make cultural context legible at scale Cody Kommers Drew Hemment Maria Antoniak Joel Z. Leibo Hoyt Long Emily Robinson Adam Sobey 164 4 0 23 May 2025
Text-to-Image Models and Their Representation of People from Different Nationalities Engaging in Activities Abdulkareem Alsudais 304 0 0 08 Apr 2025
BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and LanguagesNeural Information Processing Systems (NeurIPS), 2024 Junho Myung Nayeon Lee Yi Zhou Jiho Jin Rifki Afina Putri ... Seid Muhie Yimam Mohammad Taher Pilehvar N. Ousidhoum Jose Camacho-Collados Alice Oh 385 106 0 17 Jan 2025