Having Beer after Prayer? Measuring Cultural Bias in Large Language Models

23 May 2023

Papers citing "Having Beer after Prayer? Measuring Cultural Bias in Large Language Models"

50 / 60 papers shown

Title
Out of Sight Out of Mind, Out of Sight Out of Mind: Measuring Bias in Language Models Against Overlooked Marginalized Groups in Regional Contexts Fatma Elsafoury David Hartmann 19 0 0 17 Apr 2025
An Evaluation of Cultural Value Alignment in LLM Nicholas Sukiennik Chen Gao Fengli Xu Y. Li 26 0 0 11 Apr 2025
Beyond the Reported Cutoff: Where Large Language Models Fall Short on Financial Knowledge Agam Shah Liqin Ye Sebastian Jaskowski Wei Xu S. Chava AIFin 28 0 0 30 Mar 2025
Lost in Cultural Translation: Do LLMs Struggle with Math Across Cultural Contexts? Aabid Karim Abdul Karim Bhoomika Lohana Matt Keon Jaswinder Singh A. Sattar 44 0 0 23 Mar 2025
SaudiCulture: A Benchmark for Evaluating Large Language Models Cultural Competence within Saudi Arabia Lama Ayash Hassan Alhuzali Ashwag Alasmari Sultan Aloufi 38 0 0 21 Mar 2025
Can (A)I Change Your Mind? Miriam Havin Timna Wharton Kleinman Moran Koren Yaniv Dover Ariel Goldstein 53 0 0 03 Mar 2025
What are Foundation Models Cooking in the Post-Soviet World? Anton Lavrouk Tarek Naous Alan Ritter Wei-ping Xu 61 0 0 25 Feb 2025
Do Multilingual LLMs Think In English? Lisa Schut Y. Gal Sebastian Farquhar 35 3 0 24 Feb 2025
AACessTalk: Fostering Communication between Minimally Verbal Autistic Children and Parents with Contextual Guidance and Card Recommendation Dasom Choi SoHyun Park Kyungah Lee Hwajung Hong Y. Kim 35 0 0 17 Feb 2025
BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages Junho Myung Nayeon Lee Yi Zhou Jiho Jin Rifki Afina Putri ... Seid Muhie Yimam Mohammad Taher Pilehvar N. Ousidhoum Jose Camacho-Collados Alice H. Oh 87 30 0 17 Jan 2025
Desert Camels and Oil Sheikhs: Arab-Centric Red Teaming of Frontier LLMs Muhammed Saeed Elgizouli Mohamed Mukhtar Mohamed Shaina Raza Muhammad Abdul-Mageed Shady Shehata 33 0 0 31 Oct 2024
A Statistical Analysis of LLMs' Self-Evaluation Using Proverbs Ryosuke Sonoda Ramya Srinivasan 49 1 0 22 Oct 2024
Exploring Social Desirability Response Bias in Large Language Models: Evidence from GPT-4 Simulations Sanguk Lee Kai-Qi Yang Tai-Quan Peng Ruth Heo Hui Liu 19 0 0 20 Oct 2024
Generative AI, Pragmatics, and Authenticity in Second Language Learning Robert Godwin-Jones` 26 0 0 18 Oct 2024
One Language, Many Gaps: Evaluating Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks Fangru Lin Shaoguang Mao Emanuele La Malfa Valentin Hofmann Adrian de Wynter Jing Yao Si-Qing Chen Michael Wooldridge Furu Wei Furu Wei 40 2 0 14 Oct 2024
Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements Jingyu Zhang Ahmed Elgohary Ahmed Magooda Daniel Khashabi Benjamin Van Durme 38 2 0 11 Oct 2024
MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment Amir Hossein Kargaran Ali Modarressi Nafiseh Nikeghbal Jana Diesner François Yvon Hinrich Schütze ELM 33 3 0 08 Oct 2024
CulturalBench: a Robust, Diverse and Challenging Benchmark on Measuring the (Lack of) Cultural Knowledge of LLMs Yu Ying Chiu Liwei Jiang Bill Yuchen Lin Chan Young Park Shuyue Stella Li ... Mehar Bhatia Maria Antoniak Yulia Tsvetkov Vered Shwartz Yejin Choi ELM ALM 42 18 0 03 Oct 2024
CamelEval: Advancing Culturally Aligned Arabic Language Models and Benchmarks Zhaozhi Qian Faroq Altam Muhammad Alqurishi Riad Souissi 19 1 0 19 Sep 2024
AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs Basel Mousi Nadir Durrani Fatema Ahmad Md. Arid Hasan Maram Hasanain Tameem Kabbani Fahim Dalvi Shammur A. Chowdhury Firoj Alam 34 0 0 17 Sep 2024
Challenging Fairness: A Comprehensive Exploration of Bias in LLM-Based Recommendations Shahnewaz Karim Sakib Anindya Bijoy Das 21 0 0 17 Sep 2024
ExploreSelf: Fostering User-driven Exploration and Reflection on Personal Challenges with Adaptive Guidance by Large Language Models Inhwa Song SoHyun Park Sachin R. Pendse J. Schleider Munmun De Choudhury Young-Ho Kim 24 0 0 15 Sep 2024
Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English Fiifi Dawson Zainab Mosunmola Sahil Pocker Raj Abhijit Dandekar Rajat Dandekar Sreedath Panat 30 3 0 14 Sep 2024
Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas Louis Kwok Michal Bravansky Lewis D. Griffin 34 11 0 13 Aug 2024
Analyzing Cultural Representations of Emotions in LLMs through Mixed Emotion Survey Shiran Dudy Ibrahim Said Ahmad Ryoko Kitajima Agata Lapedriza 29 2 0 04 Aug 2024
Visual Stereotypes of Autism Spectrum in DALL-E, Stable Diffusion, SDXL, and Midjourney Maciej Wodziñski Marcin Rządeczka Anastazja Szuła Marta Sokól Marcin Moskalewicz DiffM 36 0 0 23 Jul 2024
ALLaM: Large Language Models for Arabic and English M Saiful Bari Yazeed Alnumay Norah A. Alzahrani Nouf M. Alotaibi H. A. Alyahya ... Jeril Kuriakose Abdalghani Abujabal Nora Al-Twairesh Areeb Alowisheq Haidar Khan 26 11 0 22 Jul 2024
Representation Bias in Political Sample Simulations with Large Language Models Weihong Qi Hanjia Lyu Jiebo Luo 25 5 0 16 Jul 2024
NativQA: Multilingual Culturally-Aligned Natural Query for LLMs Md. Arid Hasan Maram Hasanain Fatema Ahmad Sahinur Rahman Laskar Sunaya Upadhyay Vrunda N. Sukhadia Mucahid Kutlu Shammur A. Chowdhury Firoj Alam 33 4 0 13 Jul 2024
Beyond Aesthetics: Cultural Competence in Text-to-Image Models Nithish Kannen Arif Ahmad Marco Andreetto Vinodkumar Prabhakaran Utsav Prabhu Adji Bousso Dieng Pushpak Bhattacharyya Shachi Dave 39 15 0 09 Jul 2024
CaLMQA: Exploring culturally specific long-form question answering across 23 languages Shane Arora Marzena Karpinska Hung-Ting Chen Ipsita Bhattacharjee Mohit Iyyer Eunsol Choi HILM 29 11 0 25 Jun 2024
BertaQA: How Much Do Language Models Know About Local Culture? Julen Etxaniz Gorka Azkune A. Soroa Oier López de Lacalle Mikel Artetxe 36 6 0 11 Jun 2024
CulturePark: Boosting Cross-cultural Understanding in Large Language Models Cheng-rong Li Damien Teney Linyi Yang Qingsong Wen Xing Xie Jindong Wang 40 4 0 24 May 2024
Annotation-Efficient Preference Optimization for Language Model Alignment Yuu Jinnai Ukyo Honda 38 0 0 22 May 2024
Cross-Care: Assessing the Healthcare Implications of Pre-training Data on Language Model Bias Shan Chen Jack Gallifant Mingye Gao Pedro Moreira Nikolaj Munch ... Hugo J. W. L. Aerts Brian Anthony Leo Anthony Celi William G. La Cava Danielle S. Bitterman 29 8 0 09 May 2024
CultiVerse: Towards Cross-Cultural Understanding for Paintings with Large Language Model Wei Zhang Wong Kam-Kwai Biying Xu Yiwen Ren Yuhuai Li Minfeng Zhu Yingchaojie Feng Wei Chen 25 2 0 01 May 2024
From Persona to Personalization: A Survey on Role-Playing Language Agents Jiangjie Chen Xintao Wang Rui Xu Siyu Yuan Yikai Zhang ... Caiyu Hu Siye Wu Scott Ren Ziquan Fu Yanghua Xiao 50 72 0 28 Apr 2024
CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies Weiyan Shi Ryan Li Yutong Zhang Caleb Ziems Chunhua yu R. Horesh Rogério Abreu de Paula Diyi Yang 23 8 0 23 Apr 2024
High-Dimension Human Value Representation in Large Language Models Samuel Cahyawijaya Delong Chen Yejin Bang Leila Khalatbari Bryan Wilie Ziwei Ji Etsuko Ishii Pascale Fung 54 5 0 11 Apr 2024
CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledge Yu Ying Chiu Amirhossein Ajalloeian Maria Antoniak Chan Young Park Shuyue Stella Li Mehar Bhatia Sahithya Ravi Yulia Tsvetkov Vered Shwartz Yejin Choi 34 13 0 10 Apr 2024
A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias Yuemei Xu Ling Hu Jiayi Zhao Zihan Qiu Yuqi Ye Hanwen Gu LRM 19 36 0 01 Apr 2024
Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews Weixin Liang Zachary Izzo Yaohui Zhang Haley Lepp Hancheng Cao ... Haotian Ye Sheng Liu Zhi Huang Daniel A. McFarland James Y. Zou DeLMO 62 78 0 11 Mar 2024
Unintended Impacts of LLM Alignment on Global Representation Michael Joseph Ryan William B. Held Diyi Yang 27 39 0 22 Feb 2024
CultureLLM: Incorporating Cultural Differences into Large Language Models Cheng-rong Li Mengzhou Chen Jindong Wang Sunayana Sitaram Xing Xie VLM 46 17 0 09 Feb 2024
Generative AI to Generate Test Data Generators Benoit Baudry K. Etemadi Sen Fang Yogya Gamage Yi Liu Yuxin Liu Martin Monperrus Javier Ron André Silva Deepika Tiwari 9 5 0 31 Jan 2024
Towards Conversational Diagnostic AI Tao Tu Anil Palepu M. Schaekermann Khaled Saab Jan Freyberg ... Katherine Chou Greg S. Corrado Yossi Matias Alan Karthikesalingam Vivek Natarajan AI4MH LM&MA 18 87 0 11 Jan 2024
From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models Wolfgang Messner Tatum Greene Josephine Matalone 11 4 0 21 Dec 2023
Cultural Bias and Cultural Alignment of Large Language Models Yan Tao Olga Viberg Ryan S. Baker René F. Kizilcec ELM 13 72 0 23 Nov 2023
Cultural Adaptation of Recipes Yong Cao Yova Kementchedjhieva Ruixiang Cui Antonia Karamolegkou Li Zhou Megan Dare Lucia Donatelli Daniel Hershcovich 13 5 0 26 Oct 2023
Navigating Cultural Chasms: Exploring and Unlocking the Cultural POV of Text-To-Image Models Mor Ventura Eyal Ben-David Anna Korhonen Roi Reichart 13 12 0 03 Oct 2023