Multilingual Language Models are not Multicultural: A Case Study in Emotion

3 July 2023

Langchen Liu Sharath Chandra Guntuku

Lyle Ungar

ArXiv PDF HTML

Papers citing "Multilingual Language Models are not Multicultural: A Case Study in Emotion"

34 / 34 papers shown

Title
AI with Emotions: Exploring Emotional Expressions in Large Language Models Shin-nosuke Ishikawa Atsushi Yoshino LLMAG AI4MH 64 0 0 20 Apr 2025
KODIS: A Multicultural Dispute Resolution Dialogue Corpus James Hale Sushrita Rakshit Kushal Chawla Jeanne M. Brett Jonathan Gratch 19 0 0 17 Apr 2025
RedditESS: A Mental Health Social Support Interaction Dataset -- Understanding Effective Social Support to Refine AI-Driven Support Tools Zeyad Alghamdi Tharindu Kumarage Garima Agrawal Mansooreh Karami Ibrahim Almuteb Huan Liu AI4MH 51 0 0 27 Mar 2025
Exploring Cultural Nuances in Emotion Perception Across 15 African Languages Ibrahim Said Ahmad Shiran Dudy Tadesse Destaw Belay Idris Abdulmumin Seid Muhie Yimam Shamsuddeen Hassan Muhammad Kenneth Ward Church 39 0 0 25 Mar 2025
CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understanding Tadesse Destaw Belay Ahmed Haj Ahmed Alvin Grissom II Iqra Ameer Grigori Sidorov Olga Kolesnikova Seid Muhie Yimam 41 0 0 12 Mar 2025
A General Framework to Evaluate Methods for Assessing Dimensions of Lexical Semantic Change Using LLM-Generated Synthetic Data Naomi Baes Raphael Merx Nick Haslam Ekaterina Vylomova Haim Dubossarsky 41 0 0 11 Mar 2025
SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection Shamsuddeen Hassan Muhammad N. Ousidhoum Idris Abdulmumin Seid Muhie Yimam Jan Philip Wahle ... A. Ayele Oana Ignat Alexander Panchenko Yi Zhou Saif M. Mohammad 40 1 0 10 Mar 2025
BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languages Shamsuddeen Hassan Muhammad N. Ousidhoum Idris Abdulmumin Jan Philip Wahle Terry Ruas ... Florian Valentin Wunderlich Hanif Muhammad Zhafran Tianhui Zhang Yi Zhou Saif M. Mohammad 33 3 0 17 Feb 2025
Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspective Taelin Karidi Eitan Grossman Omri Abend 26 1 0 07 Oct 2024
CulturalBench: a Robust, Diverse and Challenging Benchmark on Measuring the (Lack of) Cultural Knowledge of LLMs Yu Ying Chiu Liwei Jiang Bill Yuchen Lin Chan Young Park Shuyue Stella Li ... Mehar Bhatia Maria Antoniak Yulia Tsvetkov Vered Shwartz Yejin Choi ELM ALM 45 18 0 03 Oct 2024
The FIX Benchmark: Extracting Features Interpretable to eXperts Helen Jin Shreya Havaldar Chaehyeon Kim Anton Xue Weiqiu You ... Bhuvnesh Jain Amin Madani M. Sako Lyle Ungar Eric Wong 24 1 0 20 Sep 2024
Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas Louis Kwok Michal Bravansky Lewis D. Griffin 34 11 0 13 Aug 2024
Knowledge-based Emotion Recognition using Large Language Models Bin Han Cleo Yau Su Lei Jonathan Gratch CVBM 23 1 0 07 Aug 2024
Analyzing Cultural Representations of Emotions in LLMs through Mixed Emotion Survey Shiran Dudy Ibrahim Said Ahmad Ryoko Kitajima Agata Lapedriza 32 4 0 04 Aug 2024
MASIVE: Open-Ended Affective State Identification in English and Spanish Nicholas Deas Elsbeth Turcan Iván Pérez Mejía Kathleen McKeown CVBM 14 0 0 16 Jul 2024
Are Generative Language Models Multicultural? A Study on Hausa Culture and Emotions using ChatGPT Ibrahim Said Ahmad Shiran Dudy R. Ramachandranpillai Kenneth Church 26 4 0 27 Jun 2024
Building Knowledge-Guided Lexica to Model Cultural Variation Shreya Havaldar Salvatore Giorgi Sunny Rai Thomas Talhelm Sharath Chandra Guntuku Lyle Ungar 16 5 0 17 Jun 2024
BertaQA: How Much Do Language Models Know About Local Culture? Julen Etxaniz Gorka Azkune A. Soroa Oier López de Lacalle Mikel Artetxe 36 6 0 11 Jun 2024
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models Seungone Kim Juyoung Suk Ji Yong Cho Shayne Longpre Chaeeun Kim ... Sean Welleck Graham Neubig Moontae Lee Kyungjae Lee Minjoon Seo ELM ALM LM&MA 97 29 0 09 Jun 2024
mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans Yusuke Sakai Hidetaka Kamigaito Taro Watanabe LRM 38 2 0 06 Jun 2024
Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art Chen Cecilia Liu Iryna Gurevych Anna Korhonen 33 5 0 06 Jun 2024
The Echoes of Multilinguality: Tracing Cultural Value Shifts during LM Fine-tuning Rochelle Choenni Anne Lauscher Ekaterina Shutova 26 7 0 21 May 2024
Large Language Models Show Human-like Social Desirability Biases in Survey Responses Aadesh Salecha Molly E. Ireland Shashanka Subrahmanya João Sedoc L. Ungar J. Eichstaedt PILM AI4CE 39 5 0 09 May 2024
High-Dimension Human Value Representation in Large Language Models Samuel Cahyawijaya Delong Chen Yejin Bang Leila Khalatbari Bryan Wilie Ziwei Ji Etsuko Ishii Pascale Fung 63 5 0 11 Apr 2024
Towards Measuring and Modeling "Culture" in LLMs: A Survey Muhammad Farid Adilazuarda Sagnik Mukherjee Pradhyumna Lavania Siddhant Singh Alham Fikri Aji Jacki OÑeill Ashutosh Modi Monojit Choudhury 50 53 0 05 Mar 2024
KorNAT: LLM Alignment Benchmark for Korean Social Values and Common Knowledge Jiyoung Lee Minwoo Kim Seungho Kim Junghwan Kim Seunghyun Won Hwaran Lee Edward Choi ALM 23 11 0 21 Feb 2024
I Am Not Them: Fluid Identities and Persistent Out-group Bias in Large Language Models Wenchao Dong Assem Zhunis Hyojin Chin Jiyoung Han Meeyoung Cha 16 2 0 16 Feb 2024
Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking Yi Ren Fung Ruining Zhao Jae Doo Chenkai Sun Heng Ji 26 27 0 14 Feb 2024
Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs Simone Balloccu Patrícia Schmidtová Mateusz Lango Ondrej Dusek SILM ELM PILM 21 155 0 06 Feb 2024
English Prompts are Better for NLI-based Zero-Shot Emotion Classification than Target-Language Prompts Patrick Bareiss Roman Klinger Jeremy Barnes 19 7 0 05 Feb 2024
SOCIALITE-LLAMA: An Instruction-Tuned Model for Social Scientific Tasks Gourab Dey Adithya V Ganesan Yash Kumar Lal Manal Shah Shreyashee Sinha Matthew Matero Salvatore Giorgi Vivek Kulkarni H. A. Schwartz ALM 47 9 0 03 Feb 2024
Comparing Styles across Languages: A Cross-Cultural Exploration of Politeness Shreya Havaldar Matthew Pressimone Eric Wong Lyle Ungar 50 2 0 11 Oct 2023
OYXOY: A Modern NLP Test Suite for Modern Greek Konstantinos Kogkalidis S. Chatzikyriakidis Eirini Chrysovalantou Giannikouri Vassiliki Katsouli Christina Klironomou ... Dimitris Papadakis Thelka Pasparaki Erofili Psaltaki E. Sakellariou Hara Soupiona 14 0 0 13 Sep 2023
TorchQL: A Programming Framework for Integrity Constraints in Machine Learning Aaditya Naik Adam Stein Yinjun Wu Mayur Naik Eric Wong 19 3 0 13 Aug 2023