Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Study

30 March 2023

Yong Cao

Li Zhou

Seolhwa Lee

Laura Cabello

Min Chen

Daniel Hershcovich

ArXiv PDF HTML

Papers citing "Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Study"

50 / 102 papers shown

Title
From Knowledge to Reasoning: Evaluating LLMs for Ionic Liquids Research in Chemical and Biological Engineering Gaurab Sarkar Sougata Saha 16 0 0 11 May 2025
An Evaluation of Cultural Value Alignment in LLM Nicholas Sukiennik Chen Gao Fengli Xu Y. Li 29 0 0 11 Apr 2025
CAReDiO: Cultural Alignment of LLM via Representativeness and Distinctiveness Guided Data Optimization Jing Yao Xiaoyuan Yi Jindong Wang Zhicheng Dou Xing Xie 23 0 0 09 Apr 2025
CARE: Aligning Language Models for Regional Cultural Awareness Geyang Guo Tarek Naous Hiromi Wakaki Yukiko Nishimura Yuki Mitsufuji Alan Ritter Wei-ping Xu 50 0 0 07 Apr 2025
Cultural Learning-Based Culture Adaptation of Language Models Chen Cecilia Liu Anna Korhonen Iryna Gurevych 39 0 0 03 Apr 2025
DaKultur: Evaluating the Cultural Awareness of Language Models for Danish with Native Speakers Max Müller-Eberstein Mike Zhang Elisa Bassignana Peter Brunsgaard Trolle Rob van der Goot ELM 39 0 0 03 Apr 2025
Enhanced Bloom's Educational Taxonomy for Fostering Information Literacy in the Era of Large Language Models Yiming Luo Ting Liu Patrick Cheong-Iao Pang Dana McKay Z. Chen George Buchanan Shanton Chang AI4Ed 41 0 0 25 Mar 2025
Exploring Cultural Nuances in Emotion Perception Across 15 African Languages Ibrahim Said Ahmad Shiran Dudy Tadesse Destaw Belay Idris Abdulmumin Seid Muhie Yimam Shamsuddeen Hassan Muhammad Kenneth Ward Church 32 0 0 25 Mar 2025
Solving Situation Puzzles with Large Language Model and External Reformulation Kun Li Xinwei Chen Tianyou Song Chengrui Zhou Zhuoran Liu Zhenyan Zhang Jiangjian Guo Qing Shan ReLM LRM 71 2 0 24 Mar 2025
LLM Alignment for the Arabs: A Homogenous Culture or Diverse Ones? Amr Keleg 51 0 0 19 Mar 2025
Provocations from the Humanities for Generative AI Research Lauren F. Klein Meredith Martin André Brock Maria Antoniak Melanie Walsh Jessica Marie Johnson Lauren Tilton David M. Mimno VLM 64 1 0 26 Feb 2025
Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs Jonathan Rystrøm Hannah Rose Kirk Scott A. Hale 41 2 0 23 Feb 2025
Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations Yong Cao Haijiang Liu Arnav Arora Isabelle Augenstein Paul Röttger Daniel Hershcovich 49 1 0 20 Feb 2025
Reasoning and the Trusting Behavior of DeepSeek and GPT: An Experiment Revealing Hidden Fault Lines in Large Language Models Rubing Li João Sedoc Arun Sundararajan LRM 56 0 0 20 Feb 2025
Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking Greta Warren Irina Shklovski Isabelle Augenstein OffRL 67 4 0 13 Feb 2025
Matina: A Large-Scale 73B Token Persian Text Corpus Sara Bourbour Hosseinbeigi Fatemeh Taherinezhad Heshaam Faili Hamed Baghbani Fatemeh Nadi Mostafa Amiri 66 0 0 13 Feb 2025
One world, one opinion? The superstar effect in LLM responses Sofie Goethals L. Rhue 78 0 0 13 Dec 2024
Examining Human-AI Collaboration for Co-Writing Constructive Comments Online Farhana Shahid Maximilian Dittgen Mor Naaman Aditya Vashistha 30 1 0 05 Nov 2024
Generative AI, Pragmatics, and Authenticity in Second Language Learning Robert Godwin-Jones` 31 0 0 18 Oct 2024
Bias in the Mirror: Are LLMs opinions robust to their own adversarial attacks ? Virgile Rennard Christos Xypolopoulos Michalis Vazirgiannis AAML 19 0 0 17 Oct 2024
Self-Pluralising Culture Alignment for Large Language Models Shaoyang Xu Yongqi Leng Linhao Yu Deyi Xiong 21 0 0 16 Oct 2024
Extended Japanese Commonsense Morality Dataset with Masked Token and Label Enhancement Takumi Ohashi Tsubasa Nakagawa Hitoshi Iyatomi 25 0 0 12 Oct 2024
Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspective Taelin Karidi Eitan Grossman Omri Abend 26 1 0 07 Oct 2024
CulturalBench: a Robust, Diverse and Challenging Benchmark on Measuring the (Lack of) Cultural Knowledge of LLMs Yu Ying Chiu Liwei Jiang Bill Yuchen Lin Chan Young Park Shuyue Stella Li ... Mehar Bhatia Maria Antoniak Yulia Tsvetkov Vered Shwartz Yejin Choi ELM ALM 45 18 0 03 Oct 2024
DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Life Yu Ying Chiu Liwei Jiang Yejin Choi 48 2 0 03 Oct 2024
Uncovering Differences in Persuasive Language in Russian versus English Wikipedia Bryan Li Aleksey Panasyuk Chris Callison-Burch 11 1 0 27 Sep 2024
Exposing Assumptions in AI Benchmarks through Cognitive Modelling Jonathan H. Rystrøm Kenneth C. Enevoldsen 32 0 0 25 Sep 2024
Measuring Human and AI Values Based on Generative Psychometrics with Large Language Models Haoran Ye Yuhang Xie Yuanyi Ren Hanjun Fang Xin Zhang Guojie Song LM&MA 30 1 0 18 Sep 2024
Challenging Fairness: A Comprehensive Exploration of Bias in LLM-Based Recommendations Shahnewaz Karim Sakib Anindya Bijoy Das 23 0 0 17 Sep 2024
AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances Dhruv Agarwal Mor Naaman Aditya Vashistha 29 13 0 17 Sep 2024
Real or Robotic? Assessing Whether LLMs Accurately Simulate Qualities of Human Responses in Dialogue Jonathan Ivey Shivani Kumar Jiayu Liu Hua Shen Sushrita Rakshit ... Dustin Wright Abraham Israeli Anders Giovanni Møller Lechen Zhang David Jurgens 47 3 0 12 Sep 2024
Self-Alignment: Improving Alignment of Cultural Values in LLMs via In-Context Learning Rochelle Choenni Ekaterina Shutova 32 5 0 29 Aug 2024
United in Diversity? Contextual Biases in LLM-Based Predictions of the 2024 European Parliament Elections Leah von der Heyde Anna Haensch Alexander Wenz Bolei Ma 49 2 0 29 Aug 2024
Cultural Adaptation of Menus: A Fine-Grained Approach Zhonghe Zhang Xiaoyu He Vivek Iyer Alexandra Birch 29 4 0 24 Aug 2024
Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas Louis Kwok Michal Bravansky Lewis D. Griffin 34 11 0 13 Aug 2024
CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responses Jing Yao Xiaoyuan Yi Xing Xie ELM ALM 29 7 0 15 Jul 2024
Vision-Language Models under Cultural and Inclusive Considerations Antonia Karamolegkou Phillip Rust Yong Cao Ruixiang Cui Anders Søgaard Daniel Hershcovich VLM 47 7 0 08 Jul 2024
Exploring LGBTQ+ Bias in Generative AI Answers across Different Country and Religious Contexts L. Vicsek Anna Vancsó Mike Zajko Judit Takacs 14 0 0 03 Jul 2024
Uplifting Lower-Income Data: Strategies for Socioeconomic Perspective Shifts in Vision-Language Models Joan Nwatu Oana Ignat Rada Mihalcea 16 0 0 02 Jul 2024
Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models? Yuu Jinnai 47 1 0 24 Jun 2024
Translating Across Cultures: LLMs for Intralingual Cultural Adaptation Pushpdeep Singh Mayur Patidar L. Vig 24 4 0 20 Jun 2024
Extrinsic Evaluation of Cultural Competence in Large Language Models Shaily Bhatt Fernando Diaz ELM EGVM 47 4 0 17 Jun 2024
The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models Bolei Ma Xinpeng Wang Tiancheng Hu Anna Haensch Michael A. Hedderich Barbara Plank Frauke Kreuter ALM 28 2 0 16 Jun 2024
Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas Chengyuan Deng Yiqun Duan Xin Jin Heng Chang Yijun Tian ... Kuofeng Gao Sihong He Jun Zhuang Lu Cheng Haohan Wang AILaw 38 16 0 08 Jun 2024
mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans Yusuke Sakai Hidetaka Kamigaito Taro Watanabe LRM 38 2 0 06 Jun 2024
Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art Chen Cecilia Liu Iryna Gurevych Anna Korhonen 33 5 0 06 Jun 2024
Are You Sure? Rank Them Again: Repeated Ranking For Better Preference Datasets Peter Devine ALM 14 3 0 29 May 2024
CulturePark: Boosting Cross-cultural Understanding in Large Language Models Cheng-rong Li Damien Teney Linyi Yang Qingsong Wen Xing Xie Jindong Wang 46 4 0 24 May 2024
CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models Giada Pistilli Alina Leidinger Yacine Jernite Atoosa Kasirzadeh A. Luccioni Margaret Mitchell 21 2 0 22 May 2024
Annotation-Efficient Preference Optimization for Language Model Alignment Yuu Jinnai Ukyo Honda 38 0 0 22 May 2024