Title
The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models Bolei Ma Xinpeng Wang Tiancheng Hu Anna Haensch Michael A. Hedderich Barbara Plank Frauke Kreuter ALM 28 2 0 16 Jun 2024
Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art Chen Cecilia Liu Iryna Gurevych Anna Korhonen 22 5 0 06 Jun 2024
CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models Giada Pistilli Alina Leidinger Yacine Jernite Atoosa Kasirzadeh A. Luccioni Margaret Mitchell 19 2 0 22 May 2024
The Echoes of Multilinguality: Tracing Cultural Value Shifts during LM Fine-tuning Rochelle Choenni Anne Lauscher Ekaterina Shutova 18 5 0 21 May 2024
Cross-Cultural Validation of Partner Models for Voice User Interfaces Katie Seaborn Iona Gessinger Suzuka Yoshida Benjamin R. Cowan Philip R. Doyle 21 1 0 15 May 2024
ChatGPT and Vaccine Hesitancy: A Comparison of English, Spanish, and French Responses Using a Validated Scale Saubhagya Joshi Eunbin Ha Yonaira M Rivera Vivek K Singh LM&MA 18 1 0 06 May 2024
Modeling the Sacred: Considerations when Using Religious Texts in Natural Language Processing Ben Hutchinson 66 0 0 23 Apr 2024
Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignment Zhaofeng Wu Ananth Balashankar Yoon Kim Jacob Eisenstein Ahmad Beirami 43 8 0 18 Apr 2024
Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions Leena Mathur Paul Pu Liang Louis-Philippe Morency LLMAG 25 6 0 17 Apr 2024
CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledge Yu Ying Chiu Amirhossein Ajalloeian Maria Antoniak Chan Young Park Shuyue Stella Li Mehar Bhatia Sahithya Ravi Yulia Tsvetkov Vered Shwartz Yejin Choi 34 13 0 10 Apr 2024
Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers Libo Qin Qiguang Chen Yuhang Zhou Zhi Chen Yinghui Li Lizi Liao Min Li Wanxiang Che Philip S. Yu LRM 47 35 0 07 Apr 2024
IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provinces Fajri Koto Rahmad Mahendra Nurul Aisyah Timothy Baldwin LRM 59 16 0 02 Apr 2024
Towards Measuring and Modeling "Culture" in LLMs: A Survey Muhammad Farid Adilazuarda Sagnik Mukherjee Pradhyumna Lavania Siddhant Singh Alham Fikri Aji Jacki OÑeill Ashutosh Modi Monojit Choudhury 43 23 0 05 Mar 2024
What Is Missing in Multilingual Visual Reasoning and How to Fix It Yueqi Song Simran Khanuja Graham Neubig VLM LRM 82 6 0 03 Mar 2024
Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages? Shaoyang Xu Weilong Dong Zishan Guo Xinwei Wu Deyi Xiong 33 6 0 28 Feb 2024
Multi-FAct: Assessing Multilingual LLMs' Multi-Regional Knowledge using FActScore Sheikh Shafayat Eunsu Kim Juhyun Oh Alice H. Oh HILM 25 6 0 28 Feb 2024
DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures Agrima Seth Sanchit Ahuja Kalika Bali Sunayana Sitaram 22 8 0 23 Feb 2024
Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking Yi Ren Fung Ruining Zhao Jae Doo Chenkai Sun Heng Ji 8 27 0 14 Feb 2024
Exploring Visual Culture Awareness in GPT-4V: A Comprehensive Probing Yong Cao Wenyan Li Jiaang Li Yifei Yuan Antonia Karamolegkou Daniel Hershcovich VLM 20 7 0 08 Feb 2024
CIC: A Framework for Culturally-Aware Image Captioning Youngsik Yun Jihie Kim VLM 9 5 0 08 Feb 2024
Sociolinguistically Informed Interpretability: A Case Study on Hinglish Emotion Classification Kushal Tatariya Heather Lent Johannes Bjerva Miryam de Lhoneux 19 2 0 05 Feb 2024
Bridging Cultural Nuances in Dialogue Agents through Cultural Value Surveys Yong Cao Min Chen Daniel Hershcovich 10 5 0 18 Jan 2024
Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates Aida Mostafazadeh Davani Mark Díaz Dylan K. Baker Vinodkumar Prabhakaran AAML 8 14 0 11 Dec 2023
Bridging Background Knowledge Gaps in Translation with Automatic Explicitation HyoJung Han Jordan L. Boyd-Graber Marine Carpuat 66 5 0 03 Dec 2023
Increasing Coverage and Precision of Textual Information in Multilingual Knowledge Graphs Simone Conia Min Li Daniel Lee U. F. Minhas Ihab F. Ilyas Yunyao Li 50 8 0 27 Nov 2023
MC $^2$ : Towards Transparent and Culturally-Aware NLP for Minority Languages in China Chen Zhang Mingxu Tao Quzhe Huang Jiuheng Lin Zhibin Chen Yansong Feng 17 2 0 14 Nov 2023
CPopQA: Ranking Cultural Concept Popularity by LLMs Ming Jiang Mansi Joshi 14 6 0 14 Nov 2023
COPAL-ID: Indonesian Language Reasoning with Local Culture and Nuances Haryo Akbarianto Wibowo Erland Hilman Fuadi Made Nindyatama Nityasya Radityo Eko Prasojo Alham Fikri Aji LRM 10 22 0 02 Nov 2023
CreoleVal: Multilingual Multitask Benchmarks for Creoles Heather Lent Kushal Tatariya Raj Dabre Yiyi Chen Marcell Richard Fekete ... Miryam de Lhoneux Daniel Hershcovich Michel DeGraff Anders Sogaard Johannes Bjerva SLR 33 9 0 30 Oct 2023
Cultural Adaptation of Recipes Yong Cao Yova Kementchedjhieva Ruixiang Cui Antonia Karamolegkou Li Zhou Megan Dare Lucia Donatelli Daniel Hershcovich 13 5 0 26 Oct 2023
GD-COMET: A Geo-Diverse Commonsense Inference Model Mehar Bhatia Vered Shwartz 11 6 0 23 Oct 2023
Unveiling the Multi-Annotation Process: Examining the Influence of Annotation Quantity and Instance Difficulty on Model Performance Pritam Kadasi Mayank Singh 21 2 0 23 Oct 2023
Semantic and Expressive Variation in Image Captions Across Languages Andre Ye Sebastin Santy Jena D. Hwang Amy X. Zhang Ranjay Krishna VLM 35 3 0 22 Oct 2023
Comparing Styles across Languages: A Cross-Cultural Exploration of Politeness Shreya Havaldar Matthew Pressimone Eric Wong Lyle Ungar 41 2 0 11 Oct 2023
Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Features Li Zhou Antonia Karamolegkou Wenyu Chen Daniel Hershcovich 40 11 0 10 Oct 2023
AceGPT, Localizing Large Language Models in Arabic Huang Huang Fei Yu Jianqing Zhu Xuening Sun Hao Cheng ... Lian Zhang Ruoyu Sun Xiang Wan Haizhou Li Jinchao Xu 9 22 0 21 Sep 2023
Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayings Chen Cecilia Liu Fajri Koto Timothy Baldwin Iryna Gurevych LRM 17 17 0 15 Sep 2023
BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Models Wei Qi Leong Jian Gang Ngui Yosephine Susanto Hamsawardhini Rengarajan Kengatharaiyer Sarveswaran William-Chandra Tjhi 13 9 0 12 Sep 2023
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants Lucas Bandarkar Davis Liang Benjamin Muller Mikel Artetxe Satya Narayan Shukla Don Husa Naman Goyal Abhinandan Krishnan Luke Zettlemoyer Madian Khabsa 20 127 0 31 Aug 2023
Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems Songbo Hu Han Zhou Mete Hergul Milan Gritta Guchun Zhang Ignacio Iacobacci Ivan Vulić Anna Korhonen 18 10 0 26 Jul 2023
On Evaluating Multilingual Compositional Generalization with Translated Datasets Zi Wang Daniel Hershcovich 15 7 0 20 Jun 2023
Modeling Cross-Cultural Pragmatic Inference with Codenames Duet Omar Shaikh Caleb Ziems William B. Held Aryan Pariani Fred Morstatter Diyi Yang 18 9 0 04 Jun 2023
NLPositionality: Characterizing Design Biases of Datasets and Models Sebastin Santy Jenny T Liang Ronan Le Bras Katharina Reinecke Maarten Sap 23 75 0 02 Jun 2023
Being Right for Whose Right Reasons? Terne Sasha Thorn Jakobsen Laura Cabello Anders Søgaard 11 10 0 01 Jun 2023
Ethical Considerations for Machine Translation of Indigenous Languages: Giving a Voice to the Speakers Manuel Mager Elisabeth Mager Katharina Kann Ngoc Thang Vu 24 29 0 31 May 2023
Multi-lingual and Multi-cultural Figurative Language Understanding Anubha Kabra Emmy Liu Simran Khanuja Alham Fikri Aji Genta Indra Winata Samuel Cahyawijaya Anuoluwapo Aremu Perez Ogayo Graham Neubig 11 26 0 25 May 2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer Akari Asai Sneha Kudugunta Xinyan Velocity Yu Terra Blevins Hila Gonen Machel Reid Yulia Tsvetkov Sebastian Ruder Hannaneh Hajishirzi 22 53 0 24 May 2023
Having Beer after Prayer? Measuring Cultural Bias in Large Language Models Tarek Naous Michael Joseph Ryan Alan Ritter Wei-ping Xu 18 82 0 23 May 2023
Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models Oana Ignat Zhijing Jin Artem Abzaliev Laura Biester Santiago Castro ... Verónica Pérez-Rosas Siqi Shen Zekun Wang Winston Wu Rada Mihalcea LRM 22 6 0 21 May 2023
SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Models Akshita Jha Aida Mostafazadeh Davani Chandan K. Reddy Shachi Dave Vinodkumar Prabhakaran Sunipa Dev 15 39 0 19 May 2023