Out of One, Many: Using Language Models to Simulate Human Samples

14 September 2022

Papers citing "Out of One, Many: Using Language Models to Simulate Human Samples"

50 / 277 papers shown

Title
Towards Effective Discrimination Testing for Generative AI Thomas P. Zollo Nikita Rajaneesh Richard Zemel Talia B. Gillis Emily Black 30 1 0 31 Dec 2024
Evaluating Convolutional Neural Networks for COVID-19 classification in chest X-ray images Leonardo Gabriel Ferreira Rodrigues Danilo Ferreira da Silva Larissa Ferreira Rodrigues João Fernando Mari 41 3 0 26 Dec 2024
Beyond Partisan Leaning: A Comparative Analysis of Political Bias in Large Language Models Kaiqi Yang Hang Li Yucheng Chu Hang Li Tai-Quan Peng Yuping Lin Hui Liu 80 1 0 21 Dec 2024
Towards an optimised evaluation of teachers' discourse: The case of engaging messages Samuel Falcon Jaime Leon 70 1 0 18 Dec 2024
Beyond Dataset Creation: Critical View of Annotation Variation and Bias Probing of a Dataset for Online Radical Content Detection Arij Riabi Virginie Mouilleron Menel Mahamdi Wissam Antoun Djamé Seddah 62 0 0 16 Dec 2024
Generative Adversarial Reviews: When LLMs Become the Critic Nicolas Bougie Narimasa Watanabe 74 2 0 09 Dec 2024
From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents Xinyi Mou Xuanwen Ding Qi He Liang Wang Jingcong Liang ... L. Sun Jiayu Lin Jie Zhou Xuanjing Huang Zhongyu Wei LLMAG LM&Ro AI4CE 80 12 0 04 Dec 2024
TextClass Benchmark: A Continuous Elo Rating of LLMs in Social Sciences Bastián González-Bustamante VLM 64 0 0 30 Nov 2024
Simulating Tabular Datasets through LLMs to Rapidly Explore Hypotheses about Real-World Entities Miguel Zabaleta Joel Lehman 67 0 0 27 Nov 2024
Epistemic Integrity in Large Language Models Bijean Ghafouri Shahrad Mohammadzadeh James Zhou Pratheeksha Nair Jacob-Junqi Tian Mayank Goel Reihaneh Rabbany Jean-Francois Godbout Kellin Pelrine HILM 34 0 0 10 Nov 2024
One fish, two fish, but not the whole sea: Alignment reduces language models' conceptual diversity Sonia K. Murthy Tomer Ullman Jennifer Hu ALM 41 11 0 07 Nov 2024
Automatic Generation of Question Hints for Mathematics Problems using Large Language Models in Educational Technology Junior Cedric Tonga Benjamin Clément Pierre-Yves Oudeyer LRM 33 2 0 05 Nov 2024
Social Science Meets LLMs: How Reliable Are Large Language Models in Social Simulations? Yue Huang Zhengqing Yuan Yujun Zhou Kehan Guo Xiangqi Wang ... Weixiang Sun Lichao Sun Jindong Wang Yanfang Ye X. Zhang LLMAG 36 10 0 30 Oct 2024
Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machina Yuan Gao Dokyun Lee Gordon Burtch Sina Fazelpour LRM 42 7 0 25 Oct 2024
AgentSense: Benchmarking Social Intelligence of Language Agents through Interactive Scenarios Xinyi Mou Jingcong Liang Jiayu Lin X. Zhang Xiawei Liu ... Rong Ye Lei Chen Haoyu Kuang Xuanjing Huang Zhongyu Wei 26 8 0 25 Oct 2024
Is artificial intelligence still intelligence? LLMs generalize to novel adjective-noun pairs, but don't mimic the full human distribution Hayley Ross Kathryn Davidson Najoung Kim 23 2 0 23 Oct 2024
Using GPT Models for Qualitative and Quantitative News Analytics in the 2024 US Presidental Election Process Bohdan M. Pavlyshenko 24 0 0 21 Oct 2024
SMILES-Prompting: A Novel Approach to LLM Jailbreak Attacks in Chemical Synthesis Aidan Wong He Cao Zijing Liu Yu Li 33 2 0 21 Oct 2024
Exploring Social Desirability Response Bias in Large Language Models: Evidence from GPT-4 Simulations Sanguk Lee Kai-Qi Yang Tai-Quan Peng Ruth Heo Hui Liu 24 2 0 20 Oct 2024
XForecast: Evaluating Natural Language Explanations for Time Series Forecasting Taha Aksu Chenghao Liu Amrita Saha Sarah Tan Caiming Xiong Doyen Sahoo AI4TS 21 1 0 18 Oct 2024
A Simulation System Towards Solving Societal-Scale Manipulation Maximilian Puelma Touzel Sneheel Sarangi Austin Welch Gayatri Krishnakumar Dan Zhao ... Camille Thibault Busra Tugce Gurbuz Reihaneh Rabbany Jean-Francois Godbout Kellin Pelrine 13 3 0 17 Oct 2024
Personas with Attitudes: Controlling LLMs for Diverse Data Annotation Leon Fröhling Gianluca Demartini Dennis Assenmacher 24 2 0 15 Oct 2024
Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets Tommaso Giorgi Lorenzo Cima T. Fagni M. Avvenuti S. Cresci 40 9 0 10 Oct 2024
Intelligent Computing Social Modeling and Methodological Innovations in Political Science in the Era of Large Language Models Zhenyu Wang Yi Xu Dequan Wang Lingfeng Zhou Yiqi Zhou 32 0 0 07 Oct 2024
Kiss up, Kick down: Exploring Behavioral Changes in Multi-modal Large Language Models with Assigned Visual Personas Seungjong Sun Eungu Lee Seo Yeon Baek Seunghyun Hwang Wonbyung Lee Dongyan Nan Bernard J. Jansen Jang Hyun Kim 32 2 0 04 Oct 2024
'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participants Shivani Kapania William Agnew Motahhare Eslami Hoda Heidari Sarah E Fox 34 4 0 28 Sep 2024
Designing Domain-Specific Large Language Models: The Critical Role of Fine-Tuning in Public Opinion Simulation Haocheng Lin ALM 24 0 0 28 Sep 2024
Ethical and Scalable Automation: A Governance and Compliance Framework for Business Applications Haocheng Lin 22 2 0 25 Sep 2024
EvAlignUX: Advancing UX Research through LLM-Supported Exploration of Evaluation Metrics Qingxiao Zheng Minrui Chen Pranav Sharma Yiliu Tang Mehul Oswal Yiren Liu Yun Huang ELM 22 2 0 23 Sep 2024
LLM-Agent-UMF: LLM-based Agent Unified Modeling Framework for Seamless Integration of Multi Active/Passive Core-Agents Amine B. Hassouna Hana Chaari Ines Belhaj LLMAG 30 1 0 17 Sep 2024
Instigating Cooperation among LLM Agents Using Adaptive Information Modulation Qiliang Chen Sepehr Ilami Nunzio Lore Babak Heydari 31 1 0 16 Sep 2024
Benchmarking LLMs in Political Content Text-Annotation: Proof-of-Concept with Toxicity and Incivility Data Bastián González-Bustamante 18 1 0 15 Sep 2024
Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation Cheng Charles Ma Kevin Hyekang Joo Alexandria K. Vail Sunreeta Bhattacharya Álvaro Fernández García Kailana Baker-Matsuoka Sheryl Mathew Lori L. Holt Fernando De la Torre 47 3 0 13 Sep 2024
Identifying the sources of ideological bias in GPT models through linguistic variation in output Christina Walker Joan C. Timoneda 18 0 0 09 Sep 2024
DiverseDialogue: A Methodology for Designing Chatbots with Human-Like Diversity Xiaoyu Lin Xinkai Yu Ankit Aich Salvatore Giorgi Lyle Ungar ALM 40 0 0 30 Aug 2024
United in Diversity? Contextual Biases in LLM-Based Predictions of the 2024 European Parliament Elections Leah von der Heyde Anna Haensch Alexander Wenz Bolei Ma 52 2 0 29 Aug 2024
LLMs generate structurally realistic social networks but overestimate political homophily Serina Chang Alicja Chaszczewicz Emma Wang Maya Josifovska Emma Pierson J. Leskovec 40 6 0 29 Aug 2024
Using Large Language Models to Create AI Personas for Replication, Generalization and Prediction of Media Effects: An Empirical Test of 133 Published Experimental Research Findings Leo Yeykelis Kaavya Pichai James J. Cummings Byron Reeves 62 1 0 28 Aug 2024
How will advanced AI systems impact democracy? Christopher Summerfield Lisa Argyle Michiel Bakker Teddy Collins Esin Durmus ... Elizabeth Seger Divya Siddarth Henrik Skaug Sætra MH Tessler M. Botvinick 38 2 0 27 Aug 2024
IQA-EVAL: Automatic Evaluation of Human-Model Interactive Question Answering Ruosen Li Barry Wang Ruochen Li Xinya Du ELM 33 5 0 24 Aug 2024
Can LLMs Understand Social Norms in Autonomous Driving Games? Boxuan Wang Haonan Duan Yanhao Feng Xu Chen Yongjie Fu Zhaobin Mo Xuan Di 37 4 0 22 Aug 2024
Towards "Differential AI Psychology" and in-context Value-driven Statement Alignment with Moral Foundations Theory Simon Münker SyDa 19 0 0 21 Aug 2024
Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas Louis Kwok Michal Bravansky Lewis D. Griffin 34 11 0 13 Aug 2024
Are Social Sentiments Inherent in LLMs? An Empirical Study on Extraction of Inter-demographic Sentiments Kunitomo Tanaka Ryohei Sasano Koichi Takeda 31 0 0 08 Aug 2024
Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models Nunzio Lorè Alireza Ilami Babak Heydari LRM 37 0 0 05 Aug 2024
Perceptions of Linguistic Uncertainty by Language Models and Humans Catarina G Belém Markelle Kelly M. Steyvers Sameer Singh Padhraic Smyth 33 3 0 22 Jul 2024
Psychometric Alignment: Capturing Human Knowledge Distributions via Language Models Joy He-Yueya Wanjing Anya Ma Kanishk Gandhi Benjamin W. Domingue Emma Brunskill Noah D. Goodman ALM 27 3 0 22 Jul 2024
Do LLMs have Consistent Values? Naama Rozen G. Elidan Amir Globerson Ella Daniel 55 3 0 16 Jul 2024
Representation Bias in Political Sample Simulations with Large Language Models Weihong Qi Hanjia Lyu Jiebo Luo 31 5 0 16 Jul 2024
Vox Populi, Vox AI? Using Language Models to Estimate German Public Opinion Leah von der Heyde Anna Haensch Alexander Wenz 18 4 0 11 Jul 2024