Out of One, Many: Using Language Models to Simulate Human Samples

14 September 2022

Papers citing "Out of One, Many: Using Language Models to Simulate Human Samples"

50 / 277 papers shown

Title
Improving Interpersonal Communication by Simulating Audiences with Language Models Ryan Liu Howard Yen Raja Marjieh Thomas L. Griffiths Ranjay Krishna 10 11 0 01 Nov 2023
Can Large Language Models Capture Public Opinion about Global Warming? An Empirical Assessment of Algorithmic Fidelity and Bias S. Lee T. Peng M. H. Goldberg S. A. Rosenthal J. Kotcher E. W. Maibach A. Leiserowitz AI4CE 10 16 0 01 Nov 2023
CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agents Qinlin Zhao Jindong Wang Yixuan Zhang Yiqiao Jin Kaijie Zhu Hao Chen Xing Xie LLMAG 17 23 0 26 Oct 2023
Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition Sander Schulhoff Jeremy Pinto Anaum Khan Louis-Franccois Bouchard Chenglei Si Svetlina Anati Valen Tagliabue Anson Liu Kost Christopher Carnahan Jordan L. Boyd-Graber SILM 29 41 0 24 Oct 2023
Generative Language Models Exhibit Social Identity Biases Tiancheng Hu Yara Kyrychenko Steve Rathje Nigel Collier S. V. D. Linden Jon Roozenbeek 24 37 0 24 Oct 2023
Prevalence and prevention of large language model use in crowd work V. Veselovsky Manoel Horta Ribeiro Philip Cozzolino Andrew Gordon David Rothschild Robert West 19 0 0 24 Oct 2023
NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violation Aochong Li Mallika Subramanian Arkadiy Saakyan Sky CH-Wang Smaranda Muresan 16 13 0 23 Oct 2023
Prompt Engineering Through the Lens of Optimal Control Yifan Luo Yiming Tang Chengfeng Shen Zhennan Zhou Bin Dong OffRL 25 6 0 22 Oct 2023
CoMPosT: Characterizing and Evaluating Caricature in LLM Simulations Myra Cheng Tiziano Piccardi Diyi Yang LLMAG 11 66 0 17 Oct 2023
Target Variable Engineering Jessica Clark 22 0 0 13 Oct 2023
Not All Demonstration Examples are Equally Beneficial: Reweighting Demonstration Examples for In-Context Learning Zhe Yang Damai Dai Peiyi Wang Zhifang Sui 34 9 0 12 Oct 2023
Multiclass Classification of Policy Documents with Large Language Models Erkan Gunes Christoffer Florczak 18 1 0 12 Oct 2023
Large-Language-Model-Powered Agent-Based Framework for Misinformation and Disinformation Research: Opportunities and Open Challenges Javier Pastor-Galindo Pantaleone Nespoli José A. Ruipérez-Valiente AI4CE LLMAG 26 4 0 11 Oct 2023
Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithms Petter Törnberg D. Valeeva J. Uitermark Christopher Bail LLMAG 31 42 0 05 Oct 2023
The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice Fernando Delgado Stephen Yang Michael A. Madaio Qian Yang 71 100 0 02 Oct 2023
Are Human-generated Demonstrations Necessary for In-context Learning? Rui Li Guoyin Wang Jiwei Li LRM 15 12 0 26 Sep 2023
EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria Tae Soo Kim Yoonjoo Lee Jamin Shin Young-Ho Kim Juho Kim 21 40 0 24 Sep 2023
Studying and improving reasoning in humans and machines Nicolas Yax Hernan Anlló Stefano Palminteri LRM 55 18 0 21 Sep 2023
Rehearsal: Simulating Conflict to Teach Conflict Resolution Omar Shaikh Valentino Chai Michele J. Gelfand Diyi Yang Michael S. Bernstein 16 54 0 21 Sep 2023
Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligence Navid Ghaffarzadegan A. Majumdar Ross Williams Niyousha Hosseinichimeh LLMAG AI4CE 21 23 0 20 Sep 2023
Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting Tilman Beck Hendrik Schuff Anne Lauscher Iryna Gurevych 22 32 0 13 Sep 2023
Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framing Nunzio Lorè Babak Heydari 13 33 0 12 Sep 2023
Framework-Based Qualitative Analysis of Free Responses of Large Language Models: Algorithmic Fidelity A. Amirova T. Fteropoulli Nafiso Ahmed Martin R. Cowie Joel Z. Leibo 18 5 0 06 Sep 2023
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties Taylor Sorensen Liwei Jiang Jena D. Hwang Sydney Levine Valentina Pyatkin ... Kavel Rao Chandra Bhagavatula Maarten Sap J. Tasioulas Yejin Choi SLR 11 50 0 02 Sep 2023
A Survey on Large Language Model based Autonomous Agents Lei Wang Chengbang Ma Xueyang Feng Zeyu Zhang Hao-ran Yang ... Xu Chen Yankai Lin Wayne Xin Zhao Zhewei Wei Ji-Rong Wen LLMAG AI4CE LM&Ro 39 1,101 0 22 Aug 2023
Detecting The Corruption Of Online Questionnaires By Artificial Intelligence Benjamin LeBrun Sharon Temtsin Andrew J. Vonasch Christoph Bartneck DeLMO 14 7 0 14 Aug 2023
Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI Houjiang Liu Anubrata Das Alexander Boltz Didi Zhou Daisy Pinaroc Matthew Lease Min Kyung Lee HAI 25 16 0 14 Aug 2023
Revisiting Prompt Engineering via Declarative Crowdsourcing Aditya G. Parameswaran Shreya Shankar Parth Asawa Naman Jain Yujie Wang 25 21 0 07 Aug 2023
Metric-Based In-context Learning: A Case Study in Text Simplification Subhadra Vadlamannati Gözde Gül Sahin 19 1 0 27 Jul 2023
Evaluating the Moral Beliefs Encoded in LLMs Nino Scherrer Claudia Shi Amir Feder David M. Blei 25 115 0 26 Jul 2023
How to use LLMs for Text Analysis Petter Tornberg 11 9 0 24 Jul 2023
Chit-Chat or Deep Talk: Prompt Engineering for Process Mining U. Jessen Michal Sroka Dirk Fahland 19 18 0 19 Jul 2023
Questioning the Survey Responses of Large Language Models Ricardo Dominguez-Olmedo Moritz Hardt Celestine Mendler-Dünner 26 30 0 13 Jun 2023
Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Tasks V. Veselovsky Manoel Horta Ribeiro Robert West 20 129 0 13 Jun 2023
Towards Coding Social Science Datasets with Language Models Anonymous Acl Taylor Sorensen Lisa P. Argyle Ethan C. Busby Nancy Fulda Joshua R Gubler David Wingate ALM SyDa 13 10 0 03 Jun 2023
Exploring Lottery Prompts for Pre-trained Language Models Yulin Chen Ning Ding Xiaobin Wang Shengding Hu Haitao Zheng Zhiyuan Liu Pengjun Xie VLM LRM 16 7 0 31 May 2023
Mitigating Label Biases for In-context Learning Yu Fei Yifan Hou Zeming Chen Antoine Bosselut 27 66 0 28 May 2023
Training Socially Aligned Language Models on Simulated Social Interactions Ruibo Liu Ruixin Yang Chenyan Jia Ge Zhang Denny Zhou Andrew M. Dai Diyi Yang Soroush Vosoughi ALM 18 44 0 26 May 2023
Science in the Era of ChatGPT, Large Language Models and Generative AI: Challenges for Research Ethics and How to Respond Evangelos Pournaras 20 4 0 24 May 2023
AutoPlan: Automatic Planning of Interactive Decision-Making Tasks With Large Language Models Siqi Ouyang Lei Li LM&Ro LLMAG 20 8 0 24 May 2023
Generating Faithful Synthetic Data with Large Language Models: A Case Study in Computational Social Science V. Veselovsky Manoel Horta Ribeiro Akhil Arora Martin Josifoski Ashton Anderson Robert West SyDa HILM 25 31 0 24 May 2023
Self-ICL: Zero-Shot In-Context Learning with Self-Generated Demonstrations Wei-Lin Chen Cheng-Kuang Wu Yun-Nung Chen Hsin-Hsi Chen 8 27 0 24 May 2023
In-Context Impersonation Reveals Large Language Models' Strengths and Biases Leonard Salewski Stephan Alaniz Isabel Rio-Torto Eric Schulz Zeynep Akata 22 148 0 24 May 2023
Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMs Xiaoyang Song Akshat Gupta Kiyan Mohebbizadeh Shujie Hu Anant Singh 19 25 0 24 May 2023
Active Learning Principles for In-Context Learning with Large Language Models Katerina Margatina Timo Schick Nikolaos Aletras Jane Dwivedi-Yu 20 39 0 23 May 2023
Polyglot or Not? Measuring Multilingual Encyclopedic Knowledge in Foundation Models Tim Schott Daniel Furman Shreshta Bhat ELM 25 4 0 23 May 2023
AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback Yann Dubois Xuechen Li Rohan Taori Tianyi Zhang Ishaan Gulrajani Jimmy Ba Carlos Guestrin Percy Liang Tatsunori B. Hashimoto ALM 40 536 0 22 May 2023
Enhancing Few-shot Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategies Linyong Nan Yilun Zhao Weijin Zou Narutatsu Ri Jaesung Tae Ellen Zhang Arman Cohan Dragomir R. Radev LMTD 20 47 0 21 May 2023
Flatness-Aware Prompt Selection Improves Accuracy and Sample Efficiency Lingfeng Shen Weiting Tan Boyuan Zheng Daniel Khashabi VLM 22 6 0 18 May 2023
From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models Shangbin Feng Chan Young Park Yuhan Liu Yulia Tsvetkov 19 227 0 15 May 2023