In-Context Impersonation Reveals Large Language Models' Strengths and Biases

24 May 2023

Papers citing "In-Context Impersonation Reveals Large Language Models' Strengths and Biases"

50 / 109 papers shown

Title
Aligning to Thousands of Preferences via System Message Generalization Seongyun Lee Sue Hyun Park Seungone Kim Minjoon Seo ALM 14 35 0 28 May 2024
Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations Yi-Pei Chen Noriki Nishida Hideki Nakayama Yuji Matsumoto LLMAG 28 3 0 28 May 2024
WisPerMed at BioLaySumm: Adapting Autoregressive Large Language Models for Lay Summarization of Scientific Articles T. M. G. Pakull Hendrik Damm Ahmad Idrissi-Yaghir Henning Schafer Peter A. Horn Christoph M. Friedrich 21 1 0 20 May 2024
MarkLLM: An Open-Source Toolkit for LLM Watermarking Leyi Pan Aiwei Liu Zhiwei He Zitian Gao Xuandong Zhao ... Shuliang Liu Xuming Hu Lijie Wen Irwin King Philip S. Yu 27 23 0 16 May 2024
Sign of the Times: Evaluating the use of Large Language Models for Idiomaticity Detection Dylan Phelps Thomas Pickard Maggie Mi Edward Gow-Smith Aline Villavicencio 30 4 0 15 May 2024
Navigating LLM Ethics: Advancements, Challenges, and Future Directions Junfeng Jiao S. Afroogh Yiming Xu Connor Phillips AILaw 55 19 0 14 May 2024
Conformity, Confabulation, and Impersonation: Persona Inconstancy in Multi-Agent LLM Collaboration Razan Baltaji Babak Hemmatian L. Varshney LLMAG 19 1 0 06 May 2024
FairMonitor: A Dual-framework for Detecting Stereotypes and Biases in Large Language Models Yanhong Bai Jiabao Zhao Jinxin Shi Zhentao Xie Xingjiao Wu Liang He 25 3 0 06 May 2024
PICLe: Eliciting Diverse Behaviors from Large Language Models with Persona In-Context Learning Hyeong Kyu Choi Yixuan Li 59 17 0 03 May 2024
MMAC-Copilot: Multi-modal Agent Collaboration Operating Copilot Zirui Song Yaohang Li Meng Fang Zhenhao Chen Zecheng Shi Yuan Huang Ling-Hao Chen Xiuying Chen Ling Chen LLMAG 26 1 0 28 Apr 2024
AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaboration Bo Pan Jiaying Lu Ke Wang Li Zheng Zhen Wen Yingchaojie Feng Minfeng Zhu Wei Chen LLMAG 29 10 0 18 Apr 2024
On the effectiveness of Large Language Models for GitHub Workflows Xinyu Zhang Siddharth Muralee Sourag Cherupattamoolayil Aravind Machiry 20 2 0 19 Mar 2024
RSBuilding: Towards General Remote Sensing Image Building Extraction and Change Detection with Foundation Model Mingze Wang Lili Su Cilin Yan Sheng Xu Pengcheng Yuan Xiaolong Jiang Baochang Zhang 39 11 0 12 Mar 2024
CogBench: a large language model walks into a psychology lab Julian Coda-Forno Marcel Binz Jane X. Wang Eric Schulz ELM ALM LLMAG LM&MA 64 33 0 28 Feb 2024
Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Information Seungjong Sun Eungu Lee Dongyan Nan Xiangying Zhao Wonbyung Lee Bernard J. Jansen Jang Hyun Kim 31 17 0 28 Feb 2024
Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation Jiawei Wang Renhe Jiang Chuang Yang Zengqing Wu Makoto Onizuka Ryosuke Shibasaki Noboru Koshizuka Chuan Xiao LLMAG 26 28 0 22 Feb 2024
Q-Probe: A Lightweight Approach to Reward Maximization for Language Models Kenneth Li Samy Jelassi Hugh Zhang Sham Kakade Martin Wattenberg David Brandfonbrener 19 9 0 22 Feb 2024
Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents Zengqing Wu Run Peng Shuyuan Zheng Qianying Liu Xu Han Brian Inhyuk Kwon Makoto Onizuka Shaojie Tang Chuan Xiao 22 10 0 19 Feb 2024
Stick to Your Role! Context-dependence and Stability of Personal Value Expression in Large Language Models Grgur Kovač Rémy Portelas Masataka Sawayama Peter Ford Dominey Pierre-Yves Oudeyer LLMAG 19 1 0 19 Feb 2024
Your Large Language Model is Secretly a Fairness Proponent and You Should Prompt it Like One Tianlin Li Xiaoyu Zhang Chao Du Tianyu Pang Qian Liu Qing-Wu Guo Chao Shen Yang Liu ALM 31 9 0 19 Feb 2024
A Note on Bias to Complete Jia Xu Mona Diab 39 1 0 18 Feb 2024
(Ir)rationality and Cognitive Biases in Large Language Models Olivia Macmillan-Scott Mirco Musolesi LRM 38 17 0 14 Feb 2024
Assessing Generalization for Subpopulation Representative Modeling via In-Context Learning Gabriel Simmons Vladislav Savinov 8 0 0 12 Feb 2024
Had enough of experts? Quantitative knowledge retrieval from large language models David Selby Kai Spriestersbach Yuichiro Iwashita Dennis Bappert Archana Warrier Sumantrak Mukherjee M. Asim Koichi Kise Sebastian Vollmer 29 0 0 12 Feb 2024
Self-Alignment of Large Language Models via Monopolylogue-based Social Scene Simulation Xianghe Pang Shuo Tang Rui Ye Yuxin Xiong Bolun Zhang Yanfeng Wang Siheng Chen 108 27 0 08 Feb 2024
Large Language Models in Cybersecurity: State-of-the-Art Farzad Nourmohammadzadeh Motlagh Mehrdad Hajizadeh Mehryar Majd Pejman Najafi Feng Cheng Christoph Meinel ELM 39 37 0 30 Jan 2024
Canvil: Designerly Adaptation for LLM-Powered User Experiences K. J. Kevin Feng Q. V. Liao Ziang Xiao Jennifer Wortman Vaughan Amy X. Zhang David W. McDonald 20 16 0 17 Jan 2024
Do LLM Agents Exhibit Social Behavior? Yan Leng Yuan Yuan LLMAG 31 33 0 23 Dec 2023
Prompting Datasets: Data Discovery with Conversational Agents Johanna Walker Elisavet Koutsiana Joe Massey Gefion Thuermer Elena Simperl 10 2 0 15 Dec 2023
Dr. Jekyll and Mr. Hyde: Two Faces of LLMs Matteo Gioele Collu Tom Janssen-Groesbeek Stefanos Koffas Mauro Conti S. Picek 14 1 0 06 Dec 2023
Mark My Words: Analyzing and Evaluating Language Model Watermarks Julien Piet Chawin Sitawarin Vivian Fang Norman Mu David A. Wagner WaLM 17 32 0 01 Dec 2023
Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilities Avishree Khare Saikat Dutta Ziyang Li Alaia Solko-Breslin Rajeev Alur Mayur Naik ELM 14 40 0 16 Nov 2023
Selecting Shots for Demographic Fairness in Few-Shot Learning with Large Language Models Carlos Alejandro Aguirre Kuleen Sasse Isabel Cachola Mark Dredze 16 1 0 14 Nov 2023
On the steerability of large language models toward data-driven personas Junyi Li Ninareh Mehrabi Charith Peris Palash Goyal Kai-Wei Chang Aram Galstyan Richard Zemel Rahul Gupta 10 29 0 08 Nov 2023
Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs Shashank Gupta Vaishnavi Shrivastava A. Deshpande A. Kalyan Peter Clark Ashish Sabharwal Tushar Khot 108 49 0 08 Nov 2023
"One-Size-Fits-All"? Examining Expectations around What Constitute "Fair" or "Good" NLG System Behaviors Li Lucy Su Lin Blodgett Milad Shokouhi Hanna M. Wallach Alexandra Olteanu 18 7 0 23 Oct 2023
VizAbility: Enhancing Chart Accessibility with LLM-based Conversational Interaction Joshua Gorniak Yoon Kim Donglai Wei Nam Wook Kim 11 7 0 14 Oct 2023
Diversity of Thought Improves Reasoning Abilities of LLMs Ranjita Naik Varun Chandrasekaran Mert Yuksekgonul Hamid Palangi Besmira Nushi LRM 13 6 0 11 Oct 2023
Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systems Yixin Wan Jieyu Zhao Aman Chadha Nanyun Peng Kai-Wei Chang 24 22 0 08 Oct 2023
Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Models Duanyu Feng Yongfu Dai Jimin Huang Yifang Zhang Qianqian Xie Weiguang Han Zhengyu Chen Alejandro Lopez-Lira Hao Wang 12 7 0 01 Oct 2023
Bias Testing and Mitigation in LLM-based Code Generation Dong Huang Qingwen Bu Jie M. Zhang Xiaofei Xie Junjie Chen Heming Cui 33 20 0 03 Sep 2023
AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors Weize Chen Yusheng Su Jingwei Zuo Cheng Yang Chenfei Yuan ... Xin Cong Ruobing Xie Zhiyuan Liu Maosong Sun Jie Zhou AI4CE LLMAG LM&Ro 13 129 0 21 Aug 2023
Unveiling Gender Bias in Terms of Profession Across LLMs: Analyzing and Addressing Sociological Implications Vishesh Thakur 14 26 0 18 Jul 2023
Large Language Models as Superpositions of Cultural Perspectives Grgur Kovač Masataka Sawayama Rémy Portelas Cédric Colas Peter Ford Dominey Pierre-Yves Oudeyer LLMAG 20 32 0 15 Jul 2023
Mapping the Challenges of HCI: An Application and Evaluation of ChatGPT and GPT-4 for Mining Insights at Scale Jonas Oppenlaender Joonas Hamalainen 10 5 0 08 Jun 2023
Guided scenarios with simulated expert personae: a remarkable strategy to perform cognitive work D. Buren LLMAG 14 7 0 03 Jun 2023
Generative Agents: Interactive Simulacra of Human Behavior J. Park Joseph C. O'Brien Carrie J. Cai Meredith Ringel Morris Percy Liang Michael S. Bernstein LM&Ro AI4CE 206 1,701 0 07 Apr 2023
Ask Me Anything: A simple strategy for prompting language models Simran Arora A. Narayan Mayee F. Chen Laurel J. Orr Neel Guha Kush S. Bhatia Ines Chami Frederic Sala Christopher Ré ReLM LRM 192 160 0 05 Oct 2022
Using cognitive psychology to understand GPT-3 Marcel Binz Eric Schulz ELM LLMAG 228 435 0 21 Jun 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022