Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMs

24 May 2023

Akshat Gupta

Shujie Hu

Papers citing "Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMs"

27 / 27 papers shown

Title
Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications Wenhan Dong Yuemeng Zhao Zhen Sun Yule Liu Zifan Peng ... Jun Wu Ruiming Wang Shengmin Xu Xinyi Huang Xinlei He LLMAG 57 0 0 30 Apr 2025
Persona Dynamics: Unveiling the Impact of Personality Traits on Agents in Text-Based Games Seungwon Lim Seungbeen Lee Dongjun Min Youngjae Yu AI4CE 44 0 0 09 Apr 2025
AI Will Always Love You: Studying Implicit Biases in Romantic AI Companions Clare Grogan Jackie Kay Maria Perez-Ortiz 57 1 0 27 Feb 2025
From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents Xinyi Mou Xuanwen Ding Qi He Liang Wang Jingcong Liang ... L. Sun Jiayu Lin Jie Zhou Xuanjing Huang Zhongyu Wei LLMAG LM&Ro AI4CE 80 13 0 04 Dec 2024
Personality-Guided Code Generation Using Large Language Models Y. Guo Zhenpeng Chen J. Zhang Yang Liu Yun Ma 22 0 0 16 Oct 2024
Humanity in AI: Detecting the Personality of Large Language Models Baohua Zhan Yongyi Huang Wenyao Cui Huaping Zhang Jianyun Shang 18 0 0 11 Oct 2024
Assessment and manipulation of latent constructs in pre-trained language models using psychometric scales Maor Reuben Ortal Slobodin Aviad Elyshar Idan-Chaim Cohen Orna Braun-Lewensohn Odeya Cohen Rami Puzis 38 0 0 29 Sep 2024
Measuring Human and AI Values Based on Generative Psychometrics with Large Language Models Haoran Ye Yuhang Xie Yuanyi Ren Hanjun Fang Xin Zhang Guojie Song LM&MA 30 1 0 18 Sep 2024
The Better Angels of Machine Personality: How Personality Relates to LLM Safety Jie M. Zhang Dongrui Liu Chao Qian Ziyue Gan Yong-jin Liu Yu Qiao Jing Shao LLMAG PILM 45 12 0 17 Jul 2024
Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models Zhiyuan Wen Yu Yang Jiannong Cao Haoming Sun Ruosong Yang Shuaiqi Liu 35 5 0 25 Jun 2024
Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics Seungbeen Lee Seungwon Lim Seungju Han Giyeong Oh Hyungjoo Chae ... Beong-woo Kwak Yeonsoo Lee Dongha Lee Jinyoung Yeo Youngjae Yu 33 8 0 20 Jun 2024
ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models Yuanyi Ren Haoran Ye Hanjun Fang Xin Zhang Guojie Song LLMAG ELM 29 4 0 06 Jun 2024
Dynamic Generation of Personalities with Large Language Models Jianzhi Liu Hexiang Gu Tianyu Zheng Liuyu Xiang Huijia Wu Jie Fu Zhaofeng He 37 3 0 10 Apr 2024
Identifying Multiple Personalities in Large Language Models with External Evaluation Xiaoyang Song Yuta Adachi Jessie Feng Mouwei Lin Linhao Yu Frank Li Akshat Gupta Gopala Anumanchipalli Simerjot Kaur LLMAG 27 8 0 22 Feb 2024
Tailoring Personality Traits in Large Language Models via Unsupervisedly-Built Personalized Lexicons Tianlong Li Shihan Dou Changze Lv Wenhao Liu Jianhan Xu Muling Wu Zixuan Ling Xiaoqing Zheng Xuanjing Huang 19 7 0 25 Oct 2023
Self-Assessment Tests are Unreliable Measures of LLM Personality Akshat Gupta Xiaoyang Song Gopala Anumanchipalli 13 17 0 15 Sep 2023
A Survey on Evaluation of Large Language Models Yu-Chu Chang Xu Wang Jindong Wang Yuanyi Wu Linyi Yang ... Yue Zhang Yi-Ju Chang Philip S. Yu Qian Yang Xingxu Xie ELM LM&MA ALM 58 1,506 0 06 Jul 2023
Personality Traits in Large Language Models Gregory Serapio-García Mustafa Safdari Clément Crepy Luning Sun Stephen Fitz P. Romero Marwa Abdulhai Aleksandra Faust Maja J. Matarić LM&MA LLMAG 55 119 0 01 Jul 2023
Revisiting the Reliability of Psychological Scales on Large Language Models Jen-tse Huang Wenxuan Wang Man Ho Lam E. Li Wenxiang Jiao Michael R. Lyu 34 21 0 31 May 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 251 2,232 0 22 Mar 2023
Leveraging Large Language Models for Multiple Choice Question Answering Joshua Robinson Christopher Rytting David Wingate ELM 138 186 0 22 Oct 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 306 11,909 0 04 Mar 2022
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 236 805 0 14 Oct 2021
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu Max Bartolo Alastair Moore Sebastian Riedel Pontus Stenetorp AILaw LRM 277 1,117 0 18 Apr 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,843 0 18 Apr 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 248 1,986 0 31 Dec 2020
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 406 2,584 0 03 Sep 2019