A Computational Framework for Behavioral Assessment of LLM Therapists

1 January 2024

Yu Ying Chiu

Papers citing "A Computational Framework for Behavioral Assessment of LLM Therapists"

31 / 31 papers shown

Title
How Real Are Synthetic Therapy Conversations? Evaluating Fidelity in Prolonged Exposure Dialogues Suhas BN Dominik Mattioli Saeed Abdullah Rosa I. Arriaga Chris W. Wiese Andrew M. Sherrill 33 0 0 30 Apr 2025
AI with Emotions: Exploring Emotional Expressions in Large Language Models Shin-nosuke Ishikawa Atsushi Yoshino LLMAG AI4MH 64 0 0 20 Apr 2025
When LLM Therapists Become Salespeople: Evaluating Large Language Models for Ethical Motivational Interviewing Haein Kong Seonghyeon Moon ELM 46 0 0 30 Mar 2025
Leveraging LLMs for Mental Health: Detection and Recommendations from Social Discussions Vaishali Aggarwal Sachin Thukral Krushil Patel Arnab Chatterjee AI4MH 59 0 0 03 Mar 2025
Wearable Meets LLM for Stress Management: A Duoethnographic Study Integrating Wearable-Triggered Stressors and LLM Chatbots for Personalized Interventions Sameer Neupane Poorvesh Dongre Denis Gračanin Santosh Kumar 39 0 0 24 Feb 2025
Explaining GPT-4's Schema of Depression Using Machine Behavior Analysis Adithya V Ganesan Vasudha Varadarajan Yash Kumar Lal Veerle C. Eijsbroek Katarina Kjell ... Elizabeth C. Stade J. Eichstaedt Ryan L. Boyd H. A. Schwartz Lucie Flek AI4MH 57 0 0 21 Nov 2024
Do Large Language Models Align with Core Mental Health Counseling Competencies? Viet Cuong Nguyen Mohammad Taher Dongwan Hong Vinicius Konkolics Possobom Vibha Thirunellayi Gopalakrishnan ... Zihang Li H. J. Soled Michael L. Birnbaum Srijan Kumar M. D. Choudhury ELM LM&MA AI4MH 39 3 0 29 Oct 2024
"ChatGPT, Don't Tell Me What to Do": Designing AI for Context Analysis in Humanitarian Frontline Negotiations ZIlin Ma Yiyang Mei Claude Bruderlein Krzysztof Z. Gajos Weiwei Pan 33 1 0 11 Oct 2024
Multi-Session Client-Centered Treatment Outcome Evaluation in Psychotherapy Hongbin Na Tao Shen Shumao Yu Ling Chen 18 0 0 08 Oct 2024
MindScape Study: Integrating LLM and Behavioral Sensing for Personalized AI-Driven Journaling Experiences Subigya Nepal Arvind Pillai William Campbell Talie Massachi Michael V. Heinz ... Colin A. Depp Nicholas C. Jacobson Mary Czerwinski Eric L. Granholm Andrew T. Campbell 17 7 0 15 Sep 2024
ExploreSelf: Fostering User-driven Exploration and Reflection on Personal Challenges with Adaptive Guidance by Large Language Models Inhwa Song SoHyun Park Sachin R. Pendse J. Schleider Munmun De Choudhury Young-Ho Kim 24 0 0 15 Sep 2024
Prompt and Prejudice Lorenzo Berlincioni Luca Cultrera Federico Becattini Marco Bertini A. Bimbo 33 0 0 07 Aug 2024
Towards Collaborative Intelligence: Propagating Intentions and Reasoning for Multi-Agent Coordination with Large Language Models Xihe Qiu Haoyu Wang Xiaoyu Tan Chao Qu Yujie Xiong Yuan-Chia Cheng Yinghui Xu Wei Chu Yuan Qi LLMAG LM&Ro 18 0 0 17 Jul 2024
MentalAgora: A Gateway to Advanced Personalized Care in Mental Health through Multi-Agent Debating and Attribute Control Yeonji Lee Sangjun Park Kyunghyun Cho Jinyeong Bak 26 1 0 03 Jul 2024
EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations L. Galland Catherine Pelachaud Florian Pecune 22 1 0 24 Jun 2024
Towards a Client-Centered Assessment of LLM Therapists by Client Simulation Jiashuo Wang Yang Xiao Yanran Li Changhe Song Chunpu Xu Chenhao Tan Wenjie Li 18 11 0 18 Jun 2024
PATIENT-Ψ: Using Large Language Models to Simulate Patients for Training Mental Health Professionals Ruiyi Wang Stephanie Milani Jamie C. Chiu Jiayin Zhi S. Eack ... Nev Jones Kate Hardy Hong Shen Fei Fang Zhiyu Zoey Chen LM&MA AI4MH 23 9 0 30 May 2024
Can AI Relate: Testing Large Language Model Response for Mental Health Support Saadia Gabriel Isha Puri Xuhai Xu Matteo Malgaroli Marzyeh Ghassemi LM&MA AI4MH 27 11 0 20 May 2024
Digital Diagnostics: The Potential Of Large Language Models In Recognizing Symptoms Of Common Illnesses Gaurav Kumar Gupta Aditi Singh Sijo Valayakkad Manikandan Abul Ehtesham LM&MA 36 1 0 09 May 2024
AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligence Minbeom Kim Hwanhee Lee Joonsuk Park Hwaran Lee Kyomin Jung 19 1 0 18 Apr 2024
Social Skill Training with Large Language Models Diyi Yang Caleb Ziems William B. Held Omar Shaikh Michael S. Bernstein John C. Mitchell LLMAG 24 6 0 05 Apr 2024
Contextual AI Journaling: Integrating LLM and Time Series Behavioral Sensing Technology to Promote Self-Reflection and Well-being using the MindScape App Subigya Nepal Arvind Pillai William Campbell Talie Massachi Eunsol Soul Choi ... Colin A. Depp Nicholas C. Jacobson Mary Czerwinski Dom McGrath Andrew T. Campbell 21 24 0 30 Mar 2024
Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer Counselors Alicja Chaszczewicz Raj Sanjay Shah Ryan Louie B. Arnow Robert E. Kraut Diyi Yang OffRL 9 9 0 21 Mar 2024
The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Support Inhwa Song Sachin R. Pendse Neha Kumar Munmun De Choudhury AI4MH 33 15 0 25 Jan 2024
Towards Understanding Sycophancy in Language Models Mrinank Sharma Meg Tong Tomasz Korbak D. Duvenaud Amanda Askell ... Oliver Rausch Nicholas Schiefer Da Yan Miranda Zhang Ethan Perez 209 178 0 20 Oct 2023
Large Language Models Understand and Can be Enhanced by Emotional Stimuli Cheng-rong Li Jindong Wang Yixuan Zhang Kaijie Zhu Wenxin Hou Jianxun Lian Fang Luo Qiang Yang Xingxu Xie LRM 67 116 0 14 Jul 2023
Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedback Shang-ling Hsu Raj Sanjay Shah Prathik Senthil Zahra Ashktorab Casey Dugan Werner Geyer Diyi Yang 41 17 0 15 May 2023
Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction Ashish Sharma Kevin Rushton Inna Wanyin Lin David Wadden Khendra G. Lucas Adam S. Miner Theresa Nguyen Tim Althoff 71 71 0 04 May 2023
Evaluation of GPT-3.5 and GPT-4 for supporting real-world information needs in healthcare delivery Debadutta Dash Rahul Thapa Juan M. Banda Akshay Swaminathan Morgan Cheatham ... Garret K. Morris H. Magon M. Lungren Eric Horvitz N. Shah ELM LM&MA AI4MH 68 49 0 26 Apr 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 203 2,232 0 22 Mar 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022