AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap

2 June 2023

Papers citing "AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap"

49 / 99 papers shown

Title
Harder, Better, Faster, Stronger: Interactive Visualization for Human-Centered AI Tools Md. Naimul Hoque Sungbok Shin Niklas Elmqvist 19 2 0 02 Apr 2024
"I'm categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practices Shivani Kapania Ruiyi Wang Toby Jia-Jun Li Tianshi Li Hong Shen 31 6 0 28 Mar 2024
A Design Space for Intelligent and Interactive Writing Assistants Mina Lee Katy Ilonka Gero John Joon Young Chung S. Buckingham Shum Vipul Raheja ... Joonsuk Park Roy Pea Eugenia H. Rho Shannon Zejiang Shen Pao Siangliulue 29 82 0 21 Mar 2024
Exploring Prompt Engineering Practices in the Enterprise Michael Desmond Michelle Brachman 35 10 0 13 Mar 2024
iScore: Visual Analytics for Interpreting How Language Models Automatically Score Summaries Adam Joseph Coscia Langdon Holmes Wesley Morris Joon Suh Choi Scott Crossley Alex Endert 18 6 0 07 Mar 2024
Determinants of LLM-assisted Decision-Making Eva Eigner Thorsten Händler 43 44 0 27 Feb 2024
Farsight: Fostering Responsible AI Awareness During AI Application Prototyping Zijie J. Wang Chinmay Kulkarni Lauren Wilcox Michael Terry Michael A. Madaio 38 42 0 23 Feb 2024
Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology Nur Yildirim Hannah Richardson Maria T. A. Wetscherek Junaid Bajwa Joseph Jacob ... Ozan Oktay M. Lungren Javier Alvarez-Valle A. Nori Anja Thieme LM&MA 51 44 0 22 Feb 2024
What is the focus of XAI in UI design? Prioritizing UI design principles for enhancing XAI user experience Dian Lei Yao He Jianyou Zeng 24 1 0 21 Feb 2024
Large Language Models for Data Annotation: A Survey Zhen Tan Dawei Li Song Wang Alimohammad Beigi Bohan Jiang Amrita Bhattacharjee Mansooreh Karami Jundong Li Lu Cheng Huan Liu SyDa 42 46 0 21 Feb 2024
Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactions Auste Simkute Lev Tankelevitch Viktor Kewenig A. E. Scott Abigail Sellen Sean Rintel 27 20 0 17 Feb 2024
Why and When LLM-Based Assistants Can Go Wrong: Investigating the Effectiveness of Prompt-Based Interactions for Software Help-Seeking Anjali Khurana Hariharan Subramonyam Parmit K. Chilana 45 30 0 12 Feb 2024
Overconfident and Unconfident AI Hinder Human-AI Collaboration Jingshu Li Yitian Yang Renwen Zhang Yi-Chieh Lee 27 1 0 12 Feb 2024
Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Models Chirag Agarwal Sree Harsha Tanneru Himabindu Lakkaraju LRM 22 35 0 07 Feb 2024
Position: What Can Large Language Models Tell Us about Time Series Analysis Ming Jin Yifan Zhang Wei Chen Kexin Zhang Yuxuan Liang Bin Yang Jindong Wang Shirui Pan Qingsong Wen AI4TS 29 16 0 05 Feb 2024
How Beginning Programmers and Code LLMs (Mis)read Each Other S. Nguyen Hannah McLean Babe Yangtian Zi Arjun Guha C. Anderson Molly Q. Feldman 25 43 0 26 Jan 2024
CUI@CHI 2024: Building Trust in CUIs-From Design to Deployment Smit Desai C. Wei Jaisie Sin Mateusz Dubiel Nima Zargham ... Minha Lee Heloisa Candello Joel E. Fischer Cosmin Munteanu Benjamin R. Cowan 14 3 0 25 Jan 2024
Beyond Behaviorist Representational Harms: A Plan for Measurement and Mitigation Jennifer Chien David Danks 34 13 0 25 Jan 2024
Design, Development, and Deployment of Context-Adaptive AI Systems for Enhanced End-User Adoption Christine P. Lee 10 2 0 24 Jan 2024
Canvil: Designerly Adaptation for LLM-Powered User Experiences K. J. Kevin Feng Q. V. Liao Ziang Xiao Jennifer Wortman Vaughan Amy X. Zhang David W. McDonald 26 16 0 17 Jan 2024
The Metacognitive Demands and Opportunities of Generative AI Lev Tankelevitch Viktor Kewenig Auste Simkute A. E. Scott Advait Sarkar Abigail Sellen Sean Rintel AI4CE 28 94 0 18 Dec 2023
RELIC: Investigating Large Language Model Responses using Self-Consistency Furui Cheng Vilém Zouhar Simran Arora Mrinmaya Sachan Hendrik Strobelt Mennatallah El-Assady HILM 19 18 0 28 Nov 2023
The HaLLMark Effect: Supporting Provenance and Transparent Use of Large Language Models in Writing with Interactive Visualization Md. Naimul Hoque Tasfia Mashiat Bhavya Ghai Cecilia Shelton Fanny Chevalier Kari Kraus Niklas Elmqvist 14 17 0 21 Nov 2023
Leveraging Generative AI for Clinical Evidence Summarization Needs to Ensure Trustworthiness Gongbo Zhang Qiao Jin Denis Jered McInerney Yong Chen Fei Wang ... Mor Peleg Byron C. Wallace Zhiyong Lu Chunhua Weng Yifan Peng 28 18 0 19 Nov 2023
Interpreting Pretrained Language Models via Concept Bottlenecks Zhen Tan Lu Cheng Song Wang Yuan Bo Jundong Li Huan Liu LRM 22 20 0 08 Nov 2023
Knowledge Editing for Large Language Models: A Survey Song Wang Yaochen Zhu Haochen Liu Zaiyi Zheng Chen Chen Jundong Li KELM 66 132 0 24 Oct 2023
Harnessing the Power of LLMs: Evaluating Human-AI Text Co-Creation through the Lens of News Headline Generation Zijian Ding Alison Smith-Renner Wenjuan Zhang Joel R. Tetreault Alejandro Jaimes 19 23 0 16 Oct 2023
An Information Bottleneck Characterization of the Understanding-Workload Tradeoff Lindsay M. Sanneman Mycal Tucker Julie A. Shah 24 2 0 11 Oct 2023
To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processing Sireesh Gururaja Amanda Bertsch Clara Na D. Widder Emma Strubell 19 3 0 11 Oct 2023
Co-audit: tools to help humans double-check AI-generated content Andrew D. Gordon Carina Negreanu J. Cambronero Rasika Chakravarthy Ian Drosos ... Hannah Richardson Advait Sarkar Stephanie Simmons Jack Williams Ben Zorn 25 12 0 02 Oct 2023
Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models Mert Yuksekgonul Varun Chandrasekaran Erik Jones Suriya Gunasekar Ranjita Naik Hamid Palangi Ece Kamar Besmira Nushi HILM 13 39 0 26 Sep 2023
"It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agents Zhiping Zhang Michelle Jia Hao-Ping Lee Bingsheng Yao Sauvik Das Ada Lerner Dakuo Wang Tianshi Li SILM ELM 14 69 0 20 Sep 2023
Towards Lightweight Data Integration using Multi-workflow Provenance and Data Observability Renan Souza Tyler J. Skluzacek Sean R. Wilkinson M. Ziatdinov Rafael Ferreira da Silva AI4CE 12 6 0 17 Aug 2023
A Framework for Designing Fair Ubiquitous Computing Systems Han Zhang Leijie Wang Yilun Sheng Xuhai Xu Jennifer Mankoff A. Dey 33 9 0 17 Aug 2023
Uncertainty in Natural Language Generation: From Theory to Applications Joris Baan Nico Daheim Evgenia Ilia Dennis Ulmer Haau-Sing Li Raquel Fernández Barbara Plank Rico Sennrich Chrysoula Zerva Wilker Aziz UQLM 17 40 0 28 Jul 2023
Interactive Explanation with Varying Level of Details in an Explainable Scientific Literature Recommender System Mouadh Guesmi Mohamed Amine Chatti Shoeb Joarder Qurat Ul Ain R. Alatrash Clara Siepmann Tannaz Vahidi 11 9 0 09 Jun 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 230 2,989 0 22 Mar 2023
Competence-Based Analysis of Language Models Adam Davies Jize Jiang Chengxiang Zhai ELM 21 4 0 01 Mar 2023
BiasTestGPT: Using ChatGPT for Social Bias Testing of Language Models Rafal Kocielnik Shrimai Prabhumoye Vivian Zhang Roy Jiang R. Alvarez Anima Anandkumar 30 6 0 14 Feb 2023
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey Sachin Kumar Vidhisha Balachandran Lucille Njoo Antonios Anastasopoulos Yulia Tsvetkov ELM 61 85 0 14 Oct 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 104 107 0 22 Sep 2022
Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned Deep Ganguli Liane Lovitt John Kernion Amanda Askell Yuntao Bai ... Nicholas Joseph Sam McCandlish C. Olah Jared Kaplan Jack Clark 218 441 0 23 Aug 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 303 11,881 0 04 Mar 2022
The Effects of System Initiative during Conversational Collaborative Search Sandeep Avula Bogeum Choi Jaime Arguello 21 21 0 20 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,402 0 28 Jan 2022
What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research Markus Langer Daniel Oster Timo Speith Holger Hermanns Lena Kästner Eva Schmidt Andreas Sesing Kevin Baum XAI 43 415 0 15 Feb 2021
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 275 1,311 0 17 Jan 2021
Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI Alon Jacovi Ana Marasović Tim Miller Yoav Goldberg 241 422 0 15 Oct 2020
Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models Cheolhyoung Lee Kyunghyun Cho Wanmo Kang MoE 235 205 0 25 Sep 2019