How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation

2 February 2018

Finale Doshi-Velez

Papers citing "How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation"

50 / 105 papers shown

Title
VirtualXAI: A User-Centric Framework for Explainability Assessment Leveraging GPT-Generated Personas Georgios Makridis Vasileios Koukos G. Fatouros D. Kyriazis 77 1 0 06 Mar 2025
Towards Human-centered Design of Explainable Artificial Intelligence (XAI): A Survey of Empirical Studies Shuai Ma 29 0 0 28 Oct 2024
Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsing Daking Rai Rydia R. Weiland Kayla Margaret Gabriella Herrera Tyler H. Shaw Ziyu Yao 35 1 0 05 Oct 2024
Are Logistic Models Really Interpretable? Danial Dervovic Freddy Lecue Nicolas Marchesotti Daniele Magazzeni 29 0 0 19 Jun 2024
Incremental XAI: Memorable Understanding of AI with Incremental Explanations Jessica Y. Bo Pan Hao Brian Y Lim CLL 31 6 0 10 Apr 2024
How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Survey Thu Nguyen Alessandro Canossa Jichen Zhu 35 3 0 21 Mar 2024
What Does Evaluation of Explainable Artificial Intelligence Actually Tell Us? A Case for Compositional and Contextual Validation of XAI Building Blocks Kacper Sokol Julia E. Vogt 37 11 0 19 Mar 2024
Gradient based Feature Attribution in Explainable AI: A Technical Review Yongjie Wang Tong Zhang Xu Guo Zhiqi Shen XAI 21 18 0 15 Mar 2024
Properties and Challenges of LLM-Generated Explanations Jenny Kunz Marco Kuhlmann 30 19 0 16 Feb 2024
Physician Detection of Clinical Harm in Machine Translation: Quality Estimation Aids in Reliance and Backtranslation Identifies Critical Errors Nikita Mehandru Sweta Agrawal Yimin Xiao Elaine C. Khoong Ge Gao Marine Carpuat Niloufar Salehi 24 10 0 25 Oct 2023
On the Interpretability of Part-Prototype Based Classifiers: A Human Centric Analysis Omid Davoodi Shayan Mohammadizadehsamakosh Majid Komeili 10 11 0 10 Oct 2023
Evaluation of Human-Understandability of Global Model Explanations using Decision Tree Adarsa Sivaprasad Ehud Reiter N. Tintarev Nir Oren FAtt 18 4 0 18 Sep 2023
Good-looking but Lacking Faithfulness: Understanding Local Explanation Methods through Trend-based Testing Jinwen He Kai Chen Guozhu Meng Jiangshan Zhang Congyi Li FAtt AAML 35 2 0 09 Sep 2023
Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanations Yanda Chen Ruiqi Zhong Narutatsu Ri Chen Zhao He He Jacob Steinhardt Zhou Yu Kathleen McKeown LRM 26 47 0 17 Jul 2023
Information Fusion via Symbolic Regression: A Tutorial in the Context of Human Health J. J. Schnur Nitesh V. Chawla 24 5 0 31 May 2023
Multi-Abstractive Neural Controller: An Efficient Hierarchical Control Architecture for Interactive Driving Xiao Li Igor Gilitschenski Guy Rosman S. Karaman Daniela Rus 16 0 0 24 May 2023
Explainability in AI Policies: A Critical Review of Communications, Reports, Regulations, and Standards in the EU, US, and UK L. Nannini Agathe Balayn A. Smith 21 37 0 20 Apr 2023
Explaining Groups of Instances Counterfactually for XAI: A Use Case, Algorithm and User Study for Group-Counterfactuals Greta Warren Markt. Keane Christophe Guéret Eoin Delaney 26 13 0 16 Mar 2023
Helpful, Misleading or Confusing: How Humans Perceive Fundamental Building Blocks of Artificial Intelligence Explanations E. Small Yueqing Xuan Danula Hettiachchi Kacper Sokol 23 10 0 02 Mar 2023
The Generalizability of Explanations Hanxiao Tan FAtt 18 1 0 23 Feb 2023
Invisible Users: Uncovering End-Users' Requirements for Explainable AI via Explanation Forms and Goals Weina Jin Jianyu Fan D. Gromala Philippe Pasquier Ghassan Hamarneh 28 7 0 10 Feb 2023
Selective Explanations: Leveraging Human Input to Align Explainable AI Vivian Lai Yiming Zhang Chacha Chen Q. V. Liao Chenhao Tan 23 43 0 23 Jan 2023
Explanations Can Reduce Overreliance on AI Systems During Decision-Making Helena Vasconcelos Matthew Jörke Madeleine Grunde-McLaughlin Tobias Gerstenberg Michael S. Bernstein Ranjay Krishna 29 164 0 13 Dec 2022
What Makes a Good Explanation?: A Harmonized View of Properties of Explanations Zixi Chen Varshini Subhash Marton Havasi Weiwei Pan Finale Doshi-Velez XAI FAtt 33 18 0 10 Nov 2022
Trustworthy Human Computation: A Survey H. Kashima S. Oyama Hiromi Arai Junichiro Mori 27 0 0 22 Oct 2022
Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanations Yao Rong Tobias Leemann Thai-trang Nguyen Lisa Fiedler Peizhu Qian Vaibhav Unhelkar Tina Seidel Gjergji Kasneci Enkelejda Kasneci ELM 36 92 0 20 Oct 2022
The Influence of Explainable Artificial Intelligence: Nudging Behaviour or Boosting Capability? Matija Franklin TDI 23 1 0 05 Oct 2022
Towards Human-Compatible XAI: Explaining Data Differentials with Concept Induction over Background Knowledge Cara L. Widmer Md Kamruzzaman Sarker Srikanth Nadella Joshua L. Fiechter I. Juvina B. Minnery Pascal Hitzler Joshua Schwartz M. Raymer 32 7 0 27 Sep 2022
Explanations, Fairness, and Appropriate Reliance in Human-AI Decision-Making Jakob Schoeffer Maria De-Arteaga Niklas Kuehl FaML 45 46 0 23 Sep 2022
Computing Abductive Explanations for Boosted Trees Gilles Audemard Jean-Marie Lagniez Pierre Marquis N. Szczepanski 26 12 0 16 Sep 2022
Transcending XAI Algorithm Boundaries through End-User-Inspired Design Weina Jin Jianyu Fan D. Gromala Philippe Pasquier Xiaoxiao Li Ghassan Hamarneh 23 3 0 18 Aug 2022
Comparing Baseline Shapley and Integrated Gradients for Local Explanation: Some Additional Insights Tianshu Feng Zhipu Zhou Tarun Joshi V. Nair FAtt 20 4 0 12 Aug 2022
Leveraging Explanations in Interactive Machine Learning: An Overview Stefano Teso Öznur Alkan Wolfgang Stammer Elizabeth M. Daly XAI FAtt LRM 26 62 0 29 Jul 2022
The Manifold Hypothesis for Gradient-Based Explanations Sebastian Bordt Uddeshya Upadhyay Zeynep Akata U. V. Luxburg FAtt AAML 25 12 0 15 Jun 2022
A Psychological Theory of Explainability Scott Cheng-Hsin Yang Tomas Folke Patrick Shafto XAI FAtt 49 16 0 17 May 2022
Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanations Jessica Dai Sohini Upadhyay Ulrich Aïvodji Stephen H. Bach Himabindu Lakkaraju 40 56 0 15 May 2022
Can counterfactual explanations of AI systems' predictions skew lay users' causal intuitions about the world? If so, can we correct for that? Marko Tešić U. Hahn CML 17 5 0 12 May 2022
Let's Go to the Alien Zoo: Introducing an Experimental Framework to Study Usability of Counterfactual Explanations for Machine Learning Ulrike Kuhl André Artelt Barbara Hammer 35 17 0 06 May 2022
Missingness Bias in Model Debugging Saachi Jain Hadi Salman E. Wong Pengchuan Zhang Vibhav Vineet Sai H. Vemprala A. Madry 27 37 0 19 Apr 2022
Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions Alicia Parrish H. Trivedi Ethan Perez Angelica Chen Nikita Nangia Jason Phang Sam Bowman 17 14 0 11 Apr 2022
The Impact of Explanations on Layperson Trust in Artificial Intelligence-Driven Symptom Checker Apps: Experimental Study Claire Woodcock Brent Mittelstadt Dan Busbridge Grant Blank 12 26 0 27 Feb 2022
The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspective Satyapriya Krishna Tessa Han Alex Gu Steven Wu S. Jabbari Himabindu Lakkaraju 177 186 0 03 Feb 2022
From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI Meike Nauta Jan Trienes Shreyasi Pathak Elisa Nguyen Michelle Peters Yasmin Schmitt Jorg Schlotterer M. V. Keulen C. Seifert ELM XAI 28 396 0 20 Jan 2022
Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies Vivian Lai Chacha Chen Q. V. Liao Alison Smith-Renner Chenhao Tan 27 186 0 21 Dec 2021
On Two XAI Cultures: A Case Study of Non-technical Explanations in Deployed AI System Helen Jiang Erwen Senge 25 7 0 02 Dec 2021
Teaching Humans When To Defer to a Classifier via Exemplars Hussein Mozannar Arvindmani Satyanarayan David Sontag 33 43 0 22 Nov 2021
Improving Users' Mental Model with Attention-directed Counterfactual Edits Kamran Alipour Arijit Ray Xiaoyu Lin Michael Cogswell J. Schulze Yi Yao Giedrius Burachas OOD 22 9 0 13 Oct 2021
Cross-Model Consensus of Explanations and Beyond for Image Classification Models: An Empirical Study Xuhong Li Haoyi Xiong Siyu Huang Shilei Ji Dejing Dou 14 10 0 02 Sep 2021
Cases for Explainable Software Systems:Characteristics and Examples Mersedeh Sadeghi V. Klös Andreas Vogelsang 11 16 0 12 Aug 2021
On the Interaction of Belief Bias and Explanations Ana Valeria González Anna Rogers Anders Søgaard FAtt 20 19 0 29 Jun 2021