Towards Accountable AI: Hybrid Human-Machine Analyses for Characterizing System Failure

19 September 2018

Papers citing "Towards Accountable AI: Hybrid Human-Machine Analyses for Characterizing System Failure"

34 / 34 papers shown

Title
StarFT: Robust Fine-tuning of Zero-shot Models via Spuriosity Alignment Younghyun Kim Jongheon Jeong Sangkyung Kwak Kyungmin Lee Juho Lee Jinwoo Shin 63 0 0 19 May 2025
Predictable Artificial Intelligence Lexin Zhou Pablo Antonio Moreno Casares Fernando Martínez-Plumed John Burden Ryan Burnell ... Seán Ó hÉigeartaigh Danaja Rutar Wout Schellaert Konstantinos Voudouris José Hernández-Orallo 146 3 0 08 Jan 2025
A Multimodal Automated Interpretability Agent Tamar Rott Shaham Sarah Schwettmann Franklin Wang Achyuta Rajaram Evan Hernandez Jacob Andreas Antonio Torralba 219 27 0 22 Apr 2024
Efficient Failure Pattern Identification of Predictive Algorithms Bao Nguyen Viet Anh Nguyen 62 0 0 01 Jun 2023
Improving Human-AI Collaboration With Descriptions of AI Behavior Ángel Alexander Cabrera Adam Perer Jason I. Hong 84 40 0 06 Jan 2023
Data-Centric Debugging: mitigating model failures via targeted data collection Sahil Singla Atoosa Malemir Chegini Mazda Moayeri Soheil Feiz 94 4 0 17 Nov 2022
A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges Yunpeng Qing Shunyu Liu Mingli Song Huiqiong Wang Mingli Song XAI 81 1 0 12 Nov 2022
Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice Wesley Hanwen Deng B. Guo Alicia DeVrio Hong Shen Motahhare Eslami Kenneth Holstein MLAU 106 65 0 07 Oct 2022
Beyond Value: CHECKLIST for Testing Inferences in Planning-Based RL Kin-Ho Lam Delyar Tabatabai Jed Irvine Donald Bertucci Anita Ruangrotsakun Minsuk Kahng Alan Fern OffRL 56 1 0 04 Jun 2022
ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCO Sanghyuk Chun Wonjae Kim Song Park Minsuk Chang Seong Joon Oh VLM 545 46 0 07 Apr 2022
Core Risk Minimization using Salient ImageNet Sahil Singla Mazda Moayeri Soheil Feizi 88 14 0 28 Mar 2022
A Mental-Model Centric Landscape of Human-AI Symbiosis Z. Zahedi S. Sreedharan Subbarao Kambhampati 56 4 0 18 Feb 2022
Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignment Yuyang Gao Tong Sun Liang Zhao Sungsoo Ray Hong HAI 86 38 0 06 Feb 2022
Salient ImageNet: How to discover spurious features in Deep Learning? Sahil Singla Soheil Feizi AAML VLM 105 120 0 08 Oct 2021
Discovering and Validating AI Errors With Crowdsourced Failure Reports Ángel Alexander Cabrera Abraham J. Druck Jason I. Hong Adam Perer HAI 109 57 0 23 Sep 2021
A Survey of Human-in-the-loop for Machine Learning Xingjiao Wu Luwei Xiao Yixuan Sun Junhang Zhang Tianlong Ma Liangbo He SyDa 137 532 0 02 Aug 2021
When and Why does a Model Fail? A Human-in-the-loop Error Detection Framework for Sentiment Analysis Zhe Liu Yufan Guo J. Mahmud 77 10 0 02 Jun 2021
Software Engineering for AI-Based Systems: A Survey Silverio Martínez-Fernández Justus Bogner Xavier Franch Marc Oriol Julien Siebert Adam Trendowicz Anna Maria Vollmer Stefan Wagner 112 232 0 05 May 2021
Revisiting Citizen Science Through the Lens of Hybrid Intelligence J. Rafner M. Gajdacz Gitte Kragh A. Hjorth A. Gander ... J. Miller Dominik Dellerman M. Haklay Pietro Michelucci J. Sherson 65 13 0 30 Apr 2021
Understanding and Avoiding AI Failures: A Practical Guide R. M. Williams Roman V. Yampolskiy 89 25 0 22 Apr 2021
To Trust or Not to Trust a Regressor: Estimating and Explaining Trustworthiness of Regression Predictions K. D. Bie Ana Lucic H. Haned FAtt 53 11 0 14 Apr 2021
Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs Solon Barocas Anhong Guo Ece Kamar J. Krones Meredith Ringel Morris Jennifer Wortman Vaughan Duncan Wadsworth Hanna M. Wallach 80 79 0 10 Mar 2021
i-Algebra: Towards Interactive Interpretability of Deep Neural Networks Xinyang Zhang Ren Pang S. Ji Fenglong Ma Ting Wang HAI AI4CE 38 5 0 22 Jan 2021
A Software Engineering Perspective on Engineering Machine Learning Systems: State of the Art and Challenges G. Giray 90 133 0 14 Dec 2020
Understanding Failures of Deep Networks via Robust Feature Extraction Sahil Singla Besmira Nushi S. Shah Ece Kamar Eric Horvitz FAtt 86 84 0 03 Dec 2020
An Empirical Analysis of Backward Compatibility in Machine Learning Systems Megha Srivastava Besmira Nushi Ece Kamar S. Shah Eric Horvitz AAML 99 47 0 11 Aug 2020
Toward Fairness in AI for People with Disabilities: A Research Roadmap Anhong Guo Ece Kamar Jennifer Wortman Vaughan Hanna M. Wallach Meredith Ringel Morris 92 117 0 04 Jul 2019
Predicting Model Failure using Saliency Maps in Autonomous Driving Systems Sina Mohseni Akshay V. Jagadeesh Zhangyang Wang 78 14 0 19 May 2019
What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use S. Tonekaboni Shalmali Joshi M. Mccradden Anna Goldenberg 97 401 0 13 May 2019
The role of artificial intelligence in achieving the Sustainable Development Goals Ricardo Vinuesa Hossein Azizpour Iolanda Leite Madeline Balaam Virginia Dignum S. Domisch Anna Felländer S. Langhans Max Tegmark F. F. Nerini 77 1,520 0 30 Apr 2019
HARK Side of Deep Learning -- From Grad Student Descent to Automated Machine Learning O. Gencoglu M. Gils E. Guldogan Chamin Morikawa Mehmet Süzen M. Gruber J. Leinonen H. Huttunen 105 36 0 16 Apr 2019
Can You Trust This Prediction? Auditing Pointwise Reliability After Learning Peter F. Schulam Suchi Saria OOD 101 104 0 02 Jan 2019
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems Sina Mohseni Niloofar Zarei Eric D. Ragan 122 102 0 28 Nov 2018
Investigating Human + Machine Complementarity for Recidivism Predictions S. Tan Julius Adebayo K. Quinn Ece Kamar FaML 69 54 0 28 Aug 2018