Taxonomy of Real Faults in Deep Learning Systems

24 October 2019

Gabriele Bavota

Paolo Tonella

Papers citing "Taxonomy of Real Faults in Deep Learning Systems"

50 / 66 papers shown

Title
Safe Automated Refactoring for Efficient Migration of Imperative Deep Learning Programs to Graph Execution Raffi Khatchadourian Tatiana Castro Vélez M. Bagherzadeh Nan Jia A. Raja 34 0 0 07 Apr 2025
Automated Factual Benchmarking for In-Car Conversational Systems using Large Language Models Rafael Giebisch Ken E. Friedl Lev Sorokin Andrea Stocco HILM 55 0 0 01 Apr 2025
DANDI: Diffusion as Normative Distribution for Deep Neural Network Input Somin Kim Shin Yoo 55 0 0 05 Feb 2025
Benchmarking Generative AI Models for Deep Learning Test Input Generation Maryam Matteo Biagiola Andrea Stocco Vincenzo Riccio VLM 43 3 0 23 Dec 2024
An Empirical Study of Fault Localisation Techniques for Deep Learning Nargiz Humbatova Jinhan Kim Gunel Jahangirova S. Yoo Paolo Tonella 72 0 0 15 Dec 2024
Urban Computing for Climate and Environmental Justice: Early Perspectives From Two Research Initiatives Carolina Veiga Ashish Sharma Daniel de Oliveira Marcos Lage Fabio Miranda AI4CE 39 0 0 06 Oct 2024
Demystifying Issues, Causes and Solutions in LLM Open-Source Projects Yangxiao Cai Peng Liang Yifei Wang Zengyang Li Mojtaba Shahin 45 2 0 25 Sep 2024
Studying the Impact of TensorFlow and PyTorch Bindings on Machine Learning Software Quality Hao Li Gopi Krishnan Rajbahadur C. Bezemer 39 5 0 07 Jul 2024
A Survey on Failure Analysis and Fault Injection in AI Systems Guangba Yu Gou Tan Haojia Huang Zhenyu Zhang Pengfei Chen Roberto Natella Zibin Zheng 39 4 0 28 Jun 2024
Automated Repair of AI Code with Large Language Models and Formal Verification Yiannis Charalambous Edoardo Manino Lucas C. Cordeiro 27 2 0 14 May 2024
Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification Ruben Grewal Paolo Tonella Andrea Stocco 48 12 0 29 Apr 2024
Unraveling Code Clone Dynamics in Deep Learning Frameworks Maram Assi Safwat Hassan Ying Zou 33 3 0 25 Apr 2024
ROBUST: 221 Bugs in the Robot Operating System C. Timperley G. V. D. Hoorn André Santos Harshavardhan Deshpande Andrzej Wasowski 23 4 0 04 Apr 2024
Bugs in Large Language Models Generated Code: An Empirical Study Florian Tambon Arghavan Moradi Dakhel Amin Nikanjam Foutse Khomh Michel C. Desmarais G. Antoniol ELM 42 34 0 13 Mar 2024
Beyond Accuracy: An Empirical Study on Unit Testing in Open-source Deep Learning Projects Han Wang Sijia Yu Chunyang Chen Burak Turhan Xiaodong Zhu ELM MLAU 25 2 0 26 Feb 2024
Towards Enhancing the Reproducibility of Deep Learning Bugs: An Empirical Study Mehil B. Shah Mohammad Masudur Rahman Foutse Khomh 33 5 0 05 Jan 2024
Mutation-based Fault Localization of Deep Neural Networks Ali Ghanbari Deepak-George Thomas Muhammad Arbab Arshad Hridesh Rajan 13 13 0 10 Sep 2023
NeuroCodeBench: a plain C neural network benchmark for software verification Edoardo Manino R. Menezes F. Shmarov Lucas C. Cordeiro 18 3 0 07 Sep 2023
Bug Characterization in Machine Learning-based Systems Mohammad Mehdi Morovati Amin Nikanjam Florian Tambon Foutse Khomh Zhen Ming Z. Jiang 31 20 0 26 Jul 2023
What Kinds of Contracts Do ML APIs Need? S. K. Samantha Shibbir Ahmed S. Imtiaz Hridesh Rajan G. Leavens 11 3 0 26 Jul 2023
An Empirical Study on Bugs Inside PyTorch: A Replication Study Sharon Chee Yin Ho Vahid Majdinasab Mohayeminul Islam D. Costa Emad Shihab Foutse Khomh Sarah Nadi Muhammad Raza 12 6 0 25 Jul 2023
Semantic-Based Neural Network Repair Richard Schumi Jun Sun AAML KELM 6 4 0 12 Jun 2023
DeltaNN: Assessing the Impact of Computational Environment Parameters on the Performance of Image Recognition Models Nikolaos Louloudakis Perry Gibson José Cano A. Rajan 17 8 0 05 Jun 2023
Testing of Deep Reinforcement Learning Agents with Surrogate Models Matteo Biagiola Paolo Tonella 44 19 0 22 May 2023
What Causes Exceptions in Machine Learning Applications? Mining Machine Learning-Related Stack Traces on Stack Overflow Amin Ghadesi Maxime Lamothe Heng Li 24 1 0 25 Apr 2023
Challenges and Practices of Deep Learning Model Reengineering: A Case Study on Computer Vision Wenxin Jiang Vishnu Banna Naveen Vivek Abhinav Goel Nicholas Synovic George K. Thiruvathukal James C. Davis VLM 40 18 0 13 Mar 2023
Reliability Assurance for Deep Neural Network Architectures Against Numerical Defects Linyi Li Yuhao Zhang Luyao Ren Yingfei Xiong Tao Xie 35 7 0 13 Feb 2023
An investigation of challenges encountered when specifying training data and runtime monitors for safety critical ML applications Hans-Martin Heyn E. Knauss Iswarya Malleswaran Shruthi Dinakaran 32 4 0 31 Jan 2023
Mutation Testing of Deep Reinforcement Learning Based on Real Faults Florian Tambon Vahid Majdinasab Amin Nikanjam Foutse Khomh G. Antoniol 36 7 0 13 Jan 2023
When and Why Test Generators for Deep Learning Produce Invalid Inputs: an Empirical Study Vincenzo Riccio Paolo Tonella AAML 24 29 0 21 Dec 2022
Exploring Effects of Computational Parameter Changes to Image Recognition Systems Nikolaos Louloudakis Perry Gibson José Cano A. Rajan 19 6 0 01 Nov 2022
Statistical Modeling of Soft Error Influence on Neural Networks Haitong Huang Xing-xiong Xue Cheng Liu Ying Wang Tao Luo Long Cheng Huawei Li Xiaowei Li 29 7 0 12 Oct 2022
Requirements Engineering for Machine Learning: A Review and Reflection Zhong Pei Lin Liu Chen Wang Jianmin Wang VLM 42 22 0 03 Oct 2022
IvySyn: Automated Vulnerability Discovery in Deep Learning Frameworks Neophytos Christou Di Jin Vaggelis Atlidakis Baishakhi Ray V. Kemerlis 29 13 0 29 Sep 2022
Comparative analysis of real bugs in open-source Machine Learning projects -- A Registered Report Tuan Dung Lai Anj Simmons Scott Barnett Jean-Guy Schneider Rajesh Vasa 14 1 0 20 Sep 2022
Towards Top-Down Automated Development in Limited Scopes: A Neuro-Symbolic Framework from Expressibles to Executables Jian Gu H. Gall 32 0 0 04 Sep 2022
Quality issues in Machine Learning Software Systems Pierre-Olivier Coté Amin Nikanjam Rached Bouchoucha Foutse Khomh 25 6 0 18 Aug 2022
Generating and Detecting True Ambiguity: A Forgotten Danger in DNN Supervision Testing Michael Weiss A. Gómez Paolo Tonella AAML 18 6 0 21 Jul 2022
Bugs in Machine Learning-based Systems: A Faultload Benchmark Mohammad Mehdi Morovati Amin Nikanjam Foutse Khomh Zhen Ming Z. Jiang 32 20 0 24 Jun 2022
DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs Jialun Cao Meiziniu Li Xiao Chen Ming Wen Yongqiang Tian Bo Wu Shing-Chi Cheung AAML 22 41 0 04 May 2022
Testing Feedforward Neural Networks Training Programs Houssem Ben Braiek Foutse Khomh AAML 13 14 0 01 Apr 2022
Code Smells for Machine Learning Applications Haiyin Zhang Luís Cruz A. van Deursen 23 26 0 25 Mar 2022
ExAIS: Executable AI Semantics Richard Schumi Jun Sun 14 6 0 20 Feb 2022
Challenges in Migrating Imperative Deep Learning Programs to Graph Execution: An Empirical Study Tatiana Castro Vélez Raffi Khatchadourian M. Bagherzadeh A. Raja 24 9 0 24 Jan 2022
Black-box Safety Analysis and Retraining of DNNs based on Feature Extraction and Clustering M. Attaoui Hazem M. Fahmy F. Pastore Lionel C. Briand AAML 24 21 0 13 Jan 2022
Security for Machine Learning-based Software Systems: a survey of threats, practices and challenges Huaming Chen Muhammad Ali Babar AAML 42 22 0 12 Jan 2022
Silent Bugs in Deep Learning Frameworks: An Empirical Study of Keras and TensorFlow Florian Tambon Amin Nikanjam Le An Foutse Khomh G. Antoniol 25 34 0 26 Dec 2021
Mind the Gap! A Study on the Transferability of Virtual vs Physical-world Testing of Autonomous Driving Systems Andrea Stocco Brian Pulfer Paolo Tonella 27 69 0 21 Dec 2021
Understanding Performance Problems in Deep Learning Systems Junming Cao Bihuan Chen Chao Sun Longjie Hu Shuai Wu Xin Peng 30 27 0 03 Dec 2021
Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Process Nadia Nahar Shurui Zhou Grace A. Lewis Christian Kastner VLM 47 127 0 19 Oct 2021