Towards Structured Evaluation of Deep Neural Network Supervisors

v1v2 (latest)

Towards Structured Evaluation of Deep Neural Network Supervisors

4 March 2019

Jens Henriksson

Cristofer Englund

S. Sathyamoorthy

ArXiv (abs)PDF HTML

Papers citing "Towards Structured Evaluation of Deep Neural Network Supervisors"

13 / 13 papers shown

Title
Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification Ruben Grewal Paolo Tonella Andrea Stocco 131 13 0 29 Apr 2024
Uncertainty Quantification for Deep Neural Networks: An Empirical Comparison and Usage Guidelines Michael Weiss Paolo Tonella BDL UQCV 76 11 0 14 Dec 2022
CheapET-3: Cost-Efficient Use of Remote DNN Models Michael Weiss 60 1 0 24 Aug 2022
Generating and Detecting True Ambiguity: A Forgotten Danger in DNN Supervision Testing Michael Weiss A. Gómez Paolo Tonella AAML 62 6 0 21 Jul 2022
AEON: A Method for Automatic Evaluation of NLP Test Cases Jen-tse Huang Jianping Zhang Wenxuan Wang Pinjia He Yuxin Su Michael R. Lyu 83 23 0 13 May 2022
Ergo, SMIRK is Safe: A Safety Case for a Machine Learning Component in a Pedestrian Automatic Emergency Brake System Markus Borg Jens Henriksson Kasper Socha Olof Lennartsson Elias Sonnsjo Lonegren T. Bui Piotr Tomaszewski S. Sathyamoorthy Sebastian Brink M. H. Moghadam 84 25 0 16 Apr 2022
Evaluation of Runtime Monitoring for UAV Emergency Landing Joris Guérin Kevin Delmas Jérémie Guiochet 63 13 0 07 Feb 2022
DeepGuard: A Framework for Safeguarding Autonomous Driving Systems from Inconsistent Behavior Manzoor Hussain Nazakat Ali Jang-Eui Hong AAML 52 40 0 18 Nov 2021
Benchmarking Safety Monitors for Image Classifiers with Machine Learning Raul Sena Ferreira J. Arlat Jérémie Guiochet H. Waeselynck 87 26 0 04 Oct 2021
How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review Florian Tambon Gabriel Laberge Le An Amin Nikanjam Paulina Stevia Nouwou Mindom Y. Pequignot Foutse Khomh G. Antoniol E. Merlo François Laviolette 113 70 0 26 Jul 2021
Performance Analysis of Out-of-Distribution Detection on Various Trained Neural Networks Jens Henriksson C. Berger Markus Borg Lars Tornberg S. Sathyamoorthy Cristofer Englund OODD 86 17 0 29 Mar 2021
Fail-Safe Execution of Deep Learning based Systems through Uncertainty Monitoring Michael Weiss Paolo Tonella AAML 123 30 0 01 Feb 2021
Structure-Invariant Testing for Machine Translation Pinjia He Clara Meister Z. Su 75 106 0 19 Jul 2019