A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification

28 November 2022

Papers citing "A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification"

31 / 31 papers shown

Title
TrustLoRA: Low-Rank Adaptation for Failure Detection under Out-of-distribution Data Fei Zhu Zhaoxiang Zhang OODD UQCV 60 0 0 20 Apr 2025
Interpretable Failure Detection with Human-Level Concepts Kien X. Nguyen Tang Li Xi Peng 48 0 0 07 Feb 2025
Typicalness-Aware Learning for Failure Detection Yijun Liu Jiequan Cui Zhuotao Tian Senqiao Yang Qingdong He Xiaoling Wang Jingyong Su AAML 28 0 0 04 Nov 2024
Why context matters in VQA and Reasoning: Semantic interventions for VLM input modalities Kenza Amara Lukas Klein Carsten T. Lüth Paul Jäger Hendrik Strobelt Mennatallah El-Assady 25 1 0 02 Oct 2024
Deep Learning based Visually Rich Document Content Understanding: A Survey Muhammad Ali Jean Lee Salman Khan 29 6 0 02 Aug 2024
Are We Ready for Out-of-Distribution Detection in Digital Pathology? Ji-Hun Oh Kianoush Falahkheirkhah Rohit Bhargava OODD 34 2 0 18 Jul 2024
Overcoming Common Flaws in the Evaluation of Selective Classification Systems Jeremias Traub Till J. Bungert Carsten T. Lüth Michael Baumgartner Klaus H. Maier-Hein Lena Maier-Hein Paul F. Jaeger 34 3 0 01 Jul 2024
A Rate-Distortion View of Uncertainty Quantification Ifigeneia Apostolopoulou Benjamin Eysenbach Frank Nielsen Artur Dubrawski UQCV 31 2 0 16 Jun 2024
DistilDoc: Knowledge Distillation for Visually-Rich Document Applications Jordy Van Landeghem Subhajit Maity Ayan Banerjee Matthew Blaschko Marie-Francine Moens Josep Lladós Sanket Biswas 41 2 0 12 Jun 2024
Comparative Benchmarking of Failure Detection Methods in Medical Image Segmentation: Unveiling the Role of Confidence Aggregation M. Zenk David Zimmerer Fabian Isensee Jeremias Traub T. Norajitra Paul F. Jäger Klaus H. Maier-Hein 24 4 0 05 Jun 2024
Rejection via Learning Density Ratios Alexander Soen Hisham Husain Philip Schulz Vu-Linh Nguyen 39 2 0 29 May 2024
A noisy elephant in the room: Is your out-of-distribution detector robust to label noise? Galadrielle Humblot-Renaux Sergio Escalera T. Moeslund OODD UQCV NoLa 27 5 0 02 Apr 2024
ValUES: A Framework for Systematic Validation of Uncertainty Estimation in Semantic Segmentation Kim-Celine Kahl Carsten T. Lüth M. Zenk Klaus Maier-Hein Paul F. Jaeger UQCV 17 16 0 16 Jan 2024
An Ambiguity Measure for Recognizing the Unknowns in Deep Learning Roozbeh Yousefzadeh AAML UQCV 23 0 0 11 Dec 2023
Unified Classification and Rejection: A One-versus-All Framework Zhen Cheng Xu-Yao Zhang Cheng-Lin Liu 49 7 0 22 Nov 2023
ImageNet-OOD: Deciphering Modern Out-of-Distribution Detection Algorithms William Yang Byron Zhang Olga Russakovsky OODD 30 11 0 03 Oct 2023
Jointly Exploring Client Drift and Catastrophic Forgetting in Dynamic Learning Niklas Babendererde Moritz Fuchs Camila González Yuri Tolkach Anirban Mukhopadhyay OOD FedML 13 2 0 01 Sep 2023
Beyond Document Page Classification: Design, Datasets, and Challenges Jordy Van Landeghem Sanket Biswas Matthew B. Blaschko Marie-Francine Moens 27 6 0 24 Aug 2023
Understanding Silent Failures in Medical Image Classification Till J. Bungert L. Kobelke Paul F. Jaeger UQCV 17 4 0 27 Jul 2023
Conservative Prediction via Data-Driven Confidence Minimization Caroline Choi Fahim Tajwar Yoonho Lee Huaxiu Yao Ananya Kumar Chelsea Finn 23 5 0 08 Jun 2023
Document Understanding Dataset and Evaluation (DUDE) Jordy Van Landeghem Rubèn Pérez Tito Łukasz Borchmann Michal Pietruszka Pawel Józiak ... Bertrand Ackaert Ernest Valveny Matthew Blaschko Sien Moens Tomasz Stanislawek VGen 14 52 0 15 May 2023
Great Models Think Alike: Improving Model Reliability via Inter-Model Latent Agreement Ailin Deng Miao Xiong Bryan Hooi 22 6 0 02 May 2023
OpenMix: Exploring Outlier Samples for Misclassification Detection Fei Zhu Zhen Cheng Xu-Yao Zhang Cheng-Lin Liu UQCV 22 32 0 30 Mar 2023
Window-Based Early-Exit Cascades for Uncertainty Estimation: When Deep Ensembles are More Efficient than Single Models Guoxuan Xia C. Bouganis UQCV 50 12 0 14 Mar 2023
Navigating the Pitfalls of Active Learning Evaluation: A Systematic Framework for Meaningful Performance Assessment Carsten T. Lüth Till J. Bungert Lukas Klein Paul F. Jaeger 8 10 0 25 Jan 2023
Benchmarking common uncertainty estimation methods with histopathological images under domain shift and label noise H. A. Mehrtens Alexander Kurz Tabea-Clara Bucher T. Brinker OOD UQCV 187 11 0 03 Jan 2023
Metrics reloaded: Recommendations for image analysis validation Lena Maier-Hein Annika Reinke Patrick Godau M. Tizabi Florian Buettner ... Aleksei Tiulpin Sotirios A. Tsaftaris Ben Van Calster Gaël Varoquaux Paul F. Jäger 8 212 0 03 Jun 2022
A Fine-Grained Analysis on Distribution Shift Olivia Wiles Sven Gowal Florian Stimberg Sylvestre-Alvise Rebuffi Ira Ktena Krishnamurthy Dvijotham A. Cemgil OOD 215 201 0 21 Oct 2021
Open-Set Recognition: a Good Closed-Set Classifier is All You Need? S. Vaze Kai Han Andrea Vedaldi Andrew Zisserman BDL 167 404 0 12 Oct 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 268 5,652 0 05 Dec 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 247 9,109 0 06 Jun 2015