Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem

13 December 2018

Matthias Hein

Maksym Andriushchenko

Julian Bitterwolf

OODD

ArXiv PDF HTML

Papers citing "Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem"

50 / 349 papers shown

Title
Towards Improving Calibration in Object Detection Under Domain Shift Muhammad Akhtar Munir M. H. Khan M. Sarfraz Mohsen Ali 19 22 0 15 Sep 2022
Improving Out-of-Distribution Detection via Epistemic Uncertainty Adversarial Training Derek Everett A. Nguyen Luke E. Richards Edward Raff OODD 22 2 0 05 Sep 2022
A Principled Evaluation Protocol for Comparative Investigation of the Effectiveness of DNN Classification Models on Similar-but-non-identical Datasets Esla Timothy Anzaku Haohan Wang Arnout Van Messem W. D. Neve 33 2 0 05 Sep 2022
Probing Contextual Diversity for Dense Out-of-Distribution Detection Silvio Galesso M. A. Bravo Mehdi Naouar Thomas Brox 21 4 0 30 Aug 2022
Towards In-distribution Compatibility in Out-of-distribution Detection Boxi Wu Jie Jiang Haidong Ren Zifan Du Wenxiao Wang Zhifeng Li Deng Cai Xiaofei He Binbin Lin Wei Liu OODD 19 1 0 29 Aug 2022
Semi-Supervised and Unsupervised Deep Visual Learning: A Survey Yanbei Chen Massimiliano Mancini Xiatian Zhu Zeynep Akata 40 113 0 24 Aug 2022
Evaluating Out-of-Distribution Detectors Through Adversarial Generation of Outliers Sangwoong Yoon Jinwon Choi Yonghyeon Lee Yung-Kyun Noh Frank C. Park OODD 19 1 0 20 Aug 2022
Uncertainty-guided Source-free Domain Adaptation Subhankar Roy Martin Trapp Andrea Pilzer Juho Kannala N. Sebe Elisa Ricci Arno Solin EDL TTA UQLM UQCV 37 64 0 16 Aug 2022
Distance-based detection of out-of-distribution silent failures for Covid-19 lung lesion segmentation Jiamin Liang Yuhao Huang Haoming Li Shuangchi He Xindi Hu Zejian Chen Isabel Kaltenborn Dong Ni OOD 23 41 0 05 Aug 2022
Approximate Bayesian Neural Operators: Uncertainty Quantification for Parametric PDEs Emilia Magnani Nicholas Kramer Runa Eschenhagen Lorenzo Rosasco Philipp Hennig UQCV BDL 13 9 0 02 Aug 2022
Out-of-Distribution Detection with Semantic Mismatch under Masking Yijun Yang Ruiyuan Gao Qiang Xu OODD 14 27 0 31 Jul 2022
A Novel Data Augmentation Technique for Out-of-Distribution Sample Detection using Compounded Corruptions R. Hebbalaguppe Soumya Suvra Goshal Jatin Prakash H. Khadilkar Chetan Arora OODD 33 4 0 28 Jul 2022
Instance-Aware Observer Network for Out-of-Distribution Object Segmentation Victor Besnier Andrei Bursuc David Picard Alexandre Briot 39 1 0 18 Jul 2022
Distance Learner: Incorporating Manifold Prior to Model Training Aditya Chetan Nipun Kwatra 21 1 0 14 Jul 2022
Harnessing Out-Of-Distribution Examples via Augmenting Content and Style Zhuo Huang Xiaobo Xia Li Shen Bo Han Mingming Gong Chen Gong Tongliang Liu OODD 32 46 0 07 Jul 2022
Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition Haotao Wang Aston Zhang Yi Zhu Shuai Zheng Mu Li Alexander J. Smola Zhangyang Wang OODD 138 48 0 04 Jul 2022
SLOVA: Uncertainty Estimation Using Single Label One-Vs-All Classifier Bartosz Wójcik J. Grela Marek Śmieja Krzysztof Misztal Jacek Tabor UQCV 33 4 0 28 Jun 2022
WeShort: Out-of-distribution Detection With Weak Shortcut structure Jin-Siang Lin OODD 22 0 0 23 Jun 2022
Breaking Down Out-of-Distribution Detection: Many Methods Based on OOD Training Data Estimate a Combination of the Same Core Quantities Julian Bitterwolf Alexander Meinke Maximilian Augustin Matthias Hein OODD 15 25 0 20 Jun 2022
Supervision Adaptation Balancing In-distribution Generalization and Out-of-distribution Detection Zhilin Zhao LongBing Cao Kun-Yu Lin 19 4 0 19 Jun 2022
Open-Sampling: Exploring Out-of-Distribution data for Re-balancing Long-tailed datasets Hongxin Wei Lue Tao Renchunzi Xie Lei Feng Bo An OODD 28 37 0 17 Jun 2022
READ: Aggregating Reconstruction Error into Out-of-distribution Detection Wenyu Jiang Yuxin Ge Hao Cheng Mingcai Chen Shuai Feng Chongjun Wang OODD 24 10 0 15 Jun 2022
Confidence Score for Source-Free Unsupervised Domain Adaptation Jonghyun Lee Dahuin Jung Junho Yim Sung-Hoon Yoon TTA 13 70 0 14 Jun 2022
EnergyMatch: Energy-based Pseudo-Labeling for Semi-Supervised Learning Z. Yu Yin Li Yong Jae Lee 14 0 0 13 Jun 2022
Disentangling Epistemic and Aleatoric Uncertainty in Reinforcement Learning Bertrand Charpentier Ransalu Senanayake Mykel Kochenderfer Stephan Günnemann PER UD 45 24 0 03 Jun 2022
HYCEDIS: HYbrid Confidence Engine for Deep Document Intelligence System Bao-Sinh Nguyen Q. Tran Tuan-Anh Dang Nguyen D. Nguyen H. Le 24 0 0 01 Jun 2022
Exact Feature Collisions in Neural Networks Utku Ozbulak Manvel Gasparyan Shodhan Rao W. D. Neve Arnout Van Messem AAML 19 1 0 31 May 2022
How Useful are Gradients for OOD Detection Really? Conor Igoe Youngseog Chung I. Char J. Schneider OODD 45 23 0 20 May 2022
Posterior Refinement Improves Sample Efficiency in Bayesian Neural Networks Agustinus Kristiadi Runa Eschenhagen Philipp Hennig BDL 21 12 0 20 May 2022
Evaluating Uncertainty Calibration for Open-Set Recognition Zongyao Lyu Nolan B. Gutierrez William J. Beksi UQCV 27 1 0 15 May 2022
Distinction Maximization Loss: Efficiently Improving Out-of-Distribution Detection and Uncertainty Estimation by Replacing the Loss and Calibrating David Macêdo Cleber Zanchettin Teresa B Ludermir UQCV 28 4 0 12 May 2022
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness J. Liu Shreyas Padhy Jie Jessie Ren Zi Lin Yeming Wen Ghassen Jerfel Zachary Nado Jasper Snoek Dustin Tran Balaji Lakshminarayanan UQCV BDL 16 48 0 01 May 2022
Learning to Classify Open Intent via Soft Labeling and Manifold Mixup Zifeng Cheng Zhiwei Jiang Yafeng Yin Cong Wang Qing Gu VLM 16 13 0 16 Apr 2022
Out-of-Distribution Detection with Deep Nearest Neighbors Yiyou Sun Yifei Ming Xiaojin Zhu Yixuan Li OODD 19 487 0 13 Apr 2022
Out-Of-Distribution Detection In Unsupervised Continual Learning Jiangpeng He F. Zhu OODD 13 9 0 12 Apr 2022
Leverage Your Local and Global Representations: A New Self-Supervised Learning Strategy Tong Zhang Congpei Qiu Wei Ke Sabine Süsstrunk Mathieu Salzmann SSL 19 36 0 31 Mar 2022
A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration R. Hebbalaguppe Jatin Prakash Neelabh Madan Chetan Arora UQCV 22 42 0 25 Mar 2022
Mixing Up Contrastive Learning: Self-Supervised Representation Learning for Time Series Kristoffer Wickstrøm Michael C. Kampffmeyer Karl Øyvind Mikalsen Robert Jenssen SSL AI4TS 8 94 0 17 Mar 2022
MIMO-GAN: Generative MIMO Channel Modeling Tribhuvanesh Orekondy Arash Behboodi Joseph B. Soriaga GAN 6 17 0 16 Mar 2022
Igeood: An Information Geometry Approach to Out-of-Distribution Detection Eduardo Dadalto Camara Gomes F. Alberge Pierre Duhamel Pablo Piantanida OODD 25 27 0 15 Mar 2022
Estimating the Uncertainty in Emotion Class Labels with Utterance-Specific Dirichlet Priors Wen Wu C. Zhang Xixin Wu P. Woodland 48 14 0 08 Mar 2022
Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wild Xuefeng Du Xin Eric Wang Gabriel Gozum Yixuan Li OODD 40 90 0 08 Mar 2022
Rethinking Reconstruction Autoencoder-Based Out-of-Distribution Detection Yibo Zhou OODD 11 50 0 04 Mar 2022
Detecting and Learning the Unknown in Semantic Segmentation Robin Shing Moon Chan Svenja Uhlemeyer Matthias Rottmann Hanno Gottschalk UQCV 17 5 0 17 Feb 2022
Nonparametric Uncertainty Quantification for Single Deterministic Neural Network Nikita Kotelevskii A. Artemenkov Kirill Fedyanin Fedor Noskov Alexander Fishkov Artem Shelmanov Artem Vazhentsev Aleksandr Petiushko Maxim Panov UQCV BDL 53 25 0 07 Feb 2022
The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training Shiwei Liu Tianlong Chen Xiaohan Chen Li Shen D. Mocanu Zhangyang Wang Mykola Pechenizkiy 11 106 0 05 Feb 2022
UQGAN: A Unified Model for Uncertainty Quantification of Deep Classifiers trained via Conditional GANs Philipp Oberdiek G. Fink Matthias Rottmann OODD 32 14 0 31 Jan 2022
Deep Discriminative to Kernel Density Graph for In- and Out-of-distribution Calibrated Inference Jayanta Dey Haoyin Xu Will LeVine Ashwin De Silva Tyler M. Tomita Ali Geisa Tiffany Chu Jacob Desman Joshua T. Vogelstein UQCV 29 0 0 31 Jan 2022
Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attacks Lukas Struppek Dominik Hintersdorf Antonio De Almeida Correia Antonia Adler Kristian Kersting MIACV 55 62 0 28 Jan 2022
Invariant Representation Driven Neural Classifier for Anti-QCD Jet Tagging Taoli Cheng Aaron Courville 22 6 0 18 Jan 2022