v1v2 (latest)

Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem

13 December 2018

Matthias Hein

Maksym Andriushchenko

Julian Bitterwolf

OODD

ArXiv (abs)PDF HTML

Papers citing "Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem"

50 / 365 papers shown

Title
Distinction Maximization Loss: Efficiently Improving Out-of-Distribution Detection and Uncertainty Estimation by Replacing the Loss and Calibrating David Macêdo Cleber Zanchettin Teresa B Ludermir UQCV 306 4 0 12 May 2022
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-AwarenessJournal of machine learning research (JMLR), 2022 J. Liu Shreyas Padhy Jie Jessie Ren Zi Lin Yeming Wen Ghassen Jerfel Zachary Nado Jasper Snoek Dustin Tran Balaji Lakshminarayanan UQCV BDL 440 62 0 01 May 2022
Learning to Classify Open Intent via Soft Labeling and Manifold MixupIEEE/ACM Transactions on Audio Speech and Language Processing (TASLP), 2022 Zifeng Cheng Zhiwei Jiang Yafeng Yin Cong Wang Qing Gu VLM 89 21 0 16 Apr 2022
Out-of-Distribution Detection with Deep Nearest NeighborsInternational Conference on Machine Learning (ICML), 2022 Yiyou Sun Yifei Ming Xiaojin Zhu Shouqing Yang OODD 466 666 0 13 Apr 2022
Out-Of-Distribution Detection In Unsupervised Continual Learning Jiangpeng He Fengqing Zhu OODD 107 13 0 12 Apr 2022
Leverage Your Local and Global Representations: A New Self-Supervised Learning StrategyComputer Vision and Pattern Recognition (CVPR), 2022 Tong Zhang Congpei Qiu Wei Ke Sabine Süsstrunk Mathieu Salzmann SSL 162 40 0 31 Mar 2022
A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network CalibrationComputer Vision and Pattern Recognition (CVPR), 2022 R. Hebbalaguppe Jatin Prakash Neelabh Madan Chetan Arora UQCV 157 52 0 25 Mar 2022
Mixing Up Contrastive Learning: Self-Supervised Representation Learning for Time SeriesPattern Recognition Letters (PR), 2022 Kristoffer Wickstrøm Michael C. Kampffmeyer Karl Øyvind Mikalsen Robert Jenssen SSL AI4TS 102 112 0 17 Mar 2022
MIMO-GAN: Generative MIMO Channel Modeling Tribhuvanesh Orekondy Arash Behboodi Joseph B. Soriaga GAN 102 25 0 16 Mar 2022
Igeood: An Information Geometry Approach to Out-of-Distribution DetectionInternational Conference on Learning Representations (ICLR), 2022 Eduardo Dadalto Camara Gomes F. Alberge Pierre Duhamel Pablo Piantanida OODD 239 30 0 15 Mar 2022
Estimating the Uncertainty in Emotion Class Labels with Utterance-Specific Dirichlet PriorsIEEE Transactions on Affective Computing (IEEE TAC), 2022 Wen Wu Chuxu Zhang Xixin Wu P. Woodland 251 17 0 08 Mar 2022
Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the WildComputer Vision and Pattern Recognition (CVPR), 2022 Xuefeng Du Xin Eric Wang Gabriel Gozum Shouqing Yang OODD 219 107 0 08 Mar 2022
Rethinking Reconstruction Autoencoder-Based Out-of-Distribution DetectionComputer Vision and Pattern Recognition (CVPR), 2022 Yibo Zhou OODD 233 76 0 04 Mar 2022
Detecting and Learning the Unknown in Semantic Segmentation Robin Shing Moon Chan Svenja Uhlemeyer Matthias Rottmann Hanno Gottschalk UQCV 185 5 0 17 Feb 2022
Nonparametric Uncertainty Quantification for Single Deterministic Neural NetworkNeural Information Processing Systems (NeurIPS), 2022 Nikita Kotelevskii A. Artemenkov Kirill Fedyanin Fedor Noskov Alexander Fishkov Artem Shelmanov Artem Vazhentsev Aleksandr Petiushko Maxim Panov UQCV BDL 175 41 0 07 Feb 2022
The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse TrainingInternational Conference on Learning Representations (ICLR), 2022 Shiwei Liu Tianlong Chen Xiaohan Chen Li Shen Decebal Constantin Mocanu Zinan Lin Mykola Pechenizkiy 203 128 0 05 Feb 2022
UQGAN: A Unified Model for Uncertainty Quantification of Deep Classifiers trained via Conditional GANsNeural Information Processing Systems (NeurIPS), 2022 Philipp Oberdiek G. Fink Matthias Rottmann OODD 317 22 0 31 Jan 2022
Plug & Play Attacks: Towards Robust and Flexible Model Inversion AttacksInternational Conference on Machine Learning (ICML), 2022 Lukas Struppek Dominik Hintersdorf Antonio De Almeida Correia Antonia Adler Kristian Kersting MIACV 283 78 0 28 Jan 2022
Invariant Representation Driven Neural Classifier for Anti-QCD Jet TaggingJournal of High Energy Physics (JHEP), 2022 Taoli Cheng Aaron Courville 259 6 0 18 Jan 2022
Self-Supervised Anomaly Detection by Self-Distillation and Negative SamplingInternational Conference on Artificial Neural Networks (ICANN), 2022 Nima Rafiee Rahil Gholamipoorfard Tim Kaiser Simon Jaxy Julius Ramakers M. Kollmann OODD 108 9 0 17 Jan 2022
Spatial-Temporal-Fusion BNN: Variational Bayesian Feature Layer Shiye Lei Zhuozhuo Tu Leszek Rutkowski Feng Zhou Li Shen Fengxiang He Dacheng Tao BDL 164 2 0 12 Dec 2021
Hyperdimensional Feature Fusion for Out-Of-Distribution Detection Samuel Wilson Tobias Fischer Niko Sünderhauf Feras Dayoub OODD 221 21 0 10 Dec 2021
Provable Guarantees for Understanding Out-of-distribution Detection Peyman Morteza Shouqing Yang OODD 179 102 0 01 Dec 2021
FROB: Few-shot ROBust Model for Classification and Out-of-Distribution Detection Nikolaos Dionelis Mehrdad Yaghoobi Sotirios A. Tsaftaris OODD 202 4 0 30 Nov 2021
ReAct: Out-of-distribution Detection With Rectified Activations Yiyou Sun Chuan Guo Shouqing Yang OODD 335 569 0 24 Nov 2021
DICE: Leveraging Sparsification for Out-of-Distribution Detection Yiyou Sun Shouqing Yang OODD 298 196 0 18 Nov 2021
To Trust or Not To Trust Prediction Scores for Membership Inference Attacks Dominik Hintersdorf Lukas Struppek Kristian Kersting 144 17 0 17 Nov 2021
Detecting Fake Points of Interest from Location Data Syed Raza Bashir Vojislav B. Mišić 54 0 0 11 Nov 2021
Mixtures of Laplace Approximations for Improved Post-Hoc Uncertainty in Deep Learning Runa Eschenhagen Erik A. Daxberger Philipp Hennig Agustinus Kristiadi UQCV BDL 170 28 0 05 Nov 2021
PnPOOD : Out-Of-Distribution Detection for Text Classification via Plug andPlay Data Augmentation Mrinal Rawat R. Hebbalaguppe Lovekesh Vig OODD 187 12 0 31 Oct 2021
A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challenges Mohammadreza Salehi Hossein Mirzaei Dan Hendrycks Shouqing Yang M. Rohban Mohammad Sabokrou OOD 552 221 0 26 Oct 2021
Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification Maximilian Stadler Bertrand Charpentier Simon Geisler Daniel Zügner Stephan Günnemann UQCV BDL 268 103 0 26 Oct 2021
Periodic Activation Functions Induce Stationarity Lassi Meronen Martin Trapp Arno Solin BDL 207 25 0 26 Oct 2021
Generalized Out-of-Distribution Detection: A SurveyInternational Journal of Computer Vision (IJCV), 2021 Jingkang Yang Kaiyang Zhou Shouqing Yang Ziwei Liu 592 1,176 0 21 Oct 2021
Meta Learning Low Rank Covariance Factors for Energy-Based Deterministic UncertaintyInternational Conference on Learning Representations (ICLR), 2021 Jeffrey Willette Haebeom Lee Juho Lee Sung Ju Hwang OODD OOD 207 2 0 12 Oct 2021
Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation Dennis Ulmer Christian Hardmeier J. Frellsen BDL UQCV UD EDL PER 300 73 0 06 Oct 2021
Out-of-Distribution Detection for Medical Applications: Guidelines for Practical Evaluation Karina Zadorozhny P. Thoral Paul Elbers Giovanni Cina OODD OOD 229 20 0 30 Sep 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 308 909 0 29 Sep 2021
$f$ -Cal: Calibrated aleatoric uncertainty estimation from neural networks for robot perception Dhaivat Bhatt Kaustubh Mani Dishank Bansal Krishna Murthy Jatavallabhula Hanju Lee Liam Paull UQCV 177 6 0 28 Sep 2021
Improving Uncertainty of Deep Learning-based Object Classification on Radar Spectra using Label Smoothing Kanil Patel William H. Beluch K. Rambach Michael Pfeiffer B. Yang UQCV 163 9 0 27 Sep 2021
A novel network training approach for open set image recognition Md Tahmid Hossaina S. Teng Guojun Lu Ferdous Sohel 83 0 0 27 Sep 2021
A Physics inspired Functional Operator for Model Uncertainty Quantification in the RKHS Rishabh Singh José C. Príncipe 189 4 0 22 Sep 2021
SoK: Machine Learning Governance Varun Chandrasekaran Hengrui Jia Anvith Thudi Adelin Travers Mohammad Yaghini Nicolas Papernot 231 20 0 20 Sep 2021
Efficient Action Recognition Using Confidence Distillation Shervin Manzuri Shalmani Fei Chiang Ronghuo Zheng 268 6 0 05 Sep 2021
Reiterative Domain Aware Multi-Target AdaptationGerman Conference on Pattern Recognition (DAGM), 2021 Sudipan Saha Shan Zhao Nasrullah Sheikh Xiao Xiang Zhu 166 2 0 26 Aug 2021
Influence Selection for Active Learning Zhuoming Liu Hao Ding Huaping Zhong Weijia Li Jifeng Dai Conghui He TDI 255 116 0 20 Aug 2021
CODEs: Chamfer Out-of-Distribution Examples against Overconfidence IssueIEEE International Conference on Computer Vision (ICCV), 2021 Keke Tang Dingruibo Miao Weilong Peng Jianpeng Wu Yawen Shi Zhaoquan Gu Zhihong Tian Wenping Wang OODD 311 34 0 13 Aug 2021
Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentation Victor Besnier Andrei Bursuc David Picard Alexandre Briot UQCV 205 52 0 03 Aug 2021
Robust Semantic Segmentation with Superpixel-Mix Gianni Franchi Nacim Belkhir Mai Lan Ha Yufei Hu Andrei Bursuc V. Blanz Angela Yao UQCV 181 24 0 02 Aug 2021
Energy-Based Open-World Uncertainty Modeling for Confidence CalibrationIEEE International Conference on Computer Vision (ICCV), 2021 Yezhen Wang Yue Liu Tong Che Kaiyang Zhou Ziwei Liu Dongsheng Li UQCV 233 65 0 27 Jul 2021