Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning

15 February 2020

Dmitry Vetrov

Papers citing "Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning"

42 / 92 papers shown

Title
Cold Posteriors through PAC-Bayes Konstantinos Pitas Julyan Arbel 23 5 0 22 Jun 2022
Adapting the Linearised Laplace Model Evidence for Modern Deep Learning Javier Antorán David Janz J. Allingham Erik A. Daxberger Riccardo Barbano Eric T. Nalisnick José Miguel Hernández-Lobato UQCV BDL 25 28 0 17 Jun 2022
Sample-Efficient Optimisation with Probabilistic Transformer Surrogates A. Maraval Matthieu Zimmer Antoine Grosnit Rasul Tutunov Jun Wang H. Ammar 25 2 0 27 May 2022
A high-resolution canopy height model of the Earth Nico Lang W. Jetz Konrad Schindler Jan Dirk Wegner 24 259 0 13 Apr 2022
Machine Learning and Deep Learning -- A review for Ecologists Maximilian Pichler F. Hartig 30 124 0 11 Apr 2022
Efficient Test-Time Model Adaptation without Forgetting Shuaicheng Niu Jiaxiang Wu Yifan Zhang Yaofo Chen S. Zheng P. Zhao Mingkui Tan OOD VLM TTA 26 307 0 06 Apr 2022
Continual Test-Time Domain Adaptation Qin Wang Olga Fink Luc Van Gool Dengxin Dai OOD TTA 39 394 0 25 Mar 2022
Self-Distribution Distillation: Efficient Uncertainty Estimation Yassir Fathullah Mark J. F. Gales UQCV 14 11 0 15 Mar 2022
MUAD: Multiple Uncertainties for Autonomous Driving, a benchmark for multiple uncertainty types and tasks Gianni Franchi Xuanlong Yu Andrei Bursuc Ángel Tena Rémi Kazmierczak Séverine Dubuisson Emanuel Aldea David Filliat UQCV 23 28 0 02 Mar 2022
Deep Ensembles Work, But Are They Necessary? Taiga Abe E. Kelly Buchanan Geoff Pleiss R. Zemel John P. Cunningham OOD UQCV 36 59 0 14 Feb 2022
Transformer Uncertainty Estimation with Hierarchical Stochastic Attention Jiahuan Pei Cheng-Yu Wang Gyuri Szarvas 19 22 0 27 Dec 2021
Why Calibration Error is Wrong Given Model Uncertainty: Using Posterior Predictive Checks with Deep Learning Achintya Gopal UQCV 28 1 0 02 Dec 2021
Towards Calibrated Model for Long-Tailed Visual Recognition from Prior Perspective Zhengzhuo Xu Zenghao Chai Chun Yuan 57 52 0 06 Nov 2021
Diversity Enhanced Active Learning with Strictly Proper Scoring Rules Wei Tan Lan Du Wray L. Buntine 16 30 0 27 Oct 2021
Diversity Matters When Learning From Ensembles G. Nam Jongmin Yoon Yoonho Lee Juho Lee UQCV FedML VLM 37 36 0 27 Oct 2021
AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification Romain Egele R. Maulik Krishnan Raghavan Bethany Lusch Isabelle M Guyon Prasanna Balaprakash UQCV OOD BDL 20 45 0 26 Oct 2021
MEMO: Test Time Robustness via Adaptation and Augmentation Marvin Zhang Sergey Levine Chelsea Finn OOD TTA 14 299 0 18 Oct 2021
DEBOSH: Deep Bayesian Shape Optimization N. Durasov Artem Lukoyanov Jonathan Donier Pascal Fua UQCV AI4CE 29 15 0 28 Sep 2021
Uncertainty Measures in Neural Belief Tracking and the Effects on Dialogue Policy Performance Carel van Niekerk A. Malinin Christian Geishauser Michael Heck Hsien-chin Lin Nurul Lubis Shutong Feng Milica Gavsić 18 9 0 09 Sep 2021
Effect of the output activation function on the probabilities and errors in medical image segmentation Lars Nieradzik G. Scheuermann D. Saur Christina Gillmann SSeg MedIm UQCV 30 6 0 02 Sep 2021
Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraints A. Nguyen Edward Raff Charles K. Nicholas James Holt 28 21 0 09 Aug 2021
Robust Semantic Segmentation with Superpixel-Mix Gianni Franchi Nacim Belkhir Mai Lan Ha Yufei Hu Andrei Bursuc V. Blanz Angela Yao UQCV 28 22 0 02 Aug 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 30 1,109 0 07 Jul 2021
Improving Uncertainty Calibration of Deep Neural Networks via Truth Discovery and Geometric Optimization Chunwei Ma Ziyun Huang Jiayi Xian Mingchen Gao Jinhui Xu UQCV 17 14 0 25 Jun 2021
Leveraging Self-Supervision for Cross-Domain Crowd Counting Weizhe Liu N. Durasov Pascal Fua 13 40 0 30 Mar 2021
Few-shot Conformal Prediction with Auxiliary Tasks Adam Fisch Tal Schuster Tommi Jaakkola Regina Barzilay 178 53 0 17 Feb 2021
Twin Neural Network Regression S. J. Wetzel Kevin Ryczko R. Melko Isaac Tamblyn UQCV 12 11 0 29 Dec 2020
A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving Di Feng Ali Harakeh Steven Waslander Klaus C. J. Dietmayer AAML UQCV EDL 24 222 0 20 Nov 2020
Combining Ensembles and Data Augmentation can Harm your Calibration Yeming Wen Ghassen Jerfel Rafael Muller Michael W. Dusenberry Jasper Snoek Balaji Lakshminarayanan Dustin Tran UQCV 26 63 0 19 Oct 2020
Neural Bootstrapper Minsuk Shin Hyungjoon Cho Hyun-Seok Min Sungbin Lim UQCV BDL 17 7 0 02 Oct 2020
Why have a Unified Predictive Uncertainty? Disentangling it using Deep Split Ensembles U. Sarawgi W. Zulfikar Rishab Khincha Pattie Maes PER UQCV BDL UD 16 7 0 25 Sep 2020
Calibration of Model Uncertainty for Dropout Variational Inference M. Laves Sontje Ihler Karl-Philipp Kortmann T. Ortmaier BDL UQCV 24 18 0 20 Jun 2020
Uncertainty in Gradient Boosting via Ensembles Aleksei Ustimenko Liudmila Prokhorenkova A. Malinin UQCV 17 94 0 18 Jun 2020
Neural Ensemble Search for Uncertainty Estimation and Dataset Shift Sheheryar Zaidi Arber Zela T. Elsken Chris Holmes Frank Hutter Yee Whye Teh OOD UQCV 13 71 0 15 Jun 2020
Depth Uncertainty in Neural Networks Javier Antorán J. Allingham José Miguel Hernández-Lobato UQCV OOD BDL 28 100 0 15 Jun 2020
Efficient Ensemble Model Generation for Uncertainty Estimation with Bayesian Approximation in Segmentation Hong Joo Lee S. T. Kim Hakmin Lee Nassir Navab Yong Man Ro UQCV 8 7 0 21 May 2020
Global inducing point variational posteriors for Bayesian neural networks and deep Gaussian processes Sebastian W. Ober Laurence Aitchison BDL 13 60 0 17 May 2020
Greedy Policy Search: A Simple Baseline for Learnable Test-Time Augmentation Dmitry Molchanov Alexander Lyzhov Yuliya Molchanova Arsenii Ashukha Dmitry Vetrov TPM 17 84 0 21 Feb 2020
Bayesian Deep Learning and a Probabilistic Perspective of Generalization A. Wilson Pavel Izmailov UQCV BDL OOD 17 639 0 20 Feb 2020
Training-Free Uncertainty Estimation for Dense Regression: Sensitivity as a Surrogate Lu Mi Hao Wang Yonglong Tian Hao He Nir Shavit UQCV 21 29 0 28 Sep 2019
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 270 5,660 0 05 Dec 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 282 9,136 0 06 Jun 2015