Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning

15 February 2020

Dmitry Vetrov

Papers citing "Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning"

50 / 92 papers shown

Title
Self-Ensembling Gaussian Splatting for Few-Shot Novel View Synthesis Chen Zhao Xuan Wang Tong Zhang Saqib Javed Mathieu Salzmann 3DGS 182 0 0 13 Mar 2025
Parameter Expanded Stochastic Gradient Markov Chain Monte Carlo Hyunsu Kim G. Nam Chulhee Yun Hongseok Yang Juho Lee BDL UQCV 54 0 0 02 Mar 2025
Confidence Estimation for Error Detection in Text-to-SQL Systems Oleg Somov Elena Tutubalina 43 1 0 17 Jan 2025
Variational Bayesian Bow tie Neural Networks with Shrinkage Alisa Sheinkman Sara Wade BDL UQCV 39 0 0 17 Nov 2024
Uncertainty Estimation for 3D Object Detection via Evidential Learning N. Durasov Rafid Mahmood Jiwoong Choi Marc T. Law James Lucas Pascal Fua Jose M. Alvarez UQCV EDL 3DPC 47 1 0 31 Oct 2024
Rethinking the Uncertainty: A Critical Review and Analysis in the Era of Large Language Models Mohammad Beigi Sijia Wang Ying Shen Zihao Lin Adithya Kulkarni ... Ming Jin Jin-Hee Cho Dawei Zhou Chang-Tien Lu Lifu Huang 26 1 0 26 Oct 2024
The Disparate Benefits of Deep Ensembles Kajetan Schweighofer Adrián Arnaiz-Rodríguez Sepp Hochreiter Nuria Oliver FedML 25 1 0 17 Oct 2024
Ensemble everything everywhere: Multi-scale aggregation for adversarial robustness Stanislav Fort Balaji Lakshminarayanan OOD AAML 34 4 0 08 Aug 2024
Instance-wise Uncertainty for Class Imbalance in Semantic Segmentation Luís Almeida Ines Dutra Francesco Renna UQCV 32 0 0 17 Jul 2024
Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation? Wataru Hashimoto Hidetaka Kamigaito Taro Watanabe 27 1 0 02 Jul 2024
Uncertainty Quantification in Table Structure Recognition Kehinde E. Ajayi Leizhen Zhang Yi He Jian Wu LMTD 19 1 0 01 Jul 2024
Overcoming Common Flaws in the Evaluation of Selective Classification Systems Jeremias Traub Till J. Bungert Carsten T. Lüth Michael Baumgartner Klaus H. Maier-Hein Lena Maier-Hein Paul F. Jaeger 36 3 0 01 Jul 2024
Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph Roman Vashurin Ekaterina Fadeeva Artem Vazhentsev Akim Tsvigun Daniil Vasilev ... Timothy Baldwin Timothy Baldwin Maxim Panov Artem Shelmanov Artem Shelmanov HILM 66 8 0 21 Jun 2024
Tilt and Average : Geometric Adjustment of the Last Layer for Recalibration Gyusang Cho Chan-Hyun Youn 30 0 0 14 Jun 2024
Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks Andrew Gambardella Yusuke Iwasawa Yutaka Matsuo LRM 35 4 0 04 Jun 2024
CONFINE: Conformal Prediction for Interpretable Neural Networks Linhui Huang S. Lala N. Jha 65 2 0 01 Jun 2024
Just rotate it! Uncertainty estimation in closed-source models via multiple queries Konstantinos Pitas Julyan Arbel UQCV 16 0 0 22 May 2024
Fast Ensembling with Diffusion Schrödinger Bridge Hyunsu Kim Jongmin Yoon Juho Lee FedML UQCV 21 1 0 24 Apr 2024
Application of Deep Learning Methods to Processing of Noisy Medical Video Data Danil Afonchikov E. Kornaeva Irina Makovik Alexey Kornaev 23 0 0 16 Apr 2024
Awareness of uncertainty in classification using a multivariate model and multi-views Alexey Kornaev E. Kornaeva Oleg Ivanov Ilya S. Pershin Danis Alukaev UQCV EDL 39 0 0 16 Apr 2024
Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World Bowen Lei Dongkuan Xu Ruqi Zhang Bani Mallick UQCV 33 0 0 29 Mar 2024
Enabling Uncertainty Estimation in Iterative Neural Networks N. Durasov Doruk Öner Jonathan Donier Hieu M. Le Pascal Fua UQCV 46 8 0 25 Mar 2024
EDUE: Expert Disagreement-Guided One-Pass Uncertainty Estimation for Medical Image Segmentation Kudaibergen Abutalip Numan Saeed I. Sobirov Vincent Andrearczyk A. Depeursinge Mohammad Yaqub UQCV 29 0 0 25 Mar 2024
Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding Lingdong Kong Xiang Xu Jun Cen Wenwei Zhang Liang Pan Kai-xiang Chen Ziwei Liu 50 5 0 25 Mar 2024
Diversity-Aware Agnostic Ensemble of Sharpness Minimizers Anh-Vu Bui Vy Vo Tung Pham Dinh Q. Phung Trung Le FedML UQCV 26 1 0 19 Mar 2024
Uncertainty-Calibrated Test-Time Model Adaptation without Forgetting Mingkui Tan Guohao Chen Jiaxiang Wu Yifan Zhang Yaofo Chen Peilin Zhao Shuaicheng Niu TTA OOD 31 4 0 18 Mar 2024
Enhancing Transfer Learning with Flexible Nonparametric Posterior Sampling Hyungi Lee G. Nam Edwin Fong Juho Lee BDL 29 5 0 12 Mar 2024
A prediction rigidity formalism for low-cost uncertainties in trained neural networks Filippo Bigi Sanggyu Chong Michele Ceriotti Federico Grasselli 44 5 0 04 Mar 2024
Fine-tuning with Very Large Dropout Jianyu Zhang Léon Bottou 37 1 0 01 Mar 2024
Gradient Alignment with Prototype Feature for Fully Test-time Adaptation Juhyeon Shin Jonghyun Lee Saehyung Lee Minjun Park Dongjun Lee Uiwon Hwang Sungroh Yoon 24 1 0 14 Feb 2024
Multiple Random Masking Autoencoder Ensembles for Robust Multimodal Semi-supervised Learning Alexandru-Raul Todoran Marius Leordeanu 23 0 0 12 Feb 2024
Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks Youngkyoung Bae Seungwoong Ha Hawoong Jeong 71 2 0 02 Feb 2024
Conformal Prediction Sets Improve Human Decision Making Jesse C. Cresswell Yi Sui Bhargava Kumar Noël Vouitsis 21 18 0 24 Jan 2024
Tailoring Mixup to Data for Calibration Quentin Bouniot Pavlo Mozharovskyi Florence dÁlché-Buc 55 1 0 02 Nov 2023
When are ensembles really effective? Ryan Theisen Hyunsuk Kim Yaoqing Yang Liam Hodgkinson Michael W. Mahoney FedML UQCV 24 15 0 21 May 2023
Diversifying Deep Ensembles: A Saliency Map Approach for Enhanced OOD Detection, Calibration, and Accuracy Stanislav Dereka I. Karpukhin Maksim Zhdanov Sergey Kolesnikov 30 0 0 19 May 2023
Evaluation of Test-Time Adaptation Under Computational Time Constraints Motasem Alfarra Hani Itani Alejandro Pardo Shyma Alhuwaider Merey Ramazanova Juan C. Pérez Zhipeng Cai Matthias Müller Bernard Ghanem TTA 26 2 0 10 Apr 2023
A Review of Uncertainty Estimation and its Application in Medical Imaging K. Zou Zhihao Chen Xuedong Yuan Xiaojing Shen Meng Wang H. Fu UQCV 40 85 0 16 Feb 2023
Pathologies of Predictive Diversity in Deep Ensembles Taiga Abe E. Kelly Buchanan Geoff Pleiss John P. Cunningham UQCV 38 13 0 01 Feb 2023
Uncertainty Estimation based on Geometric Separation Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 19 0 0 11 Jan 2023
ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inference N. Durasov Nik Dorndorf Hieu M. Le Pascal Fua UQCV 25 10 0 21 Nov 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 38 32 0 17 Oct 2022
Automatic Neural Network Hyperparameter Optimization for Extrapolation: Lessons Learned from Visible and Near-Infrared Spectroscopy of Mango Fruit Matthew C. Dirks David Poole 13 16 0 03 Oct 2022
Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures? Lisa Wimmer Yusuf Sale Paul Hofman Bern Bischl Eyke Hüllermeier PER UD 34 64 0 07 Sep 2022
Calibrated Selective Classification Adam Fisch Tommi Jaakkola Regina Barzilay 21 16 0 25 Aug 2022
GraphTTA: Test Time Adaptation on Graph Neural Networks Guan-Wun Chen Jiying Zhang Xi Xiao Y. Li OOD 30 9 0 19 Aug 2022
Pre-training General Trajectory Embeddings with Maximum Multi-view Entropy Coding Yan Lin Huaiyu Wan S. Guo Jilin Hu Christian S. Jensen Youfang Lin AI4TS 26 19 0 29 Jul 2022
LGV: Boosting Adversarial Example Transferability from Large Geometric Vicinity Martin Gubri Maxime Cordy Mike Papadakis Yves Le Traon Koushik Sen AAML 22 51 0 26 Jul 2022
Shifts 2.0: Extending The Dataset of Real Distributional Shifts A. Malinin A. Athanasopoulos M. Barakovic Meritxell Bach Cuadra Mark J. F. Gales ... Francesco La Rosa Eli Sivena V. Tsarsitalidis Efi Tsompopoulou E. Volf OOD 22 28 0 30 Jun 2022
RegMixup: Mixup as a Regularizer Can Surprisingly Improve Accuracy and Out Distribution Robustness Francesco Pinto Harry Yang Ser-Nam Lim Philip H. S. Torr P. Dokania UQCV 27 34 0 29 Jun 2022