Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning

16 March 2020

Papers citing "Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning"

47 / 47 papers shown

Title
MBCT: Tree-Based Feature-Aware Binning for Individual Uncertainty Calibration Siguang Huang Yunli Wang Lili Mou Huayue Zhang Han Zhu Chuan Yu Bo Zheng 60 15 0 13 Mar 2025
Unveiling the Capabilities of Large Language Models in Detecting Offensive Language with Annotation Disagreement Junyu Lu Kai Ma Kaichun Wang Kelaiti Xiao Roy Ka-Wei Lee Bo Xu Liang Yang Hongfei Lin 49 0 0 10 Feb 2025
Optical aberrations in autonomous driving: Physics-informed parameterized temperature scaling for neural network uncertainty calibration D. Wolf Alexander Braun Markus Ulrich 89 0 0 18 Dec 2024
Combining Priors with Experience: Confidence Calibration Based on Binomial Process Modeling Jinzong Dong Zhaohui Jiang Dong Pan Haoyang Yu 56 0 0 14 Dec 2024
Confidence Calibration of Classifiers with Many Classes Adrien LeCoz Stéphane Herbin Faouzi Adjed UQCV 37 1 0 05 Nov 2024
Taming Overconfidence in LLMs: Reward Calibration in RLHF Jixuan Leng Chengsong Huang Banghua Zhu Jiaxin Huang 28 7 0 13 Oct 2024
GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networks Dingyi Zhuang Chonghe Jiang Yunhan Zheng Shenhao Wang Jinhua Zhao UQCV 39 0 0 12 Oct 2024
Calibrating Expressions of Certainty Peiqi Wang Barbara D. Lam Yingcheng Liu Ameneh Asgari-Targhi Rameswar Panda W. Wells Tina Kapur Polina Golland 32 1 0 06 Oct 2024
Reassessing How to Compare and Improve the Calibration of Machine Learning Models M. Chidambaram Rong Ge 66 1 0 06 Jun 2024
CONFINE: Conformal Prediction for Interpretable Neural Networks Linhui Huang S. Lala N. Jha 68 2 0 01 Jun 2024
Conditional Shift-Robust Conformal Prediction for Graph Neural Network Akansha Agrawal UQCV 53 1 0 20 May 2024
Optimizing Calibration by Gaining Aware of Prediction Correctness Yuchi Liu Lei Wang Yuli Zou James Zou Liang Zheng UQCV 41 1 0 19 Apr 2024
Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World Bowen Lei Dongkuan Xu Ruqi Zhang Bani Mallick UQCV 36 0 0 29 Mar 2024
Class and Region-Adaptive Constraints for Network Calibration Balamurali Murugesan Julio Silva-Rodríguez Ismail Ben Ayed Jose Dolz 32 1 0 19 Mar 2024
Accuracy-Preserving Calibration via Statistical Modeling on Probability Simplex Yasushi Esaki Akihiro Nakamura Keisuke Kawano Ryoko Tokuhisa Takuro Kutsuna 40 0 0 21 Feb 2024
Overconfident and Unconfident AI Hinder Human-AI Collaboration Jingshu Li Yitian Yang Renwen Zhang Yi-Chieh Lee 27 1 0 12 Feb 2024
Model Calibration in Dense Classification with Adaptive Label Perturbation Jiawei Liu Changkun Ye Shanpeng Wang Rui-Qing Cui Jing Zhang Kai Zhang Nick Barnes 42 5 0 25 Jul 2023
Scaling of Class-wise Training Losses for Post-hoc Calibration Seungjin Jung Seung-Woo Seo Yonghyun Jeong Jongwon Choi 29 3 0 19 Jun 2023
Trustworthy Sensor Fusion against Inaudible Command Attacks in Advanced Driver-Assistance System Jiwei Guan Lei Pan Chen Wang Shui Yu Longxiang Gao Xi Zheng AAML 19 3 0 30 May 2023
Dual Focal Loss for Calibration Linwei Tao Minjing Dong Chang Xu UQCV 37 26 0 23 May 2023
Minimum-Risk Recalibration of Classifiers Zeyu Sun Dogyoon Song Alfred Hero 30 5 0 18 May 2023
Calibration Error Estimation Using Fuzzy Binning Geetanjali Bihani Julia Taylor Rayz 93 2 0 30 Apr 2023
Transfer Knowledge from Head to Tail: Uncertainty Calibration under Long-tailed Distribution Jiahao Chen Bingyue Su 30 11 0 13 Apr 2023
Uncertainty Estimation based on Geometric Separation Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 25 0 0 11 Jan 2023
Investigating Deep Learning Model Calibration for Classification Problems in Mechanics S. Mohammadzadeh Peerasait Prachaseree Emma Lejeune AI4CE 34 2 0 01 Dec 2022
A Unifying Theory of Distance from Calibration Jarosław Błasiok Parikshit Gopalan Lunjia Hu Preetum Nakkiran 31 32 0 30 Nov 2022
AdaFocal: Calibration-aware Adaptive Focal Loss Arindam Ghosh Thomas Schaaf Matthew R. Gormley FedML UQCV 21 25 0 21 Nov 2022
To Softmax, or not to Softmax: that is the question when applying Active Learning for Transformer Models Julius Gonsior C. Falkenberg Silvio Magino Anja Reusch Maik Thiele Wolfgang Lehner UQCV 36 7 0 06 Oct 2022
Adaptive Temperature Scaling for Robust Calibration of Deep Neural Networks Sérgio A. Balanya Juan Maroñas Daniel Ramos OOD 35 13 0 31 Jul 2022
BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks Uddeshya Upadhyay Shyamgopal Karthik Yanbei Chen Massimiliano Mancini Zeynep Akata UQCV BDL 26 22 0 14 Jul 2022
SLOVA: Uncertainty Estimation Using Single Label One-Vs-All Classifier Bartosz Wójcik J. Grela Marek Śmieja Krzysztof Misztal Jacek Tabor UQCV 33 4 0 28 Jun 2022
On the Usefulness of the Fit-on-the-Test View on Evaluating Calibration of Classifiers Markus Kängsepp Kaspar Valk Meelis Kull 27 3 0 16 Mar 2022
Metrics for saliency map evaluation of deep learning explanation methods T. Gomez Thomas Fréour Harold Mouchère XAI FAtt 66 41 0 31 Jan 2022
The Devil is in the Margin: Margin-based Label Smoothing for Network Calibration Bingyuan Liu Ismail Ben Ayed Adrian Galdran Jose Dolz UQCV 24 65 0 30 Nov 2021
Deep Probability Estimation Sheng Liu Aakash Kaku Weicheng Zhu M. Leibovich S. Mohan ... Haoxiang Huang L. Zanna N. Razavian Jonathan Niles-Weed C. Fernandez‐Granda UQCV OOD 28 14 0 21 Nov 2021
Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration Gavin Kerrigan Padhraic Smyth M. Steyvers 22 46 0 29 Sep 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 32 1,109 0 07 Jul 2021
Improving Uncertainty Calibration of Deep Neural Networks via Truth Discovery and Geometric Optimization Chunwei Ma Ziyun Huang Jiayi Xian Mingchen Gao Jinhui Xu UQCV 19 14 0 25 Jun 2021
Towards Consistent Predictive Confidence through Fitted Ensembles Navid Kardan Ankit Sharma Kenneth O. Stanley FedML OODD 16 8 0 22 Jun 2021
Meta-Cal: Well-controlled Post-hoc Calibration by Ranking Xingchen Ma Matthew B. Blaschko 18 34 0 10 May 2021
Local Calibration: Metrics and Recalibration Rachel Luo Aadyot Bhatnagar Yu Bai Shengjia Zhao Huan Wang Caiming Xiong Silvio Savarese Stefano Ermon Edward Schmerling Marco Pavone 19 14 0 22 Feb 2021
Probabilistic Neighbourhood Component Analysis: Sample Efficient Uncertainty Estimation in Deep Learning Ankur Mallick Chaitanya Dwivedi B. Kailkhura Gauri Joshi T. Y. Han UQCV BDL 34 6 0 18 Jul 2020
Improving Calibration through the Relationship with Adversarial Robustness Yao Qin Xuezhi Wang Alex Beutel Ed H. Chi AAML 27 25 0 29 Jun 2020
Distribution-free binary classification: prediction sets, confidence intervals and calibration Chirag Gupta A. Podkopaev Aaditya Ramdas UQCV 23 79 0 18 Jun 2020
A Survey on Deep Learning in Medical Image Analysis G. Litjens Thijs Kooi B. Bejnordi A. Setio F. Ciompi Mohsen Ghafoorian Jeroen van der Laak Bram van Ginneken C. I. Sánchez OOD 283 10,613 0 19 Feb 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 270 5,660 0 05 Dec 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 285 9,136 0 06 Jun 2015