Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration

28 October 2019

Meelis Kull

Miquel Perelló Nieto

Markus Kängsepp

Telmo de Menezes e Silva Filho

Papers citing "Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration"

28 / 78 papers shown

Title
Forecasting Future World Events with Neural Networks Andy Zou Tristan Xiao Ryan Jia Joe Kwon Mantas Mazeika Richard Li Dawn Song Jacob Steinhardt Owain Evans Dan Hendrycks 17 22 0 30 Jun 2022
SLOVA: Uncertainty Estimation Using Single Label One-Vs-All Classifier Bartosz Wójcik J. Grela Marek Śmieja Krzysztof Misztal Jacek Tabor UQCV 31 4 0 28 Jun 2022
On Calibrated Model Uncertainty in Deep Learning Biraja Ghoshal A. Tucker UQCV MedIm 20 10 0 15 Jun 2022
A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration R. Hebbalaguppe Jatin Prakash Neelabh Madan Chetan Arora UQCV 9 42 0 25 Mar 2022
On the Usefulness of the Fit-on-the-Test View on Evaluating Calibration of Classifiers Markus Kängsepp Kaspar Valk Meelis Kull 27 3 0 16 Mar 2022
Low-Degree Multicalibration Parikshit Gopalan Michael P. Kim M. Singhal Shengjia Zhao FaML UQCV 22 37 0 02 Mar 2022
Confidence Calibration for Object Detection and Segmentation Fabian Küppers Anselm Haselhoff Jan Kronenberger Jonas Schneider UQCV 17 4 0 25 Feb 2022
Calibrated Learning to Defer with One-vs-All Classifiers Rajeev Verma Eric Nalisnick 17 42 0 08 Feb 2022
Deep Probability Estimation Sheng Liu Aakash Kaku Weicheng Zhu M. Leibovich S. Mohan ... Haoxiang Huang L. Zanna N. Razavian Jonathan Niles-Weed C. Fernandez‐Granda UQCV OOD 28 14 0 21 Nov 2021
Exploring Covariate and Concept Shift for Detection and Calibration of Out-of-Distribution Data Junjiao Tian Yen-Change Hsu Yilin Shen Hongxia Jin Z. Kira OODD 19 6 0 28 Oct 2021
Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration Gavin Kerrigan Padhraic Smyth M. Steyvers 22 46 0 29 Sep 2021
Self Training with Ensemble of Teacher Models Soumyadeep Ghosh Sanjay Kumar Janu Verma Awanish Kumar 22 3 0 17 Jul 2021
Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibration Shengjia Zhao Michael P. Kim Roshni Sahoo Tengyu Ma Stefano Ermon 15 55 0 12 Jul 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 30 1,109 0 07 Jul 2021
Improving Uncertainty Calibration of Deep Neural Networks via Truth Discovery and Geometric Optimization Chunwei Ma Ziyun Huang Jiayi Xian Mingchen Gao Jinhui Xu UQCV 17 14 0 25 Jun 2021
Graceful Degradation and Related Fields J. Dymond 23 4 0 21 Jun 2021
Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error Ondrej Bohdal Yongxin Yang Timothy M. Hospedales UQCV OOD 35 21 0 17 Jun 2021
FairCal: Fairness Calibration for Face Verification Tiago Salvador Stephanie Cairns Vikram S. Voleti Noah Marshall Adam M. Oberman FaML 17 20 0 07 Jun 2021
Meta-Cal: Well-controlled Post-hoc Calibration by Ranking Xingchen Ma Matthew B. Blaschko 10 34 0 10 May 2021
Learning to Cascade: Confidence Calibration for Improving the Accuracy and Computational Cost of Cascade Inference Systems Shohei Enomoto Takeharu Eda UQCV 41 17 0 15 Apr 2021
SCRIB: Set-classifier with Class-specific Risk Bounds for Blackbox Models Zhen Lin Cao Xiao Lucas Glass M. P. M. Brandon Westover Jimeng Sun BDL 21 11 0 05 Mar 2021
Distribution-free uncertainty quantification for classification under label shift A. Podkopaev Aaditya Ramdas UQCV 14 83 0 04 Mar 2021
Local Calibration: Metrics and Recalibration Rachel Luo Aadyot Bhatnagar Yu Bai Shengjia Zhao Huan Wang Caiming Xiong Silvio Savarese Stefano Ermon Edward Schmerling Marco Pavone 11 14 0 22 Feb 2021
Know Your Limits: Uncertainty Estimation with ReLU Classifiers Fails at Reliable OOD Detection Dennis Ulmer Giovanni Cina OODD 27 31 0 09 Dec 2020
Calibration of Model Uncertainty for Dropout Variational Inference M. Laves Sontje Ihler Karl-Philipp Kortmann T. Ortmaier BDL UQCV 21 18 0 20 Jun 2020
Calibrating Deep Neural Network Classifiers on Out-of-Distribution Datasets Zhihui Shao Jianyi Yang Shaolei Ren OODD 27 11 0 16 Jun 2020
Calibrating Deep Neural Networks using Focal Loss Jishnu Mukhoti Viveka Kulharia Amartya Sanyal Stuart Golodetz Philip H. S. Torr P. Dokania UQCV 16 444 0 21 Feb 2020
Verified Uncertainty Calibration Ananya Kumar Percy Liang Tengyu Ma 19 345 0 23 Sep 2019