Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration

28 October 2019

Meelis Kull

Miquel Perelló Nieto

Markus Kängsepp

Telmo de Menezes e Silva Filho

Papers citing "Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration"

50 / 78 papers shown

Title
Restoring Calibration for Aligned Large Language Models: A Calibration-Aware Fine-Tuning Approach Jiancong Xiao Bojian Hou Zhanliang Wang Ruochen Jin Q. Long Weijie Su Li Shen 30 0 0 04 May 2025
Three Types of Calibration with Properties and their Semantic and Formal Relationships Rabanus Derr Jessie Finocchiaro Robert C. Williamson 38 0 0 25 Apr 2025
Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review Toghrul Abbasli Kentaroh Toyoda Yuan Wang Leon Witt Muhammad Asif Ali Yukai Miao Dan Li Qingsong Wei UQCV 87 0 0 25 Apr 2025
MBCT: Tree-Based Feature-Aware Binning for Individual Uncertainty Calibration Siguang Huang Yunli Wang Lili Mou Huayue Zhang Han Zhu Chuan Yu Bo Zheng 58 15 0 13 Mar 2025
Similarity-Distance-Magnitude Universal Verification Allen Schmaltz UQCV AAML 124 0 0 27 Feb 2025
Optimizing Estimators of Squared Calibration Errors in Classification Sebastian G. Gruber Francis Bach 69 1 0 24 Feb 2025
Large Language Model Confidence Estimation via Black-Box Access Tejaswini Pedapati Amit Dhurandhar Soumya Ghosh Soham Dan P. Sattigeri 89 3 0 21 Feb 2025
Understanding the Capabilities and Limitations of Weak-to-Strong Generalization Wei Yao Wenkai Yang Z. Wang Yankai Lin Yong Liu ELM 97 1 0 03 Feb 2025
Rethinking Early Stopping: Refine, Then Calibrate Eugene Berta David Holzmüller Michael I. Jordan Francis Bach 62 0 0 31 Jan 2025
Combining Priors with Experience: Confidence Calibration Based on Binomial Process Modeling Jinzong Dong Zhaohui Jiang Dong Pan Haoyang Yu 56 0 0 14 Dec 2024
Confidence Calibration of Classifiers with Many Classes Adrien LeCoz Stéphane Herbin Faouzi Adjed UQCV 33 1 0 05 Nov 2024
GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networks Dingyi Zhuang Chonghe Jiang Yunhan Zheng Shenhao Wang Jinhua Zhao UQCV 39 0 0 12 Oct 2024
Calibrating Expressions of Certainty Peiqi Wang Barbara D. Lam Yingcheng Liu Ameneh Asgari-Targhi Rameswar Panda W. Wells Tina Kapur Polina Golland 27 1 0 06 Oct 2024
SAUC: Sparsity-Aware Uncertainty Calibration for Spatiotemporal Prediction with Graph Neural Networks Dingyi Zhuang Yuheng Bu Guang Wang Shenhao Wang Jinhua Zhao BDL 32 1 0 13 Sep 2024
Reassessing How to Compare and Improve the Calibration of Machine Learning Models M. Chidambaram Rong Ge 63 1 0 06 Jun 2024
Decoupling of neural network calibration measures D. Wolf Prasannavenkatesh Balaji Alexander Braun Markus Ulrich UQCV 36 3 0 04 Jun 2024
Optimizing Calibration by Gaining Aware of Prediction Correctness Yuchi Liu Lei Wang Yuli Zou James Zou Liang Zheng UQCV 39 1 0 19 Apr 2024
Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding Lingdong Kong Xiang Xu Jun Cen Wenwei Zhang Liang Pan Kai-xiang Chen Ziwei Liu 45 5 0 25 Mar 2024
Revisiting Confidence Estimation: Towards Reliable Failure Prediction Fei Zhu Xu-Yao Zhang Zhen Cheng Cheng-Lin Liu UQCV 44 10 0 05 Mar 2024
AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems Clara Punzi Roberto Pellungrini Mattia Setzu F. Giannotti D. Pedreschi 17 5 0 09 Feb 2024
Prevalidated ridge regression is a highly-efficient drop-in replacement for logistic regression for high-dimensional data Angus Dempster Geoffrey I. Webb Daniel F. Schmidt 24 0 0 28 Jan 2024
Towards Interpretable Classification of Leukocytes based on Deep Learning S. Röhrl Johannes Groll M. Lengl Simon Schumann C. Klenk D. Heim Martin Knopp Oliver Hayden Klaus Diepold 25 2 0 24 Nov 2023
A Baseline Analysis of Reward Models' Ability To Accurately Analyze Foundation Models Under Distribution Shift Will LeVine Benjamin Pikus Tony Chen Sean Hendryx 27 8 0 21 Nov 2023
Temperature-scaling surprisal estimates improve fit to human reading times -- but does it do so for the "right reasons"? Tong Liu Iza vSkrjanec Vera Demberg 40 5 0 15 Nov 2023
Do We Still Need Non-Maximum Suppression? Accurate Confidence Estimates and Implicit Duplication Modeling with IoU-Aware Calibration Johannes Gilg Torben Teepe Fabian Herzog Philipp Wolters Gerhard Rigoll 11 1 0 06 Sep 2023
A Theoretical and Practical Framework for Evaluating Uncertainty Calibration in Object Detection Pedro Conde Rui L. Lopes C. Premebida UQCV 11 1 0 01 Sep 2023
Model Calibration in Dense Classification with Adaptive Label Perturbation Jiawei Liu Changkun Ye Shanpeng Wang Rui-Qing Cui Jing Zhang Kai Zhang Nick Barnes 33 5 0 25 Jul 2023
Set Learning for Accurate and Calibrated Models Lukas Muttenthaler Robert A. Vandermeulen Qiuyi Zhang Thomas Unterthiner Klaus-Robert Muller 26 2 0 05 Jul 2023
Scaling of Class-wise Training Losses for Post-hoc Calibration Seungjin Jung Seung-Woo Seo Yonghyun Jeong Jongwon Choi 29 3 0 19 Jun 2023
On the Limitations of Temperature Scaling for Distributions with Overlaps Muthuraman Chidambaram Rong Ge UQCV 26 4 0 01 Jun 2023
Dual Focal Loss for Calibration Linwei Tao Minjing Dong Chang Xu UQCV 37 26 0 23 May 2023
Minimum-Risk Recalibration of Classifiers Zeyu Sun Dogyoon Song Alfred Hero 28 5 0 18 May 2023
Transfer Knowledge from Head to Tail: Uncertainty Calibration under Long-tailed Distribution Jiahao Chen Bingyue Su 30 10 0 13 Apr 2023
Approaching Test Time Augmentation in the Context of Uncertainty Calibration for Deep Neural Networks Pedro Conde T. Barros Rui L. Lopes C. Premebida U. J. Nunes UQCV 17 7 0 11 Apr 2023
Rethinking Confidence Calibration for Failure Prediction Fei Zhu Zhen Cheng Xu-Yao Zhang Cheng-Lin Liu UQCV 14 39 0 06 Mar 2023
Calibrating a Deep Neural Network with Its Predecessors Linwei Tao Minjing Dong Daochang Liu Changming Sun Chang Xu BDL UQCV 6 5 0 13 Feb 2023
Uncertainty Estimation based on Geometric Separation Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 13 0 0 11 Jan 2023
Annealing Double-Head: An Architecture for Online Calibration of Deep Neural Networks Erdong Guo D. Draper Maria de Iorio 27 0 0 27 Dec 2022
NCTV: Neural Clamping Toolkit and Visualization for Neural Network Calibration Lei Hsiung Yu Tang Pin-Yu Chen Tsung-Yi Ho 12 2 0 29 Nov 2022
AdaFocal: Calibration-aware Adaptive Focal Loss Arindam Ghosh Thomas Schaaf Matthew R. Gormley FedML UQCV 14 25 0 21 Nov 2022
Layer-Stack Temperature Scaling Amr Khalifa Michael C. Mozer Hanie Sedghi Behnam Neyshabur Ibrahim M. Alabdulmohsin 75 2 0 18 Nov 2022
Stop Measuring Calibration When Humans Disagree Joris Baan Wilker Aziz Barbara Plank Raquel Fernández 21 53 0 28 Oct 2022
Calibration tests beyond classification David Widmann Fredrik Lindsten Dave Zachariah 25 17 0 21 Oct 2022
Class-wise and reduced calibration methods Michael Panchenko Anes Benmerzoug Miguel de Benito Delgado 16 0 0 07 Oct 2022
Variable-Based Calibration for Machine Learning Classifiers Mark Kelly Padhraic Smyth 14 4 0 30 Sep 2022
Neural Clamping: Joint Input Perturbation and Temperature Scaling for Neural Network Calibration Yu Tang Pin-Yu Chen Tsung-Yi Ho 18 5 0 23 Sep 2022
Towards Improving Calibration in Object Detection Under Domain Shift Muhammad Akhtar Munir M. H. Khan M. Sarfraz Mohsen Ali 6 22 0 15 Sep 2022
Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Survey S. Sun AI4CE 23 10 0 08 Sep 2022
Calibrated Selective Classification Adam Fisch Tommi Jaakkola Regina Barzilay 21 16 0 25 Aug 2022
Sample-dependent Adaptive Temperature Scaling for Improved Calibration Thomas Joy Francesco Pinto Ser-Nam Lim Philip H. S. Torr P. Dokania UQCV 19 30 0 13 Jul 2022