Revisiting the Calibration of Modern Neural Networks

15 June 2021

Papers citing "Revisiting the Calibration of Modern Neural Networks"

50 / 69 papers shown

Title
Optimizing Estimators of Squared Calibration Errors in Classification Sebastian G. Gruber Francis Bach 69 1 0 24 Feb 2025
Interpretable Failure Detection with Human-Level Concepts Kien X. Nguyen Tang Li Xi Peng 48 0 0 07 Feb 2025
Rethinking Early Stopping: Refine, Then Calibrate Eugene Berta David Holzmüller Michael I. Jordan Francis Bach 67 0 0 31 Jan 2025
Pretraining with random noise for uncertainty calibration Jeonghwan Cheon Se-Bum Paik OnRL 41 0 0 23 Dec 2024
Distribution Shifts at Scale: Out-of-distribution Detection in Earth Observation Burak Ekim G. Tadesse Caleb Robinson G. Q. Hacheme Michael Schmitt Rahul Dodhia J. L. Ferres OODD 91 1 0 18 Dec 2024
Confidence Calibration of Classifiers with Many Classes Adrien LeCoz Stéphane Herbin Faouzi Adjed UQCV 33 1 0 05 Nov 2024
On Calibration of LLM-based Guard Models for Reliable Content Moderation Hongfu Liu Hengguan Huang Hao Wang Xiangming Gu Ye Wang 53 2 0 14 Oct 2024
Taming Overconfidence in LLMs: Reward Calibration in RLHF Jixuan Leng Chengsong Huang Banghua Zhu Jiaxin Huang 26 7 0 13 Oct 2024
Can Language Model Understand Word Semantics as A Chatbot? An Empirical Study of Language Model Internal External Mismatch Jinman Zhao Xueyan Zhang Xingyu Yue Weizhe Chen Zifan Qian Ruiyu Wang LRM 34 0 0 21 Sep 2024
CALICO: Confident Active Learning with Integrated Calibration L. S. Querol Hajime Nagahara Hideaki Hayashi 21 0 0 02 Jul 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 32 0 0 14 Jun 2024
Reassessing How to Compare and Improve the Calibration of Machine Learning Models M. Chidambaram Rong Ge 63 1 0 06 Jun 2024
Orthogonal Causal Calibration Justin Whitehouse Christopher Jung Vasilis Syrgkanis Bryan Wilder Zhiwei Steven Wu CML 114 1 0 04 Jun 2024
Do not trust what you trust: Miscalibration in Semi-supervised Learning Shambhavi Mishra Balamurali Murugesan Ismail Ben Ayed M. Pedersoli Jose Dolz 43 2 0 22 Mar 2024
Class and Region-Adaptive Constraints for Network Calibration Balamurali Murugesan Julio Silva-Rodríguez Ismail Ben Ayed Jose Dolz 32 1 0 19 Mar 2024
Revisiting Confidence Estimation: Towards Reliable Failure Prediction Fei Zhu Xu-Yao Zhang Zhen Cheng Cheng-Lin Liu UQCV 44 10 0 05 Mar 2024
Towards Calibrated Deep Clustering Network Yuheng Jia Jianhong Cheng Hui Liu Junhui Hou UQCV 45 1 0 04 Mar 2024
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift Renchunzi Xie Ambroise Odonnat Vasilii Feofanov I. Redko Jianfeng Zhang Bo An UQCV 70 1 0 17 Jan 2024
Understanding the Effects of Projectors in Knowledge Distillation Yudong Chen Sen Wang Jiajun Liu Xuwei Xu Frank de Hoog Brano Kusy Zi Huang 21 0 0 26 Oct 2023
Distributionally Robust Statistical Verification with Imprecise Neural Networks Souradeep Dutta Michele Caprio Vivian Lin Matthew Cleaveland Kuk Jin Jang I. Ruchkin O. Sokolsky Insup Lee OOD AAML 49 7 0 28 Aug 2023
An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration Hiroki Naganuma Ryuichiro Hataya Kotaro Yoshida Ioannis Mitliagkas OODD 84 1 0 17 Jul 2023
Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar Runwei Guan Shanliang Yao Xiaohui Zhu Ka Lok Man Eng Gee Lim Jeremy S. Smith Yong 0001Yue Yutao Yue VOS 24 16 0 14 Jul 2023
Set Learning for Accurate and Calibrated Models Lukas Muttenthaler Robert A. Vandermeulen Qiuyi Zhang Thomas Unterthiner Klaus-Robert Muller 26 2 0 05 Jul 2023
Deep neural networks architectures from the perspective of manifold learning German Magai AAML AI4CE 16 6 0 06 Jun 2023
On the Limitations of Temperature Scaling for Distributions with Overlaps Muthuraman Chidambaram Rong Ge UQCV 31 4 0 01 Jun 2023
Utility-Probability Duality of Neural Networks Bojun Huang Fei Yuan UQCV 25 1 0 24 May 2023
Revisiting Single-gated Mixtures of Experts Amelie Royer I. Karmanov Andrii Skliar B. Bejnordi Tijmen Blankevoort MoE MoMe 25 6 0 11 Apr 2023
Rethinking Confidence Calibration for Failure Prediction Fei Zhu Zhen Cheng Xu-Yao Zhang Cheng-Lin Liu UQCV 14 39 0 06 Mar 2023
Distilling Calibrated Student from an Uncalibrated Teacher Ishan Mishra Sethu Vamsi Krishna Deepak Mishra FedML 32 2 0 22 Feb 2023
Uncertainty-Aware AB3DMOT by Variational 3D Object Detection Illia Oleksiienko Alexandros Iosifidis 3DPC 25 1 0 12 Feb 2023
Scaling Vision Transformers to 22 Billion Parameters Mostafa Dehghani Josip Djolonga Basil Mustafa Piotr Padlewski Jonathan Heek ... Mario Luvcić Xiaohua Zhai Daniel Keysers Jeremiah Harmsen N. Houlsby MLLM 61 569 0 10 Feb 2023
CHiLS: Zero-Shot Image Classification with Hierarchical Label Sets Zachary Novack Julian McAuley Zachary Chase Lipton Saurabh Garg VLM 19 79 0 06 Feb 2023
How to select predictive models for causal inference? M. Doutreligne Gaël Varoquaux ELM CML 21 2 0 01 Feb 2023
Annealing Double-Head: An Architecture for Online Calibration of Deep Neural Networks Erdong Guo D. Draper Maria de Iorio 29 0 0 27 Dec 2022
Investigating Deep Learning Model Calibration for Classification Problems in Mechanics S. Mohammadzadeh Peerasait Prachaseree Emma Lejeune AI4CE 31 2 0 01 Dec 2022
A Unifying Theory of Distance from Calibration Jarosław Błasiok Parikshit Gopalan Lunjia Hu Preetum Nakkiran 31 32 0 30 Nov 2022
Promises and Pitfalls of Threshold-based Auto-labeling Harit Vishwakarma Heguang Lin Frederic Sala Ramya Korlakai Vinayak 26 9 0 22 Nov 2022
Calibrated Interpretation: Confidence Estimation in Semantic Parsing Elias Stengel-Eskin Benjamin Van Durme UQLM 32 24 0 14 Nov 2022
Federated Calibration and Evaluation of Binary Classifiers Graham Cormode Igor L. Markov FedML 33 4 0 22 Oct 2022
Curved Representation Space of Vision Transformers Juyeop Kim Junha Park Songkuk Kim Jongseok Lee ViT 28 6 0 11 Oct 2022
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis Yuxin Xiao Paul Pu Liang Umang Bhatt W. Neiswanger Ruslan Salakhutdinov Louis-Philippe Morency 175 86 0 10 Oct 2022
Transfer Learning with Pretrained Remote Sensing Transformers A. Fuller K. Millard J.R. Green 25 11 0 28 Sep 2022
Neural Clamping: Joint Input Perturbation and Temperature Scaling for Neural Network Calibration Yu Tang Pin-Yu Chen Tsung-Yi Ho 18 5 0 23 Sep 2022
Extremely Simple Activation Shaping for Out-of-Distribution Detection Andrija Djurisic Nebojsa Bozanic Arjun Ashok Rosanne Liu OODD 164 150 0 20 Sep 2022
Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Survey S. Sun AI4CE 30 10 0 08 Sep 2022
Calibrated Selective Classification Adam Fisch Tommi Jaakkola Regina Barzilay 21 16 0 25 Aug 2022
Adaptive Temperature Scaling for Robust Calibration of Deep Neural Networks Sérgio A. Balanya Juan Maroñas Daniel Ramos OOD 35 13 0 31 Jul 2022
An Impartial Take to the CNN vs Transformer Robustness Contest Francesco Pinto Philip H. S. Torr P. Dokania UQCV AAML 22 48 0 22 Jul 2022
Assaying Out-Of-Distribution Generalization in Transfer Learning F. Wenzel Andrea Dittadi Peter V. Gehler Carl-Johann Simon-Gabriel Max Horn ... Chris Russell Thomas Brox Bernt Schiele Bernhard Schölkopf Francesco Locatello OOD OODD AAML 49 71 0 19 Jul 2022
Estimating Test Performance for AI Medical Devices under Distribution Shift with Conformal Prediction Charles Lu Syed Rakin Ahmed Praveer Singh Jayashree Kalpathy-Cramer OOD 25 5 0 12 Jul 2022