Predicting with Confidence on Unseen Distributions

7 July 2021

Papers citing "Predicting with Confidence on Unseen Distributions"

21 / 21 papers shown

Title
Incremental Uncertainty-aware Performance Monitoring with Active Labeling Intervention Alexander Koebler Thomas Decker Ingo Thon Volker Tresp Florian Buettner 29 0 0 11 May 2025
Performance Estimation in Binary Classification Using Calibrated Confidence Juhani Kivimäki Jakub Białek W. Kuberski J. Nurminen 48 0 0 08 May 2025
Unveiling AI's Blind Spots: An Oracle for In-Domain, Out-of-Domain, and Adversarial Errors Shuangpeng Han Mengmi Zhang 116 0 0 03 Oct 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 37 0 0 14 Jun 2024
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift Renchunzi Xie Ambroise Odonnat Vasilii Feofanov I. Redko Jianfeng Zhang Bo An UQCV 72 1 0 17 Jan 2024
Estimating Model Performance Under Covariate Shift Without Labels Jakub Bialek W. Kuberski Nikolaos Perrakis Albert Bifet 31 2 0 16 Jan 2024
Estimating Large Language Model Capabilities without Labeled Test Data Harvey Yiyun Fu Qinyuan Ye Albert Xu Xiang Ren Robin Jia 21 8 0 24 May 2023
C-SFDA: A Curriculum Learning Aided Self-Training Framework for Efficient Source Free Domain Adaptation Nazmul Karim Niluthpol Chowdhury Mithun Abhinav Rajvanshi Han-Pang Chiu S. Samarasekera Nazanin Rahnavard TTA 21 56 0 30 Mar 2023
A Bag-of-Prototypes Representation for Dataset-Level Applications Wei-Chih Tu Weijian Deng Tom Gedeon Liang Zheng 38 9 0 23 Mar 2023
Realistic Conversational Question Answering with Answer Selection based on Calibrated Confidence and Uncertainty Measurement Soyeong Jeong Jinheon Baek Sung Ju Hwang Jong C. Park 27 2 0 10 Feb 2023
Demystifying Disagreement-on-the-Line in High Dimensions Dong-Hwan Lee Behrad Moniri Xinmeng Huang Edgar Dobriban Hamed Hassani 21 8 0 31 Jan 2023
Transfer Learning with Pretrained Remote Sensing Transformers A. Fuller K. Millard J.R. Green 27 11 0 28 Sep 2022
HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions Lingjiao Chen Zhihua Jin Sabri Eyuboglu Christopher Ré Matei A. Zaharia James Y. Zou 45 9 0 18 Sep 2022
Estimating Model Performance under Domain Shifts with Class-Specific Confidence Scores Zeju Li Konstantinos Kamnitsas Mobarakol Islam Chen Chen Ben Glocker 22 9 0 20 Jul 2022
On the Strong Correlation Between Model Invariance and Generalization Weijian Deng Stephen Gould Liang Zheng OOD 32 16 0 14 Jul 2022
Estimating Test Performance for AI Medical Devices under Distribution Shift with Conformal Prediction Charles Lu Syed Rakin Ahmed Praveer Singh Jayashree Kalpathy-Cramer OOD 25 5 0 12 Jul 2022
Label-Free Model Evaluation with Semi-Structured Dataset Representations Xiaoxiao Sun Yunzhong Hou Hongdong Li Liang Zheng 13 11 0 01 Dec 2021
Detecting Errors and Estimating Accuracy on Unlabeled Data with Self-training Ensembles Jiefeng Chen Frederick Liu Besim Avci Xi Wu Yingyu Liang S. Jha 24 60 0 29 Jun 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 270 5,660 0 05 Dec 2016
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 297 10,216 0 16 Nov 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 285 9,136 0 06 Jun 2015