Papers citing 'Computing the Testing Error without a Testing Set'

Title
Confidence and Dispersity as Signals: Unsupervised Model Evaluation and Ranking Weijian Deng Weijie Tu Ibrahim Radwan Mohammad Abu Alsheikh Stephen Gould Liang Zheng 96 0 0 03 Oct 2025
Is Supervised Learning Really That Different from Unsupervised? Oskar Allerbo Thomas B. Schön OOD SSL 442 0 0 16 May 2025
Early Stopping Against Label Noise Without Validation DataInternational Conference on Learning Representations (ICLR), 2025 Suqin Yuan Lei Feng Tongliang Liu NoLa 520 30 0 11 Feb 2025
Towards Scalable and Versatile Weight Space LearningInternational Conference on Machine Learning (ICML), 2024 Konstantin Schurholt Michael W. Mahoney Damian Borth 199 27 0 14 Jun 2024
Bounding Box Stability against Feature Dropout Reflects Detector Generalization across Environments Yang Yang Wenhai Wang Zhe Chen Jifeng Dai Liang Zheng 144 6 0 20 Mar 2024
Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress Christian Schroeder de Witt Vishaal Udandarao Juil Sock Matthias Bethge Adel Bibi Samuel Albanie 198 3 0 29 Feb 2024
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift Renchunzi Xie Ambroise Odonnat Vasilii Feofanov I. Redko Jianfeng Zhang Bo An UQCV 365 2 0 17 Jan 2024
Notes on Applicability of Explainable AI Methods to Machine Learning Models Using Features Extracted by Persistent Homology Naofumi Hama 179 0 0 15 Oct 2023
ProtoKD: Learning from Extremely Scarce Data for Parasite Ova RecognitionInternational Conference on Machine Learning and Applications (ICMLA), 2023 Shubham Trehan U. Ramachandran Ruth Scimeca Sathyanarayanan N. Aakur 136 1 0 18 Sep 2023
Anchor Points: Benchmarking Models with Much Fewer ExamplesConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Rajan Vivek Kawin Ethayarajh Diyi Yang Douwe Kiela ALM 276 41 0 14 Sep 2023
CAME: Contrastive Automated Model EvaluationIEEE International Conference on Computer Vision (ICCV), 2023 Ru Peng Qiuyang Duan Haobo Wang Jiachen Ma Yanbo Jiang Yongjun Tu Xiu Jiang Jiaqi Zhao ELM 195 8 0 22 Aug 2023
Decorrelating neurons using persistence Rubén Ballester Carles Casacuberta Sergio Escalera 158 1 0 09 Aug 2023
Addressing caveats of neural persistence with deep graph persistence Leander Girrbach Anders Christensen Ole Winther Zeynep Akata A. Sophia Koepke GNN 295 1 0 20 Jul 2023
NAR-Former V2: Rethinking Transformer for Universal Neural Network Representation LearningNeural Information Processing Systems (NeurIPS), 2023 Yun Yi Haokui Zhang Rong Xiao Nan Wang Xiaoyu Wang GNN 285 6 0 19 Jun 2023
Deep neural networks architectures from the perspective of manifold learning German Magai AAML AI4CE 133 9 0 06 Jun 2023
Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models D. Honegger Konstantin Schurholt Damian Borth 204 5 0 26 Apr 2023
Toward Auto-evaluation with Confidence-based Category Relation-aware RegressionIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 Jiexin Wang Jiahao Chen Fuchun Sun 179 2 0 17 Apr 2023
K-means Clustering Based Feature Consistency Alignment for Label-free Model Evaluation Shuyu Miao Lin Zheng Qingbin Liu and Hong Jin 167 8 0 17 Apr 2023
On the Importance of Feature Separability in Predicting Out-Of-Distribution ErrorNeural Information Processing Systems (NeurIPS), 2023 Renchunzi Xie Jianguo Huang Lei Feng Yuzhou Cao Bo An OODD OOD 194 15 0 27 Mar 2023
Importance attribution in neural networks by means of persistence landscapes of time series Aina Ferrà Carles Casacuberta O. Pujol AI4TS 158 5 0 06 Feb 2023
Generalization Bounds with Data-dependent Fractal DimensionsInternational Conference on Machine Learning (ICML), 2023 Benjamin Dupuis George Deligiannidis Umut cSimcsekli AI4CE 166 16 0 06 Feb 2023
Confidence and Dispersity Speak: Characterising Prediction Matrix for Unsupervised Accuracy EstimationInternational Conference on Machine Learning (ICML), 2023 Weijian Deng Yumin Suh Stephen Gould Liang Zheng UQCV 257 20 0 02 Feb 2023
Approaching Peak Ground TruthIEEE International Symposium on Biomedical Imaging (ISBI), 2022 Florian Kofler J. Wahle Ivan Ezhov S. J. Wagner Rami Al-Maskari ... Jan Kirschke C. Zimmer Benedikt Wiestler Bjoern Menze Marie Piraud 153 13 0 31 Dec 2022
An Information-Theoretic Approach for Estimating Scenario Generalization in Crowd Motion Prediction Gang Qiao Kaidong Hu Seonghyeon Moon Samuel S. Sohn Sejong Yoon Mubbasir Kapadia Vladimir Pavlovic 147 0 0 02 Nov 2022
Model Zoos: A Dataset of Diverse Populations of Neural Network ModelsNeural Information Processing Systems (NeurIPS), 2022 Konstantin Schurholt Diyar Taskiran Boris Knyazev Xavier Giró-i-Nieto Damian Borth 265 35 0 29 Sep 2022
Improving Self-supervised Learning for Out-of-distribution Task via Auxiliary ClassifierInternational Conference on Information Photonics (ICIP), 2022 Harshita Boonlia T. Dam Md Meftahul Ferdaus S. Anavatti Ankan Mullick OODD 164 5 0 07 Sep 2022
On the Strong Correlation Between Model Invariance and GeneralizationNeural Information Processing Systems (NeurIPS), 2022 Weijian Deng Stephen Gould Liang Zheng OOD 181 24 0 14 Jul 2022
Betti numbers of attention graphs is all you really need Laida Kushnareva D. Piontkovski Irina Piontkovskaya GNN 106 2 0 05 Jul 2022
BERTops: Studying BERT Representations under a Topological LensIEEE International Joint Conference on Neural Network (IJCNN), 2022 Jatin Chauhan Manohar Kaul 166 4 0 02 May 2022
Topology and geometry of data manifold in deep learning German Magai A. Ayzenberg AAML 135 13 0 19 Apr 2022
Exploiting Explainable Metrics for Augmented SGDComputer Vision and Pattern Recognition (CVPR), 2022 Mahdi S. Hosseini Mathieu Tuli Konstantinos N. Plataniotis AAML 128 3 0 31 Mar 2022
Predicting the generalization gap in neural networks using topological data analysisNeurocomputing (Neurocomputing), 2022 Rubén Ballester Xavier Arnal Clemente Carles Casacuberta Meysam Madadi C. Corneanu Sergio Escalera 196 6 0 23 Mar 2022
When do GANs replicate? On the choice of dataset sizeIEEE International Conference on Computer Vision (ICCV), 2021 Qianli Feng Chen Guo Fabian Benitez-Quiroz Aleix M. Martinez 349 60 0 23 Feb 2022
Label-Free Model Evaluation with Semi-Structured Dataset Representations Xiaoxiao Sun Yunzhong Hou Hongdong Li Liang Zheng 147 12 0 01 Dec 2021
Leveraging The Topological Consistencies of Learning in Deep Neural Networks Stuart Synakowski Fabian Benitez-Quiroz Aleix M. Martinez 95 0 0 30 Nov 2021
Intrinsic Dimension, Persistent Homology and Generalization in Neural NetworksNeural Information Processing Systems (NeurIPS), 2021 Tolga Birdal Aaron Lou Leonidas Guibas Umut cSimcsekli 171 82 0 25 Nov 2021
Hyper-Representations: Self-Supervised Representation Learning on Neural Network Weights for Model Characteristic Prediction Konstantin Schurholt Dimche Kostadinov Damian Borth SSL 368 16 0 28 Oct 2021
In Search of Probeable Generalization MeasuresInternational Conference on Machine Learning and Applications (ICMLA), 2021 Jonathan Jaegerman Khalil Damouni M. M. Ankaralı Konstantinos N. Plataniotis 121 2 0 23 Oct 2021
Artificial Text Detection via Examining the Topology of Attention MapsConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Laida Kushnareva D. Cherniavskii Vladislav Mikhailov Ekaterina Artemova S. Barannikov A. Bernstein Irina Piontkovskaya D. Piontkovski Evgeny Burnaev 192 56 0 10 Sep 2021
Ranking Models in Unlabeled New EnvironmentsIEEE International Conference on Computer Vision (ICCV), 2021 Xiaoxiao Sun Yunzhong Hou Weijian Deng Hongdong Li Liang Zheng OOD 140 9 0 23 Aug 2021
Shift-Curvature, SGD, and Generalization Arwen V. Bradley C. Gomez-Uribe Manish Reddy Vuyyuru 259 3 0 21 Aug 2021
Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples Xuanyu Wu Xuhong Li Haoyi Xiong Xiao Zhang Siyu Huang Dejing Dou 84 1 0 20 Jun 2021
Topological Detection of Trojaned Neural NetworksNeural Information Processing Systems (NeurIPS), 2021 Songzhu Zheng Yikai Zhang H. Wagner Mayank Goswami Chao Chen AAML 148 45 0 11 Jun 2021
What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments?International Conference on Machine Learning (ICML), 2021 Weijian Deng Stephen Gould Liang Zheng 167 69 0 10 Jun 2021
Persistent Homology Captures the Generalization of Neural Networks Without A Validation Set Asier Gutiérrez-Fandiño David Pérez-Fernández Jordi Armengol-Estapé Marta Villegas 185 3 0 31 May 2021
Synthetic Data for Model SelectionInternational Conference on Machine Learning (ICML), 2021 Alon Shoshan Nadav Bhonker Igor Kviatkovsky Matan Fintz Gérard Medioni 138 7 0 03 May 2021
Characterizing and Measuring the Similarity of Neural Networks with Persistent Homology David Pérez-Fernández Asier Gutiérrez-Fandiño Jordi Armengol-Estapé Marta Villegas 173 7 0 19 Jan 2021
Leave Zero Out: Towards a No-Cross-Validation Approach for Model Selection Weikai Li Chuanxing Geng Songcan Chen 247 15 0 24 Dec 2020
Are Labels Always Necessary for Classifier Accuracy Evaluation? Weijian Deng Liang Zheng 226 129 0 06 Jul 2020

Confidence and Dispersity as Signals: Unsupervised Model Evaluation and Ranking

96

0

03 Oct 2025

Is Supervised Learning Really That Different from Unsupervised?

Oskar Allerbo

Thomas B. Schön

OOD SSL

442

0

16 May 2025

Early Stopping Against Label Noise Without Validation DataInternational Conference on Learning Representations (ICLR), 2025

520

30

0

11 Feb 2025

Towards Scalable and Versatile Weight Space LearningInternational Conference on Machine Learning (ICML), 2024

Konstantin Schurholt

Michael W. Mahoney

Damian Borth

199

27

0

14 Jun 2024

Bounding Box Stability against Feature Dropout Reflects Detector Generalization across Environments

Liang Zheng

144

6

0

20 Mar 2024

Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress

Christian Schroeder de Witt

198

3

0

29 Feb 2024

Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift

365

2

0

17 Jan 2024

Notes on Applicability of Explainable AI Methods to Machine Learning Models Using Features Extracted by Persistent Homology

Naofumi Hama

179

0

15 Oct 2023

ProtoKD: Learning from Extremely Scarce Data for Parasite Ova RecognitionInternational Conference on Machine Learning and Applications (ICMLA), 2023

Shubham Trehan

U. Ramachandran

Ruth Scimeca

Sathyanarayanan N. Aakur

136

1

0

18 Sep 2023

Anchor Points: Benchmarking Models with Much Fewer ExamplesConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023

Douwe Kiela

276

41

0

14 Sep 2023