ResearchTrend.AI
Active Testing: Sample-Efficient Model Evaluation

Active Testing: Sample-Efficient Model Evaluation

Jannik Kossen
Sebastian Farquhar
Y. Gal
Tom Rainforth
    VLM
ArXivPDFHTML

Papers citing "Active Testing: Sample-Efficient Model Evaluation"

12 / 12 papers shown
Title
Incremental Uncertainty-aware Performance Monitoring with Active Labeling Intervention
Incremental Uncertainty-aware Performance Monitoring with Active Labeling Intervention
Alexander Koebler
Thomas Decker
Ingo Thon
Volker Tresp
Florian Buettner
29
0
0
11 May 2025
Efficient Evaluation of Multi-Task Robot Policies With Active Experiment Selection
Efficient Evaluation of Multi-Task Robot Policies With Active Experiment Selection
Abrar Anwar
Rohan Gupta
Zain Merchant
Sayan Ghosh
Willie Neiswanger
Jesse Thomason
OffRL
67
1
0
14 Feb 2025
Novel Deep Neural Network Classifier Characterization Metrics with Applications to Dataless Evaluation
Novel Deep Neural Network Classifier Characterization Metrics with Applications to Dataless Evaluation
Nathaniel R. Dean
Dilip Sarkar
35
0
0
17 Jul 2024
Direct Acquisition Optimization for Low-Budget Active Learning
Direct Acquisition Optimization for Low-Budget Active Learning
Zhuokai Zhao
Yibo Jiang
Yuxin Chen
39
1
0
08 Feb 2024
Train ñ Trade: Foundations of Parameter Markets
Train ñ Trade: Foundations of Parameter Markets
Tzu-Heng Huang
Harit Vishwakarma
Frederic Sala
AIFin
32
2
0
07 Dec 2023
Anchor Points: Benchmarking Models with Much Fewer Examples
Anchor Points: Benchmarking Models with Much Fewer Examples
Rajan Vivek
Kawin Ethayarajh
Diyi Yang
Douwe Kiela
ALM
29
22
0
14 Sep 2023
Modern Bayesian Experimental Design
Modern Bayesian Experimental Design
Tom Rainforth
Adam Foster
Desi R. Ivanova
Freddie Bickford-Smith
37
77
0
28 Feb 2023
An Efficient Framework for Monitoring Subgroup Performance of Machine Learning Systems
An Efficient Framework for Monitoring Subgroup Performance of Machine Learning Systems
Huong Ha
19
0
0
16 Dec 2022
Promises and Pitfalls of Threshold-based Auto-labeling
Promises and Pitfalls of Threshold-based Auto-labeling
Harit Vishwakarma
Heguang Lin
Frederic Sala
Ramya Korlakai Vinayak
34
9
0
22 Nov 2022
Aura: Privacy-preserving Augmentation to Improve Test Set Diversity in Speech Enhancement
Aura: Privacy-preserving Augmentation to Improve Test Set Diversity in Speech Enhancement
Xavier Gitiaux
Aditya Khant
Ebrahim Beyrami
Chandan K. A. Reddy
J. Gupchup
Ross Cutler
22
0
0
08 Oct 2021
Sample Efficient Model Evaluation
Sample Efficient Model Evaluation
Emine Yilmaz
Peter Hayes
Raza Habib
Jordan Burgess
David Barber
49
3
0
24 Sep 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Balaji Lakshminarayanan
Alexander Pritzel
Charles Blundell
UQCV
BDL
276
5,675
0
05 Dec 2016