Active Testing: Sample-Efficient Model Evaluation

Active Testing: Sample-Efficient Model Evaluation

9 March 2021

Sebastian Farquhar

Papers citing "Active Testing: Sample-Efficient Model Evaluation"

13 / 13 papers shown

Title
When to retrain a machine learning model Regol Florence Schwinn Leo Sprague Kyle Coates Mark Markovich Thomas OffRL 7 0 0 20 May 2025
Incremental Uncertainty-aware Performance Monitoring with Active Labeling Intervention Alexander Koebler Thomas Decker Ingo Thon Volker Tresp Florian Buettner 31 0 0 11 May 2025
Efficient Evaluation of Multi-Task Robot Policies With Active Experiment Selection Abrar Anwar Rohan Gupta Zain Merchant Sayan Ghosh Willie Neiswanger Jesse Thomason OffRL 69 1 0 14 Feb 2025
Novel Deep Neural Network Classifier Characterization Metrics with Applications to Dataless Evaluation Nathaniel R. Dean Dilip Sarkar 35 0 0 17 Jul 2024
Direct Acquisition Optimization for Low-Budget Active Learning Zhuokai Zhao Yibo Jiang Yuxin Chen 39 1 0 08 Feb 2024
Train ñ Trade: Foundations of Parameter Markets Tzu-Heng Huang Harit Vishwakarma Frederic Sala AIFin 32 2 0 07 Dec 2023
Anchor Points: Benchmarking Models with Much Fewer Examples Rajan Vivek Kawin Ethayarajh Diyi Yang Douwe Kiela ALM 29 22 0 14 Sep 2023
Modern Bayesian Experimental Design Tom Rainforth Adam Foster Desi R. Ivanova Freddie Bickford-Smith 37 78 0 28 Feb 2023
An Efficient Framework for Monitoring Subgroup Performance of Machine Learning Systems Huong Ha 19 0 0 16 Dec 2022
Promises and Pitfalls of Threshold-based Auto-labeling Harit Vishwakarma Heguang Lin Frederic Sala Ramya Korlakai Vinayak 34 9 0 22 Nov 2022
Aura: Privacy-preserving Augmentation to Improve Test Set Diversity in Speech Enhancement Xavier Gitiaux Aditya Khant Ebrahim Beyrami Chandan K. A. Reddy J. Gupchup Ross Cutler 22 0 0 08 Oct 2021
Sample Efficient Model Evaluation Emine Yilmaz Peter Hayes Raza Habib Jordan Burgess David Barber 56 3 0 24 Sep 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,683 0 05 Dec 2016