Model Similarity Mitigates Test Set Overuse

Model Similarity Mitigates Test Set Overuse

29 May 2019

Benjamin Recht

Papers citing "Model Similarity Mitigates Test Set Overuse"

18 / 18 papers shown

Title
Limits to scalable evaluation at the frontier: LLM as Judge won't beat twice the data Florian E. Dorner Vivian Y. Nastl Moritz Hardt ELM ALM 42 5 0 17 Oct 2024
How Much Can We Forget about Data Contamination? Sebastian Bordt Suraj Srinivas Valentyn Boreiko U. V. Luxburg 45 1 0 04 Oct 2024
On Statistical Learning of Branch and Bound for Vehicle Routing Optimization Andrew Naguib Waleed A. Yousef Issa Traoré Mohammed Mamun 12 0 0 15 Oct 2023
Pathologies of Predictive Diversity in Deep Ensembles Taiga Abe E. Kelly Buchanan Geoff Pleiss John P. Cunningham UQCV 38 13 0 01 Feb 2023
ModelDiff: A Framework for Comparing Learning Algorithms Harshay Shah Sung Min Park Andrew Ilyas A. Madry SyDa 51 26 0 22 Nov 2022
Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning Olivia Wiles Isabela Albuquerque Sven Gowal VLM 30 46 0 18 Aug 2022
When does dough become a bagel? Analyzing the remaining mistakes on ImageNet Vijay Vasudevan Benjamin Caine Raphael Gontijo-Lopes Sara Fridovich-Keil Rebecca Roelofs VLM UQCV 35 57 0 09 May 2022
Sequential algorithmic modification with test data reuse Jean Feng Gene Pennello N. Petrick B. Sahiner Romain Pirracchio Alexej Gossmann 14 4 0 21 Mar 2022
Datamodels: Predicting Predictions from Training Data Andrew Ilyas Sung Min Park Logan Engstrom Guillaume Leclerc A. Madry TDI 35 130 0 01 Feb 2022
When Neural Networks Using Different Sensors Create Similar Features Hugues Moreau A. Vassilev Liming Luke Chen 22 0 0 04 Nov 2021
No One Representation to Rule Them All: Overlapping Features of Training Methods Raphael Gontijo-Lopes Yann N. Dauphin E. D. Cubuk 18 60 0 20 Oct 2021
Spectral Bias in Practice: The Role of Function Frequency in Generalization Sara Fridovich-Keil Raphael Gontijo-Lopes Rebecca Roelofs 35 28 0 06 Oct 2021
The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning Anders Andreassen Yasaman Bahri Behnam Neyshabur Rebecca Roelofs OOD OODD 22 78 0 30 Jun 2021
Partial success in closing the gap between human and machine vision Robert Geirhos Kantharaju Narayanappa Benjamin Mitzkus Tizian Thieringer Matthias Bethge Felix Wichmann Wieland Brendel VLM AAML 40 221 0 14 Jun 2021
Why do classifier accuracies show linear trends under distribution shift? Horia Mania S. Sra OOD 29 19 0 31 Dec 2020
Beyond accuracy: quantifying trial-by-trial behaviour of CNNs and humans by measuring error consistency Robert Geirhos Kristof Meding Felix Wichmann 6 116 0 30 Jun 2020
Mix and Match: An Optimistic Tree-Search Approach for Learning Models from Mixture Distributions Matthew Faw Rajat Sen Karthikeyan Shanmugam C. Caramanis Sanjay Shakkottai 28 3 0 23 Jul 2019
Detecting Overfitting via Adversarial Examples Roman Werpachowski András Gyorgy Csaba Szepesvári TDI 18 45 0 06 Mar 2019