Metadata Archaeology: Unearthing Data Subsets by Leveraging Training
Dynamics

Metadata Archaeology: Unearthing Data Subsets by Leveraging Training Dynamics

20 September 2022

Shoaib Ahmed Siddiqui

Nitarshan Rajkumar

David M. Krueger

Papers citing "Metadata Archaeology: Unearthing Data Subsets by Leveraging Training Dynamics"

12 / 12 papers shown

Title
Unifying Grokking and Double Descent Peter W. Battaglia David Raposo Kelsey 17 31 0 10 Mar 2023
The Value of Out-of-Distribution Data Ashwin De Silva Rahul Ramesh Carey E. Priebe Pratik Chaudhari Joshua T. Vogelstein OODD 9 10 0 23 Aug 2022
The Low-Resource Double Bind: An Empirical Study of Pruning for Low-Resource Machine Translation Orevaoghene Ahia Julia Kreutzer Sara Hooker 102 50 0 06 Oct 2021
Training Dynamic based data filtering may not work for NLP datasets Arka Talukdar Monika Dagar Prachi Gupta Varun G. Menon NoLa 21 3 0 19 Sep 2021
When does loss-based prioritization fail? Nie Hu Xinyu Hu Rosanne Liu Sara Hooker J. Yosinski 161 8 0 16 Jul 2021
Core-set Sampling for Efficient Neural Architecture Search Jaewoong Shim Kyeongbo Kong Suk-Ju Kang 112 23 0 08 Jul 2021
Beyond Fair Pay: Ethical Implications of NLP Crowdsourcing Boaz Shmueli Jan Fell Soumya Ray Lun-Wei Ku 100 86 0 20 Apr 2021
Learning Light-Weight Translation Models from Deep Transformer Bei Li Ziyang Wang Hui Liu Quan Du Tong Xiao Chunliang Zhang Jingbo Zhu VLM 112 39 0 27 Dec 2020
When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning? Gavin Brown Mark Bun Vitaly Feldman Adam D. Smith Kunal Talwar 245 80 0 11 Dec 2020
Estimating Example Difficulty Using Variance of Gradients Chirag Agarwal Daniel D'souza Sara Hooker 190 103 0 26 Aug 2020
An Investigation of Why Overparameterization Exacerbates Spurious Correlations Shiori Sagawa Aditi Raghunathan Pang Wei Koh Percy Liang 144 368 0 09 May 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 220 4,424 0 23 Jan 2020