An Empirical Study of Example Forgetting during Deep Neural Network Learning

12 December 2018

Mariya Toneva

Alessandro Sordoni

Rémi Tachet des Combes

Papers citing "An Empirical Study of Example Forgetting during Deep Neural Network Learning"

50 / 482 papers shown

Title
When Dynamic Data Selection Meets Data Augmentation S. M. I. Simon X. Yang Peng Ye F. Shen Dongzhan Zhou 24 0 0 02 May 2025
Handling Label Noise via Instance-Level Difficulty Modeling and Dynamic Optimization Kuan Zhang Chengliang Chai Jingzhe Xu Chi Zhang Ye Yuan Guoren Wang Lei Cao NoLa 59 0 0 01 May 2025
Identifying Key Challenges of Hardness-Based Resampling Pawel Pukowski Venet Osmani 33 0 0 09 Apr 2025
PEAKS: Selecting Key Training Examples Incrementally via Prediction Error Anchored by Kernel Similarity Mustafa Burak Gurbuz Xingyu Zheng C. Dovrolis OOD 38 0 0 07 Apr 2025
Multivariate Temporal Regression at Scale: A Three-Pillar Framework Combining ML, XAI, and NLP Jiztom Kavalakkatt Francis Matthew J. Darr 32 0 0 02 Apr 2025
Geometric Median Matching for Robust k-Subset Selection from Noisy Data Anish Acharya Sujay Sanghavi Alexandros G. Dimakis Inderjit S Dhillon AAML 57 0 0 01 Apr 2025
Pay More Attention to the Robustness of Prompt for Instruction Data Mining Qiang Wang Dawei Feng Xu Zhang Ao Shen Yang Xu Bo Ding H. Wang AAML 46 0 0 31 Mar 2025
Severing Spurious Correlations with Data Pruning Varun Mulchandani Jung-Eun Kim 144 0 0 24 Mar 2025
Revisiting Automatic Data Curation for Vision Foundation Models in Digital Pathology Boqi Chen Cédric Vincent-Cuaz Lydia A. Schoenpflug Manuel Madeira Lisa Fournier ... D. Thanou V. Koelzer Pascal Frossard Gabriele Campanella Gunnar Rätsch 51 0 0 24 Mar 2025
Squeeze Out Tokens from Sample for Finer-Grained Data Governance Weixiong Lin Chen Ju Haicheng Wang Shengchao Hu Shuai Xiao ... Yuheng Jiao Mingshuai Yao Jinsong Lan Qingwen Liu Ying Chen 50 0 0 18 Mar 2025
Scale Efficient Training for Large Datasets Qing Zhou Junyu Gao Qi Wang DD 75 0 0 17 Mar 2025
A Large-Scale Study on Video Action Dataset Condensation Yang Chen Sheng Guo Bo Zheng Limin Wang DD 77 2 0 13 Mar 2025
Finding the Muses: Identifying Coresets through Loss Trajectories M. Nagaraj Deepak Ravikumar Efstathia Soufleri Kaushik Roy 36 0 0 12 Mar 2025
Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond Qiongxiu Li Xiaoyu Luo Yiyi Chen Johannes Bjerva 45 0 0 10 Mar 2025
Data Efficient Subset Training with Differential Privacy Ninad Jayesh Gandhi Moparthy Venkata Subrahmanya Sri Harsha 53 0 0 09 Mar 2025
PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequence Yunxiao Shi Wujiang Xu Zeqi Zhang Xing Zi Qiang Wu Min Xu 69 0 0 04 Mar 2025
Your Model is Overconfident, and Other Lies We Tell Ourselves Timothee Mickus Aman Sinha Raúl Vázquez 53 0 0 03 Mar 2025
Training-Free Dataset Pruning for Instance Segmentation Yalun Dai Lingao Xiao Ivor W. Tsang Yang He ISeg 48 0 0 02 Mar 2025
Fewer May Be Better: Enhancing Offline Reinforcement Learning with Reduced Dataset Yiqin Yang Quanwei Wang Chenghao Li Hao Hu Chengjie Wu ... Dianyu Zhong Ziyou Zhang Qianchuan Zhao Chongjie Zhang Xu Bo OffRL 47 0 0 26 Feb 2025
Model-agnostic Coreset Selection via LLM-based Concept Bottlenecks Akshay Mehra Trisha Mittal Subhadra Gopalakrishnan Joshua Kimball 43 0 0 23 Feb 2025
Does Training with Synthetic Data Truly Protect Privacy? Yunpeng Zhao Jie Zhang 80 0 0 18 Feb 2025
Dynamic Influence Tracker: Measuring Time-Varying Sample Influence During Training Jie Xu Zihan Wu TDI 53 0 0 15 Feb 2025
Early Stopping Against Label Noise Without Validation Data Suqin Yuan Lei Feng Tongliang Liu NoLa 96 14 0 11 Feb 2025
On Learning Representations for Tabular Data Distillation Inwon Kang Parikshit Ram Yi Zhou Horst Samulowitz O. Seneviratne DD 62 0 0 23 Jan 2025
Geometric Median (GM) Matching for Robust Data Pruning Anish Acharya Inderjit S Dhillon Sujay Sanghavi AAML 59 0 0 20 Jan 2025
Generative Dataset Distillation Based on Self-knowledge Distillation Longzhen Li G. Li Ren Togo Keisuke Maeda Takahiro Ogawa Miki Haseyama DD 44 0 0 08 Jan 2025
MM-GEN: Enhancing Task Performance Through Targeted Multimodal Data Curation S. Joshi Besmira Nushi Vidhisha Balachandran Varun Chandrasekaran Vibhav Vineet Neel Joshi Baharan Mirzasoleiman MLLM VLM 44 0 0 07 Jan 2025
Swift Cross-Dataset Pruning: Enhancing Fine-Tuning Efficiency in Natural Language Understanding Binh-Nguyen Nguyen Yang He 38 1 0 05 Jan 2025
Differentiable Prompt Learning for Vision Language Models Zhenhan Huang Tejaswini Pedapati Pin-Yu Chen Jianxi Gao VLM 28 0 0 03 Jan 2025
The Silent Majority: Demystifying Memorization Effect in the Presence of Spurious Correlations Chenyu You Haocheng Dai Yifei Min Jasjeet Sekhon S. Joshi James S. Duncan 60 2 0 01 Jan 2025
Audiopedia: Audio QA with Knowledge Abhirama Subramanyam Penamakuri Kiran Chhatre Akshat Jain KELM AuLLM RALM 53 0 0 31 Dec 2024
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models Yulei Qin Yuncheng Yang Pengcheng Guo Gang Li Hang Shao Yuchen Shi Zihan Xu Yun Gu Ke Li Xing Sun ALM 90 12 0 31 Dec 2024
Demystifying CLIP Data Hu Xu Saining Xie Xiaoqing Ellen Tan Po-Yao (Bernie) Huang Russell Howes Vasu Sharma Shang-Wen Li Gargi Ghosh Luke Zettlemoyer Christoph Feichtenhofer VLM CLIP 42 108 0 31 Dec 2024
Adaptive Dataset Quantization Muquan Li Dongyang Zhang Qiang Dong Xiurui Xie Ke Qin DD MQ 88 0 0 22 Dec 2024
Data Pruning Can Do More: A Comprehensive Data Pruning Approach for Object Re-identification Zi Yang Haojin Yang Soumajit Majumder Jorge M. Cardoso Guillermo Gallego MoMe VLM 93 1 0 13 Dec 2024
Decomposed Distribution Matching in Dataset Condensation Sahar Rahimi Malakshan Mohammad Saeed Ebrahimi Saadabadi Ali Dabouei Nasser M. Nasrabadi DD 71 1 0 06 Dec 2024
Paint Outside the Box: Synthesizing and Selecting Training Data for Visual Grounding Zilin Du Haoxin Li Jianfei Yu Boyang Li 146 0 0 01 Dec 2024
Zero-Shot Coreset Selection: Efficient Pruning for Unlabeled Data Brent A. Griffin Jacob Marks Jason J. Corso VLM 74 2 0 22 Nov 2024
Targeting Negative Flips in Active Learning using Validation Sets Ryan Benkert M. Prabhushankar Ghassan AlRegib AAML 35 0 0 16 Nov 2024
From Prototypes to General Distributions: An Efficient Curriculum for Masked Image Modeling Jinhong Lin Cheng-En Wu Huanran Li Jifan Zhang Yu Hen Hu Pedro Morgado 38 0 0 16 Nov 2024
ComFairGNN: Community Fair Graph Neural Network Yonas Sium Qi Li 31 0 0 07 Nov 2024
Diagnosing Medical Datasets with Training Dynamics Laura Wenderoth 26 0 0 03 Nov 2024
Does the Definition of Difficulty Matter? Scoring Functions and their Role for Curriculum Learning Simon Rampp M. Milling Andreas Triantafyllopoulos Björn Schuller 31 1 0 01 Nov 2024
Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuning P. M. Ghari Yanning Shen FedML 23 1 0 28 Oct 2024
Continual Learning on a Data Diet Elif Ceren Gok Yildirim Murat Onur Yildirim Joaquin Vanschoren CLL 23 0 0 23 Oct 2024
Exploring Forgetting in Large Language Model Pre-Training Chonghua Liao Ruobing Xie X. Sun Haowen Sun Zhanhui Kang CLL 33 0 0 22 Oct 2024
Scalability of memorization-based machine unlearning Kairan Zhao Peter Triantafillou MU 39 2 0 21 Oct 2024
Are Large-scale Soft Labels Necessary for Large-scale Dataset Distillation? Lingao Xiao Yang He DD 32 5 0 21 Oct 2024
Mislabeled examples detection viewed as probing machine learning models: concepts, survey and extensive benchmark Thomas George Pierre Nodet A. Bondu Vincent Lemaire VLM 32 0 0 21 Oct 2024
GDeR: Safeguarding Efficiency, Balancing, and Robustness via Prototypical Graph Pruning Guibin Zhang Haonan Dong Yuchen Zhang Zhixun Li Dingshuo Chen Kai Wang Tianlong Chen Yuxuan Liang Dawei Cheng Kun Wang 32 3 0 17 Oct 2024