An Empirical Study of Example Forgetting during Deep Neural Network Learning

12 December 2018

Mariya Toneva

Alessandro Sordoni

Rémi Tachet des Combes

Papers citing "An Empirical Study of Example Forgetting during Deep Neural Network Learning"

32 / 482 papers shown

Title
Confidence-Aware Learning for Deep Neural Networks J. Moon Jihyo Kim Younghak Shin Sangheum Hwang UQCV 23 143 0 03 Jul 2020
Gradient-based Editing of Memory Examples for Online Task-free Continual Learning Xisen Jin Arka Sadhu Junyi Du Xiang Ren CLL KELM BDL 15 95 0 27 Jun 2020
Optimization and Generalization of Regularization-Based Continual Learning: a Loss Approximation Viewpoint Dong Yin Mehrdad Farajtabar Ang Li Nir Levine Alex Mott CLL 16 21 0 19 Jun 2020
Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Razvan Pascanu H. Ghasemzadeh CLL 18 219 0 12 Jun 2020
Dataset Condensation with Gradient Matching Bo-Lu Zhao Konda Reddy Mopuri Hakan Bilen DD 33 472 0 10 Jun 2020
Assessing the Bilingual Knowledge Learned by Neural Machine Translation Models Shilin He Xing Wang Shuming Shi M. Lyu Zhaopeng Tu 22 5 0 28 Apr 2020
The Right Tool for the Job: Matching Model and Instance Complexities Roy Schwartz Gabriel Stanovsky Swabha Swayamdipta Jesse Dodge Noah A. Smith 33 167 0 16 Apr 2020
Hyperplane Arrangements of Trained ConvNets Are Biased Matteo Gamba S. Carlsson Hossein Azizpour Mårten Björkman 19 5 0 17 Mar 2020
Reducing Geographic Performance Differential for Face Recognition Martins Bruveris Jochem Gietema Pouria Mortazavian Mohan Mahadevan CVBM 4 8 0 27 Feb 2020
Investigating the Compositional Structure Of Deep Neural Networks Francesco Craighero Fabrizio Angaroni Alex Graudenzi Fabio Stella M. Antoniotti FAtt 11 5 0 17 Feb 2020
Object Detection as a Positive-Unlabeled Problem Yuewei Yang Kevin J Liang Lawrence Carin 19 37 0 11 Feb 2020
Characterizing Structural Regularities of Labeled Data in Overparameterized Models Ziheng Jiang Chiyuan Zhang Kunal Talwar Michael C. Mozer TDI 17 97 0 08 Feb 2020
Dissecting Catastrophic Forgetting in Continual Learning by Deep Visualization Giang Nguyen Shuan Chen T. Do Tae Joon Jun Ho-Jin Choi Daeyoung Kim 19 10 0 06 Jan 2020
Learning and Memorizing Representative Prototypes for 3D Point Cloud Semantic and Instance Segmentation Tong He Dong Gong Zhi Tian Chunhua Shen 3DV 35 39 0 06 Jan 2020
Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data F. Such Aditya Rawal Joel Lehman Kenneth O. Stanley Jeff Clune DD 16 154 0 17 Dec 2019
Empirical Study of Easy and Hard Examples in CNN Training Ikki Kishida Hideki Nakayama 11 11 0 25 Nov 2019
Increasing Robustness to Spurious Correlations using Forgettable Examples Yadollah Yaghoobzadeh Soroush Mehri Remi Tachet Timothy J. Hazen Alessandro Sordoni OOD 13 18 0 10 Nov 2019
Robust Training with Ensemble Consensus Jisoo Lee Sae-Young Chung NoLa 17 28 0 22 Oct 2019
Orthogonal Gradient Descent for Continual Learning Mehrdad Farajtabar Navid Azizan Alex Mott Ang Li CLL 19 348 0 15 Oct 2019
Automatic Construction of Multi-layer Perceptron Network from Streaming Examples Mahardhika Pratama Choiru Za’in Andri Ashfahani Yew-Soon Ong Weiping Ding AI4CE 11 52 0 08 Oct 2019
Data Valuation using Reinforcement Learning Jinsung Yoon Sercan Ö. Arik Tomas Pfister TDI 25 173 0 25 Sep 2019
Sampling Bias in Deep Active Classification: An Empirical Study Ameya Prabhu Charles Dognin M. Singh 11 64 0 20 Sep 2019
Selection via Proxy: Efficient Data Selection for Deep Learning Cody Coleman Christopher Yeh Stephen Mussmann Baharan Mirzasoleiman Peter Bailis Percy Liang J. Leskovec Matei A. Zaharia 15 327 0 26 Jun 2019
Episodic Memory in Lifelong Language Learning Cyprien de Masson dÁutume Sebastian Ruder Lingpeng Kong Dani Yogatama CLL KELM 22 280 0 03 Jun 2019
Training Data Subset Search with Ensemble Active Learning Kashyap Chitta J. Álvarez Elmar Haussmann C. Farabet 14 13 0 29 May 2019
Lifelong Neural Predictive Coding: Learning Cumulatively Online without Forgetting Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles CLL KELM 19 15 0 25 May 2019
Meta-learners' learning dynamics are unlike learners' Neil C. Rabinowitz OffRL 23 16 0 03 May 2019
Active Domain Randomization Bhairav Mehta Manfred Diaz Florian Golemo C. Pal Liam Paull 13 256 0 09 Apr 2019
Topology-based Representative Datasets to Reduce Neural Network Training Resources Rocio Gonzalez-Diaz Miguel A. Gutiérrez-Naranjo Eduardo Paluzo-Hidalgo DD 6 8 0 20 Mar 2019
Seven Myths in Machine Learning Research Oscar Chang Hod Lipson 6 0 0 18 Feb 2019
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 329 11,681 0 09 Mar 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,889 0 15 Sep 2016