An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks

21 December 2013

Aaron Courville

Papers citing "An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks"

50 / 292 papers shown

Title
The CLEAR Benchmark: Continual LEArning on Real-World Imagery Zhiqiu Lin Jia Shi Deepak Pathak Deva Ramanan CLL VLM 148 92 0 17 Jan 2022
An Incremental Learning Approach to Automatically Recognize Pulmonary Diseases from the Multi-vendor Chest Radiographs Mehreen Sirshar Taimur Hassan M. Akram S. Khan 32 33 0 07 Jan 2022
Aerial Scene Parsing: From Tile-level Scene Classification to Pixel-wise Semantic Labeling Yang Long Gui-Song Xia Lefei Zhang Gong Cheng Deren Li 16 14 0 06 Jan 2022
Exemplar-free Class Incremental Learning via Discriminative and Comparable One-class Classifiers Wenju Sun Qingyong Li Jing Zhang Danyu Wang Wen Wang Yangli-ao Geng BDL 24 3 0 05 Jan 2022
Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments A. Iyer Karan Grewal Akash Velu Lucas O. Souza Jérémy Forest Subutai Ahmad AI4CE 35 42 0 31 Dec 2021
Generative Kernel Continual learning Mohammad Mahdi Derakhshani Xiantong Zhen Ling Shao Cees G. M. Snoek BDL VLM 41 0 0 26 Dec 2021
Graph Few-shot Class-incremental Learning Zhen Tan Kaize Ding Ruocheng Guo Huan Liu CLL GNN 34 59 0 23 Dec 2021
How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness? Xinhsuai Dong Anh Tuan Luu Min Lin Shuicheng Yan Hanwang Zhang SILM AAML 20 55 0 22 Dec 2021
Provable Continual Learning via Sketched Jacobian Approximations Reinhard Heckel CLL 20 9 0 09 Dec 2021
Self-Supervised Models are Continual Learners Enrico Fini Victor G. Turrisi da Costa Xavier Alameda-Pineda Elisa Ricci Alahari Karteek Julien Mairal BDL CLL SSL 52 159 0 08 Dec 2021
Contrastive Continual Learning with Feature Propagation Xuejun Han Yuhong Guo CLL 29 4 0 03 Dec 2021
Non-IID data and Continual Learning processes in Federated Learning: A long road ahead Marcos F. Criado F. Casado R. Iglesias Carlos V. Regueiro S. Barro FedML 38 77 0 26 Nov 2021
Merging Models with Fisher-Weighted Averaging Michael Matena Colin Raffel FedML MoMe 50 354 0 18 Nov 2021
Self-Supervised Class Incremental Learning Zixuan Ni Siliang Tang Yueting Zhuang CLL 36 6 0 18 Nov 2021
Behavioral Experiments for Understanding Catastrophic Forgetting Samuel J. Bell Neil D. Lawrence 35 4 0 20 Oct 2021
Controllable Semantic Parsing via Retrieval Augmentation Panupong Pasupat Yuan Zhang Kelvin Guu 132 47 0 16 Oct 2021
Subspace Regularizers for Few-Shot Class Incremental Learning Afra Feyza Akyürek Ekin Akyürek Derry Wijaya Jacob Andreas CLL 21 59 0 13 Oct 2021
Representational Continuity for Unsupervised Continual Learning Divyam Madaan Jaehong Yoon Yuanchun Li Yunxin Liu Sung Ju Hwang CLL SSL 68 112 0 13 Oct 2021
Powerpropagation: A sparsity inducing weight reparameterisation Jonathan Richard Schwarz Siddhant M. Jayakumar Razvan Pascanu P. Latham Yee Whye Teh 98 54 0 01 Oct 2021
Data Summarization via Bilevel Optimization Zalan Borsos Mojmír Mutný Marco Tagliasacchi Andreas Krause 30 8 0 26 Sep 2021
Stabilizing Elastic Weight Consolidation method in practical ML tasks and using weight importances for neural network pruning Alexey Kutalev A. Lapina 33 11 0 21 Sep 2021
Generalization in Mean Field Games by Learning Master Policies Sarah Perrin Mathieu Laurière Julien Pérolat Romuald Élie M. Geist Olivier Pietquin AI4CE 94 35 0 20 Sep 2021
Survey of Low-Resource Machine Translation Barry Haddow Rachel Bawden Antonio Valerio Miceli Barone Jindvrich Helcl Alexandra Birch AIMat 39 150 0 01 Sep 2021
A good body is all you need: avoiding catastrophic interference via agent architecture search Joshua P. Powers Ryan Grindle Lapo Frati Josh Bongard 17 1 0 18 Aug 2021
DIODE: Dilatable Incremental Object Detection Can Peng Kun-li Zhao Sam Maksoud Tianren Wang Brian C. Lovell CLL ObjD 27 9 0 12 Aug 2021
Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data Kuluhan Binici N. Pham T. Mitra K. Leman 30 40 0 11 Aug 2021
ARC: Adversarially Robust Control Policies for Autonomous Vehicles Sampo Kuutti Saber Fallah Richard Bowden AAML 30 5 0 09 Jul 2021
A First Look at Class Incremental Learning in Deep Learning Mobile Traffic Classification Giampaolo Bovenzi Lixuan Yang A. Finamore Giuseppe Aceto D. Ciuonzo A. Pescapé Dario Rossi 23 22 0 09 Jul 2021
Continual Learning in the Teacher-Student Setup: Impact of Task Similarity Sebastian Lee Sebastian Goldt Andrew M. Saxe CLL 32 73 0 09 Jul 2021
Multi-View Correlation Distillation for Incremental Object Detection Dongbao Yang Yu Zhou Weiping Wang 32 59 0 05 Jul 2021
Laplace Redux -- Effortless Bayesian Deep Learning Erik A. Daxberger Agustinus Kristiadi Alexander Immer Runa Eschenhagen Matthias Bauer Philipp Hennig BDL UQCV 58 289 0 28 Jun 2021
Learning without Forgetting for 3D Point Cloud Objects T. Chowdhury Mahira Jalisha A. Cheraghian Shafin Rahman 3DPC 35 9 0 27 Jun 2021
Generative Feature-driven Image Replay for Continual Learning Kevin Thandiackal Tiziano Portenier Andrea Giovannini M. Gabrani O. Goksel CLL VLM DiffM 18 9 0 09 Jun 2021
Data augmentation and pre-trained networks for extremely low data regimes unsupervised visual inspection Pierre Gutierrez Antoine Cordier Thais Caldeira Théophile Sautory 20 4 0 02 Jun 2021
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders Chen Xu Bojie Hu Yanyang Li Yuhao Zhang Shen Huang Qi Ju Tong Xiao Jingbo Zhu 25 76 0 12 May 2021
Towards Visual Semantics Fausto Giunchiglia L. Erculiani Andrea Passerini 22 16 0 26 Apr 2021
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation Mozhdeh Gheini Xiang Ren Jonathan May LRM 31 105 0 18 Apr 2021
Unsupervised Class-Incremental Learning Through Confusion Shivam Khare Kun Cao James M. Rehg SSL CLL 24 6 0 09 Apr 2021
Avalanche: an End-to-End Library for Continual Learning Vincenzo Lomonaco Lorenzo Pellegrini Andrea Cossu Antonio Carta G. Graffieti ... Christopher Kanan Joost van de Weijer Tinne Tuytelaars D. Bacciu Davide Maltoni BDL AI4TS 42 181 0 01 Apr 2021
Rainbow Memory: Continual Learning with a Memory of Diverse Samples Jihwan Bang Heesu Kim Y. Yoo Jung-Woo Ha Jonghyun Choi CLL 42 324 0 31 Mar 2021
Distilled Replay: Overcoming Forgetting through Synthetic Samples Andrea Rosasco Antonio Carta Andrea Cossu Vincenzo Lomonaco D. Bacciu DD 24 47 0 29 Mar 2021
Structural Adapters in Pretrained Language Models for AMR-to-text Generation Leonardo F. R. Ribeiro Yue Zhang Iryna Gurevych 41 69 0 16 Mar 2021
Continual Semantic Segmentation via Repulsion-Attraction of Sparse and Disentangled Latent Representations Umberto Michieli Pietro Zanuttigh CLL 43 138 0 10 Mar 2021
Behavior From the Void: Unsupervised Active Pre-Training Hao Liu Pieter Abbeel VLM SSL 41 195 0 08 Mar 2021
Posterior Meta-Replay for Continual Learning Christian Henning Maria R. Cervera Francesco DÁngelo J. Oswald Regina Traber Benjamin Ehret Seijin Kobayashi Benjamin Grewe João Sacramento CLL BDL 51 55 0 01 Mar 2021
Efficient Continual Learning with Modular Networks and Task-Driven Priors Tom Véniat Ludovic Denoyer MarcÁurelio Ranzato CLL 30 97 0 23 Dec 2020
Positive-Congruent Training: Towards Regression-Free Model Updates Sijie Yan Yuanjun Xiong Kaustav Kundu Shuo Yang Siqi Deng Meng Wang Wei Xia Stefano Soatto BDL 31 49 0 18 Nov 2020
Artificial Neural Variability for Deep Learning: On Overfitting, Noise Memorization, and Catastrophic Forgetting Zeke Xie Fengxiang He Shaopeng Fu Issei Sato Dacheng Tao Masashi Sugiyama 21 60 0 12 Nov 2020
AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem? Jun Ma Yao Zhang Song Gu Cheng Zhu Cheng Ge ... Shangqing Liu Yunpeng Wang Yuhui Li Jian He Xiaoping Yang SSeg OOD 26 326 0 28 Oct 2020
The LMU Munich System for the WMT 2020 Unsupervised Machine Translation Shared Task Alexandra Chronopoulou Dario Stojanovski Viktor Hangya Alexander Fraser 37 5 0 25 Oct 2020