An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks

21 December 2013

Aaron Courville

Papers citing "An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks"

50 / 292 papers shown

Title
Directions of Curvature as an Explanation for Loss of Plasticity Alex Lewandowski Haruto Tanaka Dale Schuurmans Marlos C. Machado 26 5 0 30 Nov 2023
Continual Referring Expression Comprehension via Dual Modular Memorization Hengtao Shen Cheng Chen Peng Wang Lianli Gao Ming Wang Jingkuan Song ObjD 43 3 0 25 Nov 2023
Density Distribution-based Learning Framework for Addressing Online Continual Learning Challenges Shilin Zhang Jiahui Wang CLL 37 0 0 22 Nov 2023
HuatuoGPT-II, One-stage Training for Medical Adaption of LLMs Junying Chen Xidong Wang Anningzhe Gao Feng Jiang Shunian Chen ... Chuyi Kong Jianquan Li Xiang Wan Haizhou Li Benyou Wang LM&MA 24 60 0 16 Nov 2023
Continual Named Entity Recognition without Catastrophic Forgetting Duzhen Zhang Wei Cong Jiahua Dong Yahan Yu Xiuyi Chen Yonggang Zhang Zhen Fang 28 10 0 23 Oct 2023
UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting Xu Liu Junfeng Hu Yuan N. Li Shizhe Diao Keli Zhang Bryan Hooi Roger Zimmermann AI4TS 27 77 0 15 Oct 2023
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models Luiza Amador Pozzobon Beyza Ermis Patrick Lewis Sara Hooker 36 20 0 11 Oct 2023
Joint Audio and Speech Understanding Yuan Gong Alexander H. Liu Hongyin Luo Leonid Karlinsky James R. Glass AuLLM 28 69 0 25 Sep 2023
Maintaining Plasticity in Continual Learning via Regenerative Regularization Saurabh Kumar Henrik Marklund Benjamin Van Roy CLL KELM 36 18 0 23 Aug 2023
Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants Yibo Yang Haobo Yuan Hefei Ling Jianlong Wu Lefei Zhang Zhouchen Lin Philip Torr Dacheng Tao Guohao Li CLL 33 8 0 03 Aug 2023
Online Prototype Learning for Online Continual Learning Yujie Wei Jiaxin Ye Zhizhong Huang Junping Zhang Hongming Shan CLL OnRL 38 39 0 01 Aug 2023
A Definition of Continual Reinforcement Learning David Abel André Barreto Benjamin Van Roy Doina Precup H. V. Hasselt Satinder Singh CLL 41 74 0 20 Jul 2023
Continual Learning as Computationally Constrained Reinforcement Learning Saurabh Kumar Henrik Marklund Anand Srinivasa Rao Yifan Zhu Hong Jun Jeon Yueyang Liu Benjamin Van Roy CLL 32 22 0 10 Jul 2023
Improving Online Continual Learning Performance and Stability with Temporal Ensembles Albin Soutif--Cormerais Antonio Carta Joost van de Weijer CLL 15 11 0 29 Jun 2023
KrADagrad: Kronecker Approximation-Domination Gradient Preconditioned Stochastic Optimization Jonathan Mei Alexander Moreno Luke Walters ODL 29 1 0 30 May 2023
Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictors Yong Liu Chenyu Li Jianmin Wang Mingsheng Long AI4TS 37 105 0 30 May 2023
SRIL: Selective Regularization for Class-Incremental Learning Jisu Han Jaemin Na Wonjun Hwang CLL 29 0 0 09 May 2023
Adaptive-saturated RNN: Remember more with less instability Khoi Minh Nguyen-Duy Quang Pham B. T. Nguyen ODL 22 1 0 24 Apr 2023
Identifying Appropriate Intellectual Property Protection Mechanisms for Machine Learning Models: A Systematization of Watermarking, Fingerprinting, Model Access, and Attacks Isabell Lederer Rudolf Mayer Andreas Rauber 29 19 0 22 Apr 2023
Non-exemplar Class-incremental Learning by Random Auxiliary Classes Augmentation and Mixed Features Kenny Song Quan Xia Guoqiang Liang Zhaoji Chen Yanning Zhang CLL 33 6 0 16 Apr 2023
Few-shot Class-incremental Learning for Cross-domain Disease Classification Han Yang Weijian Huang Jiarun Liu Cheng Li Shanshan Wang CLL 37 4 0 12 Apr 2023
SLPerf: a Unified Framework for Benchmarking Split Learning Tianchen Zhou Zhanyi Hu Bingzhe Wu Cen Chen FedML 27 4 0 04 Apr 2023
Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentation Julio Silva-Rodríguez Jose Dolz Ismail Ben Ayed 66 13 0 29 Mar 2023
Leveraging Old Knowledge to Continually Learn New Classes in Medical Images Evelyn Chee M. Lee W. Hsu CLL 13 7 0 24 Mar 2023
Failure-tolerant Distributed Learning for Anomaly Detection in Wireless Networks Marc Katzef Andrew C. Cullen T. Alpcan C. Leckie Justin Kopacz 25 0 0 23 Mar 2023
Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning Sang-Ho Kim Lorenzo Noci Antonio Orvieto Thomas Hofmann CLL 30 35 0 16 Mar 2023
ICICLE: Interpretable Class Incremental Continual Learning Dawid Rymarczyk Joost van de Weijer Bartosz Zieliñski Bartlomiej Twardowski CLL 34 28 0 14 Mar 2023
Robustness-preserving Lifelong Learning via Dataset Condensation Jinghan Jia Yihua Zhang Dogyoon Song Sijia Liu Alfred Hero DD 38 4 0 07 Mar 2023
A Neural Span-Based Continual Named Entity Recognition Model Yunan Zhang Qingcai Chen CLL 42 7 0 23 Feb 2023
Preventing Catastrophic Forgetting in Continual Learning of New Natural Language Tasks Sudipta Kar Giuseppe Castellucci Simone Filice S. Malmasi Oleg Rokhlenko CLL KELM 56 6 0 22 Feb 2023
Efficient Parametric Approximations of Neural Network Function Space Distance Nikita Dhawan Sicong Huang Juhan Bae Roger C. Grosse 16 5 0 07 Feb 2023
Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learning Yibo Yang Haobo Yuan Hefei Ling Zhouchen Lin Philip Torr Dacheng Tao CLL 39 98 0 06 Feb 2023
Multi-scale Feature Alignment for Continual Learning of Unlabeled Domains Kevin Thandiackal Luigi Piccinelli Pushpak Pati O. Goksel CLL OOD MedIm 34 7 0 02 Feb 2023
Learning Vision-based Robotic Manipulation Tasks Sequentially in Offline Reinforcement Learning Settings Sudhir Pratap Yadav R. Nagar S. Shah OffRL 29 3 0 31 Jan 2023
Probabilistic Bilevel Coreset Selection Xiao Zhou Renjie Pi Weizhong Zhang Yong Lin Tong Zhang NoLa 31 27 0 24 Jan 2023
A Domain-Agnostic Approach for Characterization of Lifelong Learning Systems Megan M. Baker Alexander New Mario Aguilar-Simon Ziad Al-Halah Sébastien M. R. Arnold ... Zifan Xu A. Yanguas-Gil Harel Yedidsion Shangqun Yu Gautam K. Vallabha 35 16 0 18 Jan 2023
Artificial Neuronal Ensembles with Learned Context Dependent Gating M. Tilley Michelle Miller David J. Freedman 32 3 0 17 Jan 2023
Dataset Distillation: A Comprehensive Review Ruonan Yu Songhua Liu Xinchao Wang DD 55 121 0 17 Jan 2023
Expected Gradients of Maxout Networks and Consequences to Parameter Initialization Hanna Tseran Guido Montúfar ODL 30 0 0 17 Jan 2023
HierVL: Learning Hierarchical Video-Language Embeddings Kumar Ashutosh Rohit Girdhar Lorenzo Torresani Kristen Grauman VLM AI4TS 28 53 0 05 Jan 2023
Task-Adaptive Saliency Guidance for Exemplar-free Class Incremental Learning Xialei Liu Jiang-Tian Zhai Andrew D. Bagdanov Ke Li Mingg-Ming Cheng CLL 33 4 0 16 Dec 2022
Localized Latent Updates for Fine-Tuning Vision-Language Models Moritz Ibing I. Lim Leif Kobbelt VLM 26 1 0 13 Dec 2022
Reliable extrapolation of deep neural operators informed by physics or sparse observations Min Zhu Handi Zhang Anran Jiao George Karniadakis Lu Lu 50 91 0 13 Dec 2022
G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks Zhongwei Wan Yichun Yin Wei Zhang Jiaxin Shi Lifeng Shang Guangyong Chen Xin Jiang Qun Liu VLM CLL 36 16 0 07 Dec 2022
Can In-context Learners Learn a Reasoning Concept from Demonstrations? Michal Tefnik Marek Kadlcík LRM 16 5 0 03 Dec 2022
Taming Normalizing Flows Shimon Malnick S. Avidan Ohad Fried TPM DiffM 29 1 0 29 Nov 2022
BeGin: Extensive Benchmark Scenarios and An Easy-to-use Framework for Graph Continual Learning Jihoon Ko Shinhwan Kang Taehyung Kwon Heechan Moon Kijung Shin CLL 43 7 0 26 Nov 2022
Overcoming Catastrophic Forgetting by XAI Giang Nguyen 18 0 0 25 Nov 2022
Cooperative data-driven modeling Aleksandr Dekhovich O. T. Turan Jiaxiang Yi Miguel A. Bessa CLL KELM AI4CE 19 5 0 23 Nov 2022
Exemplar-free Continual Learning of Vision Transformers via Gated Class-Attention and Cascaded Feature Drift Compensation Marco Cotogni Fei Yang C. Cusano Andrew D. Bagdanov Joost van de Weijer CLL 30 0 0 22 Nov 2022