ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1908.01091
  4. Cited By
Toward Understanding Catastrophic Forgetting in Continual Learning

Toward Understanding Catastrophic Forgetting in Continual Learning

2 August 2019
Cuong V Nguyen
Alessandro Achille
Michael Lam
Tal Hassner
Vijay Mahadevan
Stefano Soatto
ArXiv (abs)PDFHTML

Papers citing "Toward Understanding Catastrophic Forgetting in Continual Learning"

50 / 70 papers shown
One-Prompt Strikes Back: Sparse Mixture of Experts for Prompt-based Continual Learning
One-Prompt Strikes Back: Sparse Mixture of Experts for Prompt-based Continual Learning
Minh Le
Bao-Ngoc Dao
Huy Le Nguyen
Quyen Tran
Anh-Viêt Nguyên
Nhat Ho
CLLMoE
132
0
0
29 Sep 2025
Towards Robust Visual Continual Learning with Multi-Prototype Supervision
Towards Robust Visual Continual Learning with Multi-Prototype Supervision
Xiwei Liu
Yulong Li
Yichen Li
Xinlin Zhuang
Haolin Yang
Huifa Li
Imran Razzak
VLM
200
0
0
19 Sep 2025
DrugMCTS: a drug repurposing framework combining multi-agent, RAG and Monte Carlo Tree Search
DrugMCTS: a drug repurposing framework combining multi-agent, RAG and Monte Carlo Tree Search
Zerui Yang
Yuwei Wan
Siyu Yan
Yudai Matsuda
Tong Xie
B. Hoex
Linqi Song
315
3
0
10 Jul 2025
Little By Little: Continual Learning via Self-Activated Sparse Mixture-of-Rank Adaptive Learning
Little By Little: Continual Learning via Self-Activated Sparse Mixture-of-Rank Adaptive Learning
Haodong Lu
Chongyang Zhao
Jason Xue
Lina Yao
Kristen Moore
Dong Gong
CLLMoMeMoE
233
2
0
26 Jun 2025
Through the Valley: Path to Effective Long CoT Training for Small Language Models
Through the Valley: Path to Effective Long CoT Training for Small Language Models
Renjie Luo
Jiaxi Li
Chen Huang
Wei Lu
LRM
240
3
0
09 Jun 2025
Continual Learning on CLIP via Incremental Prompt Tuning with Intrinsic Textual Anchors
Continual Learning on CLIP via Incremental Prompt Tuning with Intrinsic Textual Anchors
Haodong Lu
Xinyu Zhang
Kristen Moore
Jason Xue
Lina Yao
Anton van den Hengel
Dong Gong
CLLVLM
222
2
0
27 May 2025
Evolving Machine Learning in Non-Stationary Environments: A Unified Survey of Drift, Forgetting, and Adaptation
Evolving Machine Learning in Non-Stationary Environments: A Unified Survey of Drift, Forgetting, and Adaptation
Ignacio Cabrera Martin
Subhaditya Mukherjee
Almas Baimagambetov
Joaquin Vanschoren
Nikolaos Polatidis
VLM
508
1
0
23 May 2025
Towards Rehearsal-Free Continual Relation Extraction: Capturing Within-Task Variance with Adaptive Prompting
Towards Rehearsal-Free Continual Relation Extraction: Capturing Within-Task Variance with Adaptive Prompting
Bao-Ngoc Dao
Quang Nguyen
Luyen Ngo Dinh
Minh Le
Nam Le
Linh Ngo Van
CLL
238
1
0
20 May 2025
A Conformal Predictive Measure for Assessing Catastrophic Forgetting
A Conformal Predictive Measure for Assessing Catastrophic Forgetting
Ioannis Pitsiorlas
Nour Jamoussi
Marios Kountouris
289
0
0
15 May 2025
Sequence Transferability and Task Order Selection in Continual Learning
T. Nguyen
Cuong N. Nguyen
Quang Pham
B. T. Nguyen
Savitha Ramasamy
Xiaoli Li
Cuong V Nguyen
270
1
0
10 Feb 2025
Should Code Models Learn Pedagogically? A Preliminary Evaluation of Curriculum Learning for Real-World Software Engineering Tasks
Should Code Models Learn Pedagogically? A Preliminary Evaluation of Curriculum Learning for Real-World Software Engineering TasksIEEE Working Conference on Mining Software Repositories (MSR), 2025
Kyi Shin Khant
Hong Yi Lin
Patanamon Thongtanunam
ELM
332
0
0
06 Feb 2025
Multiple Queries with Multiple Keys: A Precise Prompt Matching Paradigm for Prompt-based Continual Learning
Multiple Queries with Multiple Keys: A Precise Prompt Matching Paradigm for Prompt-based Continual Learning
Dunwei Tu
Huiyu Yi
Yanjie Wang
Baile Xu
Furao Shen
Jian Zhao
CLL
512
0
0
22 Jan 2025
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models
Yulei Qin
Yuncheng Yang
Pengcheng Guo
Gang Li
Hang Shao
Yuchen Shi
Zihan Xu
Yun Gu
Ke Li
Xing Sun
ALM
796
23
0
31 Dec 2024
Adaptive Rank, Reduced Forgetting: Knowledge Retention in Continual Learning Vision-Language Models with Dynamic Rank-Selective LoRA
Adaptive Rank, Reduced Forgetting: Knowledge Retention in Continual Learning Vision-Language Models with Dynamic Rank-Selective LoRA
Haodong Lu
Chongyang Zhao
Jason Xue
Lina Yao
Kristen Moore
Dong Gong
CLLKELMVLM
804
16
0
01 Dec 2024
Using Diffusion Models as Generative Replay in Continual Federated
  Learning -- What will Happen?
Using Diffusion Models as Generative Replay in Continual Federated Learning -- What will Happen?
Yongsheng Mei
Liangqi Yuan
Dong-Jun Han
Kevin S. Chan
Christopher G. Brinton
Tian-Shing Lan
287
1
0
10 Nov 2024
Continual Learning Improves Zero-Shot Action Recognition
Continual Learning Improves Zero-Shot Action RecognitionAsian Conference on Computer Vision (ACCV), 2024
Shreyank N. Gowda
Davide Moltisanti
Laura Sevilla-Lara
BDLVLMCLL
418
2
0
14 Oct 2024
FlipGuard: Defending Preference Alignment against Update Regression with
  Constrained Optimization
FlipGuard: Defending Preference Alignment against Update Regression with Constrained OptimizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Mingye Zhu
Yi Liu
Quan Wang
Junbo Guo
Zhendong Mao
175
2
0
01 Oct 2024
Towards Effective and Efficient Continual Pre-training of Large Language
  Models
Towards Effective and Efficient Continual Pre-training of Large Language Models
Jie Chen
Zhipeng Chen
Jiapeng Wang
Kun Zhou
Yutao Zhu
...
Rui Yan
Zhewei Wei
Di Hu
Wenbing Huang
Ji-Rong Wen
KELMALMCLLELMLRM
677
12
0
26 Jul 2024
Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
Qifan Zhang
Yunhui Guo
Yu Xiang
CLLVLM
596
0
0
18 Jul 2024
EVCL: Elastic Variational Continual Learning with Weight Consolidation
EVCL: Elastic Variational Continual Learning with Weight Consolidation
Hunar Batra
Ronald Clark
CLL
233
6
0
23 Jun 2024
Predicting the Susceptibility of Examples to Catastrophic Forgetting
Predicting the Susceptibility of Examples to Catastrophic Forgetting
Guy Hacohen
Tinne Tuytelaars
458
3
0
14 Jun 2024
iKAN: Global Incremental Learning with KAN for Human Activity
  Recognition Across Heterogeneous Datasets
iKAN: Global Incremental Learning with KAN for Human Activity Recognition Across Heterogeneous Datasets
Mengxi Liu
Sizhen Bian
Bo Zhou
P. Lukowicz
HAICLL
184
35
0
03 Jun 2024
Mixture of Experts Meets Prompt-Based Continual Learning
Mixture of Experts Meets Prompt-Based Continual LearningNeural Information Processing Systems (NeurIPS), 2024
Minh Le
An Nguyen
Huy Nguyen
Trang Nguyen
Trang Pham
L. Ngo
Nhat Ho
CLL
517
35
0
23 May 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning
Huiyi Wang
Haodong Lu
Lina Yao
Dong Gong
KELMCLL
359
28
0
27 Mar 2024
Can Similarity-Based Domain-Ordering Reduce Catastrophic Forgetting for
  Intent Recognition?
Can Similarity-Based Domain-Ordering Reduce Catastrophic Forgetting for Intent Recognition?
Amogh Mannekote
Xiaoyi Tian
K. Boyer
Bonnie J. Dorr
CLL
189
1
0
21 Feb 2024
Rethinking E-Commerce Search
Rethinking E-Commerce Search
Haixun Wang
Taesik Na
181
8
0
06 Dec 2023
Distributed Continual Learning with CoCoA in High-dimensional Linear
  Regression
Distributed Continual Learning with CoCoA in High-dimensional Linear RegressionIEEE Transactions on Signal Processing (IEEE TSP), 2023
Martin Hellkvist
Ayça Özçelikkale
Anders Ahlén
OOD
240
2
0
04 Dec 2023
L3DMC: Lifelong Learning using Distillation via Mixed-Curvature Space
L3DMC: Lifelong Learning using Distillation via Mixed-Curvature SpaceInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023
Kaushik Roy
Peyman Moghadam
Mehrtash Harandi
288
9
0
31 Jul 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2: Open Foundation and Fine-Tuned Chat Models
Hugo Touvron
Louis Martin
Kevin R. Stone
Peter Albert
Amjad Almahairi
...
Sharan Narang
Aurelien Rodriguez
Robert Stojnic
Sergey Edunov
Thomas Scialom
AI4MHALM
8.5K
15,388
0
18 Jul 2023
Measuring and Mitigating Interference in Reinforcement Learning
Measuring and Mitigating Interference in Reinforcement Learning
Vincent Liu
Zheng Chen
Ruo Yu Tao
Khurram Javed
Adam White
Martha White
272
7
0
10 Jul 2023
ScriptWorld: Text Based Environment For Learning Procedural Knowledge
ScriptWorld: Text Based Environment For Learning Procedural KnowledgeInternational Joint Conference on Artificial Intelligence (IJCAI), 2023
Abhinav Joshi
A. Ahmad
Umang Pandey
Ashutosh Modi
175
8
0
08 Jul 2023
Principles of Forgetting in Domain-Incremental Semantic Segmentation in
  Adverse Weather Conditions
Principles of Forgetting in Domain-Incremental Semantic Segmentation in Adverse Weather ConditionsComputer Vision and Pattern Recognition (CVPR), 2023
Tobias Kalb
Jürgen Beyerer
CLL
287
7
0
24 Mar 2023
Overcoming Catastrophic Forgetting by XAI
Overcoming Catastrophic Forgetting by XAI
Giang Nguyen
196
0
0
25 Nov 2022
CODA-Prompt: COntinual Decomposed Attention-based Prompting for
  Rehearsal-Free Continual Learning
CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual LearningComputer Vision and Pattern Recognition (CVPR), 2022
James Smith
Leonid Karlinsky
V. Gutta
Paola Cascante-Bonilla
Donghyun Kim
Assaf Arbelle
Yikang Shen
Rogerio Feris
Z. Kira
CLLVPVLMVLM
341
447
0
23 Nov 2022
Dealing with Drift of Adaptation Spaces in Learning-based Self-Adaptive
  Systems using Lifelong Self-Adaptation
Dealing with Drift of Adaptation Spaces in Learning-based Self-Adaptive Systems using Lifelong Self-AdaptationACM Transactions on Autonomous and Adaptive Systems (TAAS), 2022
Omid Gheibi
Danny Weyns
228
9
0
04 Nov 2022
Navigating Memory Construction by Global Pseudo-Task Simulation for
  Continual Learning
Navigating Memory Construction by Global Pseudo-Task Simulation for Continual LearningNeural Information Processing Systems (NeurIPS), 2022
Yejia Liu
Peng Guo
Shaolei Ren
CLL
169
3
0
16 Oct 2022
Task Formulation Matters When Learning Continually: A Case Study in
  Visual Question Answering
Task Formulation Matters When Learning Continually: A Case Study in Visual Question Answering
Mavina Nikandrou
Lu Yu
Alessandro Suglia
Ioannis Konstas
Verena Rieser
OOD
386
7
0
30 Sep 2022
Causes of Catastrophic Forgetting in Class-Incremental Semantic
  Segmentation
Causes of Catastrophic Forgetting in Class-Incremental Semantic SegmentationAsian Conference on Computer Vision (ACCV), 2022
Tobias Kalb
Jürgen Beyerer
CLL
209
9
0
16 Sep 2022
Generalization Bounds for Deep Transfer Learning Using Majority
  Predictor Accuracy
Generalization Bounds for Deep Transfer Learning Using Majority Predictor AccuracyInternational Symposium on Information Theory and its Applications (ISITA), 2022
Cuong N.Nguyen
L. Ho
Vu C. Dinh
Tal Hassner
Cuong V.Nguyen
170
4
0
13 Sep 2022
Wasserstein Task Embedding for Measuring Task Similarities
Wasserstein Task Embedding for Measuring Task SimilaritiesNeural Networks (NN), 2022
Hengrong Du
Yikun Bai
Yuzhe Lu
Andrea Soltoggio
Soheil Kolouri
OT
211
38
0
24 Aug 2022
The Effect of Task Ordering in Continual Learning
The Effect of Task Ordering in Continual Learning
Samuel J. Bell
Neil D. Lawrence
CLL
243
26
0
26 May 2022
Continual Learning with Foundation Models: An Empirical Study of Latent
  Replay
Continual Learning with Foundation Models: An Empirical Study of Latent Replay
O. Ostapenko
Timothée Lesort
P. Rodríguez
Md Rifat Arefin
Arthur Douillard
Irina Rish
Laurent Charlin
531
69
0
30 Apr 2022
Theoretical Understanding of the Information Flow on Continual Learning
  Performance
Theoretical Understanding of the Information Flow on Continual Learning PerformanceEuropean Conference on Computer Vision (ECCV), 2022
Joshua Andle
Salimeh Yasaei Sekeh
CLL
137
8
0
26 Apr 2022
Lifelong Self-Adaptation: Self-Adaptation Meets Lifelong Machine
  Learning
Lifelong Self-Adaptation: Self-Adaptation Meets Lifelong Machine LearningInternational Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), 2022
Omid Gheibi
Danny Weyns
CLL
123
29
0
04 Apr 2022
A Closer Look at Rehearsal-Free Continual Learning
A Closer Look at Rehearsal-Free Continual Learning
James Smith
Junjiao Tian
Shaunak Halbe
Yen-Chang Hsu
Z. Kira
VLMCLL
319
82
0
31 Mar 2022
Probing Representation Forgetting in Supervised and Unsupervised
  Continual Learning
Probing Representation Forgetting in Supervised and Unsupervised Continual LearningComputer Vision and Pattern Recognition (CVPR), 2022
Mohammad-Javad Davari
Nader Asadi
Sudhir Mudur
Rahaf Aljundi
Eugene Belilovsky
CLLKELM
254
76
0
24 Mar 2022
A Review of Deep Transfer Learning and Recent Advancements
A Review of Deep Transfer Learning and Recent Advancements
Mohammadreza Iman
Khaled Rasheed
H. Arabnia
248
528
0
19 Jan 2022
Wide Neural Networks Forget Less Catastrophically
Wide Neural Networks Forget Less CatastrophicallyInternational Conference on Machine Learning (ICML), 2021
Seyed Iman Mirzadeh
Arslan Chaudhry
Dong Yin
Huiyi Hu
Razvan Pascanu
Dilan Görür
Mehrdad Farajtabar
CLL
330
77
0
21 Oct 2021
Dendritic Self-Organizing Maps for Continual Learning
Dendritic Self-Organizing Maps for Continual Learning
Kosmas Pinitas
Spyridon Chavlis
Panayiota Poirazi
CLL
128
10
0
18 Oct 2021
On robustness of generative representations against catastrophic
  forgetting
On robustness of generative representations against catastrophic forgetting
Wojciech Masarczyk
Kamil Deja
Tomasz Trzciñski
152
5
0
04 Sep 2021
12
Next
Page 1 of 2