Overcoming catastrophic forgetting with hard attention to the task

4 January 2018

Joan Serra

Dídac Surís

M. Miron

Alexandros Karatzoglou

CLL

ArXiv PDF HTML

Papers citing "Overcoming catastrophic forgetting with hard attention to the task"

50 / 134 papers shown

Title
The Estimation of Continual Causal Effect for Dataset Shifting Streams Baining Chen Yiming Zhang Yuqiao Han Ruyue Zhang Ruihuan Du Zhishuo Zhou Zhengdan Zhu Xun Liu Jiecheng Guo 64 0 0 29 Apr 2025
Enhancing Pre-Trained Model-Based Class-Incremental Learning through Neural Collapse Kun He Zijian Song Shuoxi Zhang J. Hopcroft CLL 56 0 0 25 Apr 2025
Continual Learning With Quasi-Newton Methods Steven Vander Eeckt Hugo Van hamme CLL BDL 61 0 0 25 Mar 2025
Adaptive Weighted Parameter Fusion with CLIP for Class-Incremental Learning J. Guo Xiaoguang Zhu Liangyu Teng Hao Yang J. Liu Y. Liu Liang Song CLL VLM 67 1 0 25 Mar 2025
UniCon: Unidirectional Information Flow for Effective Control of Large-Scale Diffusion Models Fanghua Yu Jinjin Gu Jinfan Hu Zheyuan Li Chao Dong DiffM 50 0 0 21 Mar 2025
H2ST: Hierarchical Two-Sample Tests for Continual Out-of-Distribution Detection Yuhang Liu Wenjie Zhao Yunhui Guo OODD 58 0 0 19 Mar 2025
Enhanced Continual Learning of Vision-Language Models with Model Fusion Haoyuan Gao Zicong Zhang Yuqi Wei Linglan Zhao Guilin Li Y. Li Linghe Kong Weiran Huang CLL VLM 100 0 0 12 Mar 2025
Lifelong Learning with Task-Specific Adaptation: Addressing the Stability-Plasticity Dilemma Ruiyu Wang Sen Wang X. Zuo Q. Sun CLL KELM 62 0 0 08 Mar 2025
Mastering Continual Reinforcement Learning through Fine-Grained Sparse Network Allocation and Dormant Neuron Exploration Chengqi Zheng Haiyan Yin Jianda Chen Terence Ng Yew-Soon Ong Ivor Tsang CLL 98 0 0 07 Mar 2025
Theory on Mixture-of-Experts in Continual Learning Hongbo Li Sen-Fon Lin Lingjie Duan Yingbin Liang Ness B. Shroff MoE MoMe CLL 151 14 0 20 Feb 2025
Achieving Upper Bound Accuracy of Joint Training in Continual Learning Saleh Momeni Bing Liu CLL 80 1 0 17 Feb 2025
Unlocking the Power of Function Vectors for Characterizing and Mitigating Catastrophic Forgetting in Continual Instruction Tuning Gangwei Jiang Caigao Jiang Zhaoyi Li Siqiao Xue Jun-ping Zhou Linqi Song Defu Lian Yin Wei CLL MU 56 0 0 16 Feb 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks Ofir Schlisselberg Ran Darshan 91 0 0 10 Feb 2025
Dynamic Continual Learning: Harnessing Parameter Uncertainty for Improved Network Adaptation Christopher Angelini N. Bouaynaya BDL 31 0 0 18 Jan 2025
LSEBMCL: A Latent Space Energy-Based Model for Continual Learning Xiaodi Li Dingcheng Li Rujun Gao Mahmoud Zamani Latifur Khan CLL KELM 42 0 0 09 Jan 2025
Integrating Dual Prototypes for Task-Wise Adaption in Pre-Trained Model-Based Class-Incremental Learning Zhiming Xu S. M. I. Simon X. Yang Baile Xu Jian Zhao F. Shen CLL 81 0 0 26 Nov 2024
RECAST: Reparameterized, Compact weight Adaptation for Sequential Tasks Nazia Tasnim Bryan A. Plummer CLL OffRL 72 0 0 25 Nov 2024
Efficient Non-Exemplar Class-Incremental Learning with Retrospective Feature Synthesis Liang Bai Hong Song Yucong Lin Tianyu Fu Deqiang Xiao Danni Ai Jingfan Fan Jian Yang CLL 29 0 0 03 Nov 2024
ATLAS: Adapter-Based Multi-Modal Continual Learning with a Two-Stage Learning Strategy Hong Li Zhiquan Tan Xingyu Li Weiran Huang CLL MoMe 21 1 0 14 Oct 2024
Temporal-Difference Variational Continual Learning L. Melo Alessandro Abate Yarin Gal BDL CLL VLM 36 0 0 10 Oct 2024
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey Dianzhi Yu Xinni Zhang Yankai Chen Aiwei Liu Yifei Zhang Philip S. Yu Irwin King VLM CLL 39 9 0 07 Oct 2024
Drift to Remember Jin Du X. Zhang Hao Shen Xun Xian Ganghua Wang Jiawei Zhang Yuhong Yang Na Li Jia Liu Jie Ding CLL 9 0 0 21 Sep 2024
Joint Input and Output Coordination for Class-Incremental Learning Shuai Wang Yibing Zhan Yong Luo Han Hu Wei Yu Yonggang Wen Dacheng Tao CLL 29 2 0 09 Sep 2024
Buffer-based Gradient Projection for Continual Federated Learning Shenghong Dai Jy-yong Sohn Yicong Chen S. Alam Ravikumar Balakrishnan Suman Banerjee N. Himayat Kangwook Lee FedML 60 2 0 03 Sep 2024
Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learning Lu Yu Hesong Li Ying Fu J. Weijer Changsheng Xu CLL 44 1 0 02 Aug 2024
HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning Liyuan Wang Jingyi Xie Xingxing Zhang Hang Su Jun Zhu CLL 45 4 0 07 Jul 2024
Disentangling and Mitigating the Impact of Task Similarity for Continual Learning Naoki Hiratani CLL 35 2 0 30 May 2024
Auto-selected Knowledge Adapters for Lifelong Person Re-identification Xuelin Qian Ruiqi Wu Gong Cheng Junwei Han CLL 44 2 0 29 May 2024
Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System Chen Chen Ruizhe Li Yuchen Hu Yuanyuan Chen Chengwei Qin Qiang Zhang CLL 37 1 0 16 May 2024
Double Mixture: Towards Continual Event Detection from Speech Jingqi Kang Tongtong Wu Jinming Zhao Guitao Wang Yinwei Wei Haomiao Yang Guilin Qi Yuan-Fang Li Gholamreza Haffari 23 0 0 20 Apr 2024
Adaptive Memory Replay for Continual Learning James Seale Smith Lazar Valkov Shaunak Halbe V. Gutta Rogerio Feris Z. Kira Leonid Karlinsky 29 6 0 18 Apr 2024
One-Shot Domain Incremental Learning Yasushi Esaki Satoshi Koide Takuro Kutsuna CLL VLM 35 0 0 25 Mar 2024
HOP to the Next Tasks and Domains for Continual Learning in NLP Umberto Michieli Mete Ozay VLM 27 2 0 28 Feb 2024
COPR: Continual Human Preference Learning via Optimal Policy Regularization Han Zhang Lin Gui Yu Lei Yuanzhao Zhai Yehong Zhang ... Hui Wang Yue Yu Kam-Fai Wong Bin Liang Ruifeng Xu CLL 29 4 0 22 Feb 2024
Continual Learning on Graphs: A Survey Zonggui Tian Duanhao Zhang Hong-Ning Dai 32 5 0 09 Feb 2024
Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformer Mingxuan Liu Jiankai Tang Haoxiang Li Jiahao Qi Siwei Li Kegang Wang Yuntao wang Hong Chen Yuntao Wang Hong Chen 89 14 0 07 Feb 2024
Divide and not forget: Ensemble of selectively trained experts in Continual Learning Grzegorz Rype'sć Sebastian Cygert Valeriya Khan Tomasz Trzciñski Bartosz Zieliñski Bartlomiej Twardowski CLL 24 28 0 18 Jan 2024
Federated Continual Learning via Knowledge Fusion: A Survey Xin Yang Hao Yu Xin Gao Hao Wang Junbo Zhang Tianrui Li FedML 19 30 0 27 Dec 2023
Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models Kyra Ahrens Hans Hergen Lehmann Jae Hee Lee Stefan Wermter CLL 18 7 0 13 Dec 2023
Benchmarking Continual Learning from Cognitive Perspectives Xiaoqian Liu Junge Zhang Mingyi Zhang Peipei Yang 16 0 0 06 Dec 2023
Rethinking E-Commerce Search Haixun Wang Taesik Na 30 5 0 06 Dec 2023
CUCL: Codebook for Unsupervised Continual Learning Chen Cheng Jingkuan Song Xiaosu Zhu Junchen Zhu Lianli Gao H. Shen CLL 23 2 0 25 Nov 2023
Query by Activity Video in the Wild Tao Hu William Thong Pascal Mettes Cees G. M. Snoek 11 0 0 23 Nov 2023
Density Distribution-based Learning Framework for Addressing Online Continual Learning Challenges Shilin Zhang Jiahui Wang CLL 16 0 0 22 Nov 2023
What Can AutoML Do For Continual Learning? Mert Kilickaya Joaquin Vanschoren 28 1 0 20 Nov 2023
Two Complementary Perspectives to Continual Learning: Ask Not Only What to Optimize, But Also How Timm Hess Tinne Tuytelaars Gido M. van de Ven 31 7 0 08 Nov 2023
CoinSeg: Contrast Inter- and Intra- Class Representations for Incremental Segmentation Zekang Zhang Guangyu Gao Jianbo Jiao C. Liu Yunchao Wei 46 20 0 10 Oct 2023
Continual Improvement of Threshold-Based Novelty Detection Abe Ejilemele Jorge Mendez-Mendez 17 0 0 05 Sep 2023
CLNeRF: Continual Learning Meets NeRF Zhipeng Cai Matthias Mueller CLL 21 15 0 28 Aug 2023
Online Continual Learning on Hierarchical Label Expansion Byung Hyun Lee Ok-Cheol Jung Jonghyun Choi S. Chun CLL 17 8 0 28 Aug 2023