A Comprehensive Survey of Continual Learning: Theory, Method and Application

31 January 2023

Liyuan Wang

Xingxing Zhang

Hang Su

Jun Zhu

KELM

CLL

ArXiv PDF HTML

Papers citing "A Comprehensive Survey of Continual Learning: Theory, Method and Application"

50 / 135 papers shown

Title
ReFu: Recursive Fusion for Exemplar-Free 3D Class-Incremental Learning Yi Yang Lei Zhong Huiping Zhuang 3DPC CLL 29 0 0 18 Sep 2024
Wind turbine condition monitoring based on intra- and inter-farm federated learning Albin Grataloup Stefan Jonas Angela Meyer AI4CE 18 0 0 05 Sep 2024
Prompt Baking Aman Bhargava Cameron Witkowski Alexander Detkov Matt W. Thomson AI4CE 28 0 0 04 Sep 2024
Mitigating the Stability-Plasticity Dilemma in Adaptive Train Scheduling with Curriculum-Driven Continual DQN Expansion Achref Jaziri Etienne Kunzel Visvanathan Ramesh CLL 45 0 0 19 Aug 2024
An Effective Dynamic Gradient Calibration Method for Continual Learning Weichen Lin Jiaxiang Chen Ru Huang Huihua Ding CLL 44 0 0 30 Jul 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 72 1 0 30 Jul 2024
CLIP with Generative Latent Replay: a Strong Baseline for Incremental Learning Emanuele Frascaroli Aniello Panariello Pietro Buzzega Lorenzo Bonicelli Angelo Porrello Simone Calderara VLM CLL 35 3 0 22 Jul 2024
Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning Qifan Zhang Yunhui Guo Yu Xiang VLM CLL 54 0 0 18 Jul 2024
R+X: Retrieval and Execution from Everyday Human Videos Georgios Papagiannis Norman Di Palo Pietro Vitiello Edward Johns 51 15 0 17 Jul 2024
HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning Liyuan Wang Jingyi Xie Xingxing Zhang Hang Su Jun Zhu CLL 45 4 0 07 Jul 2024
Learning System Dynamics without Forgetting Xikun Zhang Dongjin Song Yushan Jiang Yixin Chen Dacheng Tao AI4CE 35 2 0 30 Jun 2024
Towards Synchronous Memorizability and Generalizability with Site-Modulated Diffusion Replay for Cross-Site Continual Segmentation Dunyuan Xu Xi Wang Jingyang Zhang Pheng-Ann Heng MedIm CLL 93 0 0 26 Jun 2024
A Survey of Meta-features Used for Automated Selection of Algorithms for Black-box Single-objective Continuous Optimization Gjorgjina Cenikj Ana Nikolikj Gašper Petelin N. V. Stein Carola Doerr T. Eftimov 38 1 0 08 Jun 2024
Adversarially Diversified Rehearsal Memory (ADRM): Mitigating Memory Overfitting Challenge in Continual Learning Hikmat Khan Ghulam Rasool N. Bouaynaya AAML 20 0 0 20 May 2024
Preparing for Black Swans: The Antifragility Imperative for Machine Learning Ming Jin 34 2 0 18 May 2024
General Place Recognition Survey: Towards Real-World Autonomy Peng Yin Jianhao Jiao Shiqi Zhao Lingyun Xu Guoquan Huang Howie Choset Sebastian A. Scherer Jianda Han 42 7 0 08 May 2024
HFT: Half Fine-Tuning for Large Language Models Tingfeng Hui Zhenyu Zhang Shuohuan Wang Weiran Xu Yu Sun Hua-Hong Wu CLL 37 4 0 29 Apr 2024
From Matching to Generation: A Survey on Generative Information Retrieval Xiaoxi Li Jiajie Jin Yujia Zhou Yuyao Zhang Peitian Zhang Yutao Zhu Zhicheng Dou 3DV 67 45 0 23 Apr 2024
Brain-Inspired Continual Learning-Robust Feature Distillation and Re-Consolidation for Class Incremental Learning Hikmat Khan N. Bouaynaya Ghulam Rasool CLL 36 1 0 22 Apr 2024
Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computation Wenxuan Zhang Youssef Mohamed Bernard Ghanem Philip H. S. Torr Adel Bibi Mohamed Elhoseiny CLL 29 5 0 19 Apr 2024
Confidence Self-Calibration for Multi-Label Class-Incremental Learning Kaile Du Yifan Zhou Fan Lyu Yuyang Li Chen Lu Guangcan Liu CLL 30 2 0 19 Mar 2024
PARMESAN: Parameter-Free Memory Search and Transduction for Dense Prediction Tasks Philip Matthias Winter M. Wimmer David Major Dimitrios Lenis Astrid Berg Theresa Neubauer Gaia Romana De Paolis Johannes Novotny Sophia Ulonska Katja Bühler 34 0 0 18 Mar 2024
Hyperparameters in Continual Learning: A Reality Check Sungmin Cha Kyunghyun Cho CLL 71 2 0 14 Mar 2024
DAM: Dynamic Adapter Merging for Continual Video QA Learning Feng Cheng Ziyang Wang Yi-Lin Sung Yan-Bo Lin Mohit Bansal Gedas Bertasius CLL MoMe 31 10 0 13 Mar 2024
A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends Abolfazl Younesi Mohsen Ansari Mohammadamin Fazli A. Ejlali Muhammad Shafique Joerg Henkel 3DV 38 44 0 23 Feb 2024
TinyCL: An Efficient Hardware Architecture for Continual Learning on Autonomous Systems Eugenio Ressa Alberto Marchisio Maurizio Martina Guido Masera Muhammad Shafique 32 0 0 15 Feb 2024
Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models Weijiao Zhang Jindong Han Zhao Xu Hang Ni Hao Liu Hui Xiong Hui Xiong AI4CE 77 15 0 30 Jan 2024
Hierarchical Continual Reinforcement Learning via Large Language Model Chaofan Pan Xin Yang Hao Wang Wei Wei Tianrui Li 20 2 0 25 Jan 2024
EsaCL: Efficient Continual Learning of Sparse Models Weijieying Ren V. Honavar CLL 15 3 0 11 Jan 2024
Managing the unknown: a survey on Open Set Recognition and tangential areas Marcos Barcina-Blanco J. Lobo Pablo Garcia-Bringas Javier Del Ser VLM 22 2 0 14 Dec 2023
Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models Kyra Ahrens Hans Hergen Lehmann Jae Hee Lee Stefan Wermter CLL 18 7 0 13 Dec 2023
Towards a General Framework for Continual Learning with Pre-training Liyuan Wang Jingyi Xie Xingxing Zhang Hang Su Jun Zhu CLL 29 3 0 21 Oct 2023
Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation Yilin Lyu Liyuan Wang Xingxing Zhang Zicheng Sun Hang Su Jun Zhu Liping Jing 27 8 0 13 Oct 2023
HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learning Huiwei Lin Shanshan Feng Baoquan Zhang Xutao Li Y. Ong CLL 25 0 0 26 Sep 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook Muhammad Awais Muzammal Naseer Salman Khan Rao Muhammad Anwer Hisham Cholakkal M. Shah Ming Yang F. Khan VLM 18 117 0 25 Jul 2023
Continual Learning as Computationally Constrained Reinforcement Learning Saurabh Kumar Henrik Marklund Anand Srinivasa Rao Yifan Zhu Hong Jun Jeon Yueyang Liu Benjamin Van Roy CLL 27 22 0 10 Jul 2023
DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes Xilin Jiang Yinghao Aaron Li N. Mesgarani CLL 19 1 0 29 May 2023
The Ideal Continual Learner: An Agent That Never Forgets Liangzu Peng Paris V. Giampouras René Vidal CLL 106 26 0 29 Apr 2023
Asynchronous Federated Continual Learning Donald Shenaj Marco Toldo Alberto Rigon Pietro Zanuttigh FedML CLL 14 34 0 07 Apr 2023
Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery Mingxuan Liu Subhankar Roy Zhun Zhong N. Sebe Elisa Ricci CLL SSL 32 10 0 28 Mar 2023
First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learning A. Panos Yuriko Kobe Daniel Olmeda Reino Rahaf Aljundi Richard E. Turner CLL 95 42 0 23 Mar 2023
Towards Label-Efficient Incremental Learning: A Survey Mert Kilickaya Joost van de Weijer Yuki M. Asano CLL 20 4 0 01 Feb 2023
A soft nearest-neighbor framework for continual semi-supervised learning Zhiqi Kang Enrico Fini Moin Nabi Elisa Ricci Alahari Karteek SSL BDL CLL 14 17 0 09 Dec 2022
Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning Zenglin Shi Jing Jie Ying Sun J. Lim Mengmi Zhang CLL 32 1 0 21 Nov 2022
Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfer Sen Lin Li Yang Deliang Fan Junshan Zhang CLL 111 42 0 01 Nov 2022
Continual Training of Language Models for Few-Shot Learning Zixuan Ke Haowei Lin Yijia Shao Hu Xu Lei Shu Bin Liu KELM BDL CLL 85 34 0 11 Oct 2022
Continual Learning by Modeling Intra-Class Variation L. Yu Tianyang Hu Lanqing Hong Zhen Liu Adrian Weller Weiyang Liu CLL 35 12 0 11 Oct 2022
Few-Shot Continual Active Learning by a Robot Ali Ayub C. Fendley CLL 32 29 0 09 Oct 2022
Long-Tailed Class Incremental Learning Xialei Liu Yu-Song Hu Xuezhi Cao Andrew D. Bagdanov Ke Li Mingg-Ming Cheng CLL 63 35 0 01 Oct 2022
A simple but strong baseline for online continual learning: Repeated Augmented Rehearsal Yaqian Zhang Bernhard Pfahringer E. Frank Albert Bifet N. Lim Yunzhe Jia CLL 104 40 0 28 Sep 2022