Do Pre-trained Models Benefit Equally in Continual Learning?

Do Pre-trained Models Benefit Equally in Continual Learning?

27 October 2022

Papers citing "Do Pre-trained Models Benefit Equally in Continual Learning?"

14 / 14 papers shown

Title
Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer Zhenrong Liu J. Huttunen M. Honkala CLL 34 0 0 13 May 2025
Parameter-Efficient Continual Fine-Tuning: A Survey Eric Nuertey Coleman Luigi Quarantiello Ziyue Liu Qinwen Yang Samrat Mukherjee J. Hurtado Vincenzo Lomonaco CLL 27 0 0 18 Apr 2025
Does RoBERTa Perform Better than BERT in Continual Learning: An Attention Sink Perspective Xueying Bai Yifan Sun Niranjan Balasubramanian CLL 14 0 0 08 Oct 2024
Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning Xinrui Wang Chuanxing Geng Wenhai Wan Shao-yuan Li Songcan Chen CLL 32 2 0 28 Sep 2024
ReFu: Recursive Fusion for Exemplar-Free 3D Class-Incremental Learning Yi Yang Lei Zhong Huiping Zhuang 3DPC CLL 29 0 0 18 Sep 2024
Class-Incremental Learning with CLIP: Adaptive Representation Adjustment and Parameter Fusion Linlan Huang Xusheng Cao Haori Lu Xialei Liu CLL 40 11 0 19 Jul 2024
An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank Updates Albin Soutif--Cormerais Simone Magistri J. Weijer Andew D. Bagdanov 27 1 0 28 May 2024
Watch Your Step: Optimal Retrieval for Continual Learning at Scale Truman Hickok Dhireesha Kudithipudi 30 0 0 16 Apr 2024
PARMESAN: Parameter-Free Memory Search and Transduction for Dense Prediction Tasks Philip Matthias Winter M. Wimmer David Major Dimitrios Lenis Astrid Berg Theresa Neubauer Gaia Romana De Paolis Johannes Novotny Sophia Ulonska Katja Bühler 34 0 0 18 Mar 2024
Reawakening knowledge: Anticipatory recovery from catastrophic interference via structured training Yanlai Yang Matt Jones Michael C. Mozer Mengye Ren 51 1 0 14 Mar 2024
Learning-on-the-Drive: Self-supervised Adaptation of Visual Offroad Traversability Models Eric Chen Cherie Ho Mukhtar Maulimov Chen Wang S. Scherer 13 9 0 27 Jun 2023
Overcoming the Stability Gap in Continual Learning Md Yousuf Harun Christopher Kanan AI4CE 30 6 0 02 Jun 2023
Learning without Forgetting for Vision-Language Models Da-Wei Zhou Yuanhan Zhang Jingyi Ning Jingyi Ning De-Chuan Zhan De-Chuan Zhan Ziwei Liu VLM CLL 69 37 0 30 May 2023
Knowledge Accumulation in Continually Learned Representations and the Issue of Feature Forgetting Timm Hess Eli Verwimp Gido M. van de Ven Tinne Tuytelaars CLL 10 7 0 03 Apr 2023