Self-Supervised Models are Continual Learners

8 December 2021

Enrico Fini

Victor G. Turrisi da Costa

Xavier Alameda-Pineda

Papers citing "Self-Supervised Models are Continual Learners"

50 / 101 papers shown

Title
An Analysis of Initial Training Strategies for Exemplar-Free Class-Incremental Learning Grégoire Petit Michael Soumm Eva Feillet Adrian Daniel Popescu Bertrand Delezoide David Picard C´eline Hudelot CLL 19 7 0 22 Aug 2023
Audio-Visual Class-Incremental Learning Weiguo Pian Shentong Mo Yunhui Guo Yapeng Tian CLL VLM 20 27 0 21 Aug 2023
A Comprehensive Empirical Evaluation on Online Continual Learning Albin Soutif--Cormerais Antonio Carta Andrea Cossu J. Hurtado Hamed Hemati Vincenzo Lomonaco Joost van de Weijer CLL 24 20 0 20 Aug 2023
On the Effectiveness of LayerNorm Tuning for Continual Learning in Vision Transformers Thomas De Min Massimiliano Mancini Alahari Karteek Xavier Alameda-Pineda Elisa Ricci CLL 8 9 0 18 Aug 2023
Continual Pre-Training of Large Language Models: How to (re)warm your model? Kshitij Gupta Benjamin Thérien Adam Ibrahim Mats L. Richter Quentin G. Anthony Eugene Belilovsky Irina Rish Timothée Lesort KELM 22 99 0 08 Aug 2023
Class Incremental Learning with Self-Supervised Pre-Training and Prototype Learning Wenzhuo Liu Xinjian Wu Fei Zhu Mingming Yu Chuan Wang Cheng-Lin Liu SSL CLL 24 11 0 04 Aug 2023
Online Prototype Learning for Online Continual Learning Yujie Wei Jiaxin Ye Zhizhong Huang Junping Zhang Hongming Shan CLL OnRL 25 39 0 01 Aug 2023
Downstream-agnostic Adversarial Examples Ziqi Zhou Shengshan Hu Rui-Qing Zhao Qian Wang L. Zhang Junhui Hou Hai Jin SILM AAML 16 24 0 23 Jul 2023
MoP-CLIP: A Mixture of Prompt-Tuned CLIP Models for Domain Incremental Learning Julien Nicolas Florent Chiaroni Imtiaz Masud Ziko Ola Ahmad Christian Desrosiers Jose Dolz VLM CLL 18 5 0 11 Jul 2023
Test-Time Training on Video Streams Renhao Wang Yu Sun Yossi Gandelsman Xinlei Chen Alexei A. Efros Alexei A. Efros Xiaolong Wang TTA ViT 3DGS 24 16 0 11 Jul 2023
Continual Learners are Incremental Model Generalizers Jaehong Yoon Sung Ju Hwang Yu Cao CLL 31 4 0 21 Jun 2023
Semi-supervised learning made simple with self-supervised clustering Enrico Fini Pietro Astolfi Alahari Karteek Xavier Alameda-Pineda Julien Mairal Moin Nabi Elisa Ricci SSL 34 24 0 13 Jun 2023
Regularizing with Pseudo-Negatives for Continual Self-Supervised Learning Sungmin Cha Kyunghyun Cho Taesup Moon BDL CLL 15 2 0 08 Jun 2023
Learning Representations on the Unit Sphere: Investigating Angular Gaussian and von Mises-Fisher Distributions for Online Continual Learning Nicolas Michel Giovanni Chierchia Romain Negrel J. Bercher 6 2 0 06 Jun 2023
DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes Xilin Jiang Yinghao Aaron Li N. Mesgarani CLL 19 1 0 29 May 2023
On the Effectiveness of Equivariant Regularization for Robust Online Continual Learning Lorenzo Bonicelli Matteo Boschini Emanuele Frascaroli Angelo Porrello M. Pennisi Giovanni Bellitto S. Palazzo C. Spampinato Simone Calderara CLL 24 3 0 05 May 2023
Self-supervised Activity Representation Learning with Incremental Data: An Empirical Study Jason Liu Shohreh Deldari Hao Xue Van-Hau Nguyen Flora D. Salim AI4TS CLL SSL 19 2 0 01 May 2023
Density Map Distillation for Incremental Object Counting Chenshen Wu Joost van de Weijer 18 2 0 11 Apr 2023
EMP-SSL: Towards Self-Supervised Learning in One Training Epoch Shengbang Tong Yubei Chen Y. Ma Yann LeCun 13 24 0 08 Apr 2023
Knowledge Accumulation in Continually Learned Representations and the Issue of Feature Forgetting Timm Hess Eli Verwimp Gido M. van de Ven Tinne Tuytelaars CLL 15 7 0 03 Apr 2023
Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuning Chi Ian Tang Lorena Qendro Dimitris Spathis F. Kawsar Cecilia Mascolo Akhil Mathur CLL 22 10 0 30 Mar 2023
Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery Mingxuan Liu Subhankar Roy Zhun Zhong N. Sebe Elisa Ricci CLL SSL 32 10 0 28 Mar 2023
Preserving Linear Separability in Continual Learning by Backward Feature Projection Qiao Gu Dongsub Shim Florian Shkurti CLL KELM 13 10 0 26 Mar 2023
CSSL-MHTR: Continual Self-Supervised Learning for Scalable Multi-script Handwritten Text Recognition M. Dhiaf Mohamed Ali Souibgui Kai Wang Yuyang Liu Yousri Kessentini Alicia Fornés Ahmed Cheikh Rouhou CLL 10 2 0 16 Mar 2023
Efficient Self-supervised Continual Learning with Progressive Task-correlated Layer Freezing Li Yang Sen Lin Fan Zhang Junshan Zhang Deliang Fan CLL 14 6 0 13 Mar 2023
PromptFusion: Decoupling Stability and Plasticity for Continual Learning Haoran Chen Zuxuan Wu Xintong Han Menglin Jia Yu-Gang Jiang CLL 106 12 0 13 Mar 2023
SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Model Gengwei Zhang Liyuan Wang Guoliang Kang Ling-Hao Chen Yunchao Wei CLL 26 106 0 09 Mar 2023
Improving Representational Continuity via Continued Pretraining Michael Sun Ananya Kumar Divyam Madaan Percy Liang CLL 6 2 0 26 Feb 2023
Generalized Few-Shot Continual Learning with Contrastive Mixture of Adapters Yawen Cui Zitong Yu Rizhao Cai Xuna Wang Alex C. Kot Li Liu CLL 15 7 0 12 Feb 2023
Towards Label-Efficient Incremental Learning: A Survey Mert Kilickaya Joost van de Weijer Yuki M. Asano CLL 20 4 0 01 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 24 592 0 31 Jan 2023
Are Labels Needed for Incremental Instance Learning? Mert Kilickaya Joaquin Vanschoren CLL SSL 19 1 0 26 Jan 2023
A soft nearest-neighbor framework for continual semi-supervised learning Zhiqi Kang Enrico Fini Moin Nabi Elisa Ricci Alahari Karteek SSL BDL CLL 14 17 0 09 Dec 2022
Exemplar-free Continual Learning of Vision Transformers via Gated Class-Attention and Cascaded Feature Drift Compensation Marco Cotogni Fei Yang C. Cusano Andrew D. Bagdanov Joost van de Weijer CLL 22 0 0 22 Nov 2022
FUSSL: Fuzzy Uncertain Self Supervised Learning S. Mohamadi Gianfranco Doretto Donald Adjeroh 11 6 0 28 Oct 2022
Is Multi-Task Learning an Upper Bound for Continual Learning? Zihao Wu Huy Tran Hamed Pirsiavash Soheil Kolouri SSL CLL 13 4 0 26 Oct 2022
On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learning Lorenzo Bonicelli Matteo Boschini Angelo Porrello C. Spampinato Simone Calderara CLL 10 44 0 12 Oct 2022
Beyond Supervised Continual Learning: a Review Benedikt Bagus A. Gepperth Timothée Lesort BDL CLL 14 10 0 30 Aug 2022
SCALE: Online Self-Supervised Lifelong Learning without Prior Knowledge Xiaofan Yu Yunhui Guo Sicun Gao Tajana Simunic CLL SSL 22 14 0 24 Aug 2022
S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning Yabin Wang Zhiwu Huang Xiaopeng Hong CLL VLM 22 208 0 26 Jul 2022
Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay Huan Liu Li Gu Zhixiang Chi Yang Wang Yuanhao Yu Jun Chen Jingshan Tang 17 80 0 22 Jul 2022
Consistency is the key to further mitigating catastrophic forgetting in continual learning Prashant Bhat Bahram Zonooz Elahe Arani CLL 32 16 0 11 Jul 2022
Towards Diverse Evaluation of Class Incremental Learning: A Representation Learning Perspective Sungmin Cha Jihwan Kwak Dongsub Shim Hyunwoo J. Kim Moontae Lee Honglak Lee Taesup Moon CLL 23 1 0 16 Jun 2022
Continual Barlow Twins: continual self-supervised learning for remote sensing semantic segmentation V. Marsocci Simone Scardapane CLL 24 25 0 23 May 2022
Continual Pre-Training Mitigates Forgetting in Language and Vision Andrea Cossu Tinne Tuytelaars Antonio Carta Lucia C. Passaro Vincenzo Lomonaco D. Bacciu KELM VLM CLL 14 67 0 19 May 2022
Learning Representations for New Sound Classes With Continual Self-Supervised Learning Zhepei Wang Cem Subakan Xilin Jiang Junkai Wu Efthymios Tzinis Mirco Ravanelli Paris Smaragdis CLL SSL 57 19 0 15 May 2022
DualNet: Continual Learning, Fast and Slow Quang-Cuong Pham Chenghao Liu S. Hoi CLL 69 42 0 01 Oct 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 183 450 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 298 5,761 0 29 Apr 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 278 0 12 Feb 2021