Continual Normalization: Rethinking Batch Normalization for Online Continual Learning

30 March 2022

Papers citing "Continual Normalization: Rethinking Batch Normalization for Online Continual Learning"

36 / 36 papers shown

Title
Human-inspired Perspectives: A Survey on AI Long-term Memory Zihong He Weizhe Lin Hao Zheng Fan Zhang Matt Jones Laurence Aitchison X. Xu Miao Liu Per Ola Kristensson Junxiao Shen 77 2 0 01 Nov 2024
Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspective Quanziang Wang Renzhen Wang Yichen Wu Xixi Jia Minghao Zhou Deyu Meng 32 1 0 26 Aug 2024
ER-FSL: Experience Replay with Feature Subspace Learning for Online Continual Learning Huiwei Lin CLL 22 0 0 17 Jul 2024
CCSI: Continual Class-Specific Impression for Data-free Class Incremental Learning Sana Ayromlou Teresa S. M. Tsang Purang Abolmaesumi Xiaoxiao Li CLL 30 2 0 09 Jun 2024
Exploring the Evolution of Hidden Activations with Live-Update Visualization Xianglin Yang Jin Song Dong 25 0 0 24 May 2024
Integrating Present and Past in Unsupervised Continual Learning Yipeng Zhang Laurent Charlin R. Zemel Mengye Ren CLL 27 2 0 29 Apr 2024
Revisiting Neural Networks for Continual Learning: An Architectural Perspective Aojun Lu Tao Feng Hangjie Yuan Xiaotian Song Yanan Sun 37 7 0 23 Apr 2024
One-Shot Domain Incremental Learning Yasushi Esaki Satoshi Koide Takuro Kutsuna CLL VLM 40 0 0 25 Mar 2024
Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learning Da-Wei Zhou Hai-Long Sun Han-Jia Ye De-Chuan Zhan CLL 38 51 0 18 Mar 2024
Class-incremental Learning for Time Series: Benchmark and Evaluation Zhongzheng Qiao Quang-Cuong Pham Zhen Cao Hoang H Le Ponnuthurai Nagaratnam Suganthan Xudong Jiang Savitha Ramasamy 40 10 0 19 Feb 2024
Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomy Everton L. Aleixo J. Colonna Marco Cristo Everlandio Fernandes CLL 50 21 0 16 Dec 2023
Weighted Ensemble Models Are Strong Continual Learners Imad Eddine Marouf Subhankar Roy Enzo Tartaglione Stéphane Lathuilière CLL 27 16 0 14 Dec 2023
Prior-Free Continual Learning with Unlabeled Data in the Wild Tao Zhuo Zhiyong Cheng Hehe Fan Mohan S. Kankanhalli VLM CLL 33 2 0 16 Oct 2023
Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation Yilin Lyu Liyuan Wang Xingxing Zhang Zicheng Sun Hang Su Jun Zhu Liping Jing 34 8 0 13 Oct 2023
Factorized Tensor Networks for Multi-Task and Multi-Domain Learning Yash Garg Nebiyou Yismaw Rakib Hyder Ashley Prater-Bennette M. Salman Asif 26 2 0 09 Oct 2023
HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learning Huiwei Lin Shanshan Feng Baoquan Zhang Xutao Li Y. Ong CLL 30 0 0 26 Sep 2023
SymED: Adaptive and Online Symbolic Representation of Data on the Edge Daniel Hofstätter Shashikant Ilager Ivan Lujic Ivona Brandić 15 3 0 06 Sep 2023
Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual Learning Filip Szatkowski Mateusz Pyla Marcin Przewiȩźlikowski Sebastian Cygert Bartlomiej Twardowski Tomasz Trzciñski CLL 24 10 0 18 Aug 2023
Class-Incremental Mixture of Gaussians for Deep Continual Learning Lukasz Korycki Bartosz Krawczyk CLL BDL 18 1 0 09 Jul 2023
Does Continual Learning Equally Forget All Parameters? Haiyan Zhao Tianyi Zhou Guodong Long Jing Jiang Chengqi Zhang CLL KELM 32 13 0 09 Apr 2023
Principles of Forgetting in Domain-Incremental Semantic Segmentation in Adverse Weather Conditions Tobias Kalb Jürgen Beyerer CLL 13 4 0 24 Mar 2023
Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need Da-Wei Zhou Han-Jia Ye De-Chuan Zhan Ziwei Liu CLL 28 99 0 13 Mar 2023
Effects of Architectures on Continual Semantic Segmentation Tobias Kalb Niket Ahuja Jingxing Zhou Jürgen Beyerer CLL 26 3 0 21 Feb 2023
New Insights for the Stability-Plasticity Dilemma in Online Continual Learning Dahuin Jung Dongjin Lee Sunwon Hong Hyemi Jang Ho Bae Sungroh Yoon CLL 21 14 0 17 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 33 596 0 31 Jan 2023
On the Soft-Subnetwork for Few-shot Class Incremental Learning Haeyong Kang Jaehong Yoon Sultan Rizky Hikmawan Madjid Sung Ju Hwang Chang-Dong Yoo CLL 47 41 0 15 Sep 2022
Towards Diverse Evaluation of Class Incremental Learning: A Representation Learning Perspective Sungmin Cha Jihwan Kwak Dongsub Shim Hyunwoo J. Kim Moontae Lee Honglak Lee Taesup Moon CLL 28 1 0 16 Jun 2022
Alleviating Representational Shift for Continual Fine-tuning Shibo Jie Zhi-Hong Deng Ziheng Li CLL 22 11 0 22 Apr 2022
On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis Dominik Rivoir Isabel Funke Stefanie Speidel 19 15 0 15 Mar 2022
Diagnosing Batch Normalization in Class Incremental Learning Minghao Zhou Quanziang Wang Jun Shu Qian Zhao Deyu Meng CLL 35 6 0 16 Feb 2022
Architecture Matters in Continual Learning Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Timothy Nguyen Razvan Pascanu Dilan Görür Mehrdad Farajtabar OOD KELM 111 58 0 01 Feb 2022
Rebalancing Batch Normalization for Exemplar-based Class-Incremental Learning Sungmin Cha Sungjun Cho Dasol Hwang Sunwon Hong Moontae Lee Taesup Moon CLL 59 18 0 29 Jan 2022
DualNet: Continual Learning, Fast and Slow Quang-Cuong Pham Chenghao Liu S. Hoi CLL 69 42 0 01 Oct 2021
Task-Specific Normalization for Continual Learning of Blind Image Quality Models Weixia Zhang Kede Ma Guangtao Zhai Xiaokang Yang VLM 26 24 0 28 Jul 2021
TaskNorm: Rethinking Batch Normalization for Meta-Learning J. Bronskill Jonathan Gordon James Requeima Sebastian Nowozin Richard E. Turner 59 89 0 06 Mar 2020
CrossQ: Batch Normalization in Deep Reinforcement Learning for Greater Sample Efficiency and Simplicity Aditya Bhatt Daniel Palenicek Boris Belousov Max Argus Artemij Amiranashvili Thomas Brox Jan Peters 21 43 0 14 Feb 2019