Continual Learning in Low-rank Orthogonal Subspaces

Continual Learning in Low-rank Orthogonal Subspaces

22 October 2020

Arslan Chaudhry

Naeemullah Khan

Philip H. S. Torr

Papers citing "Continual Learning in Low-rank Orthogonal Subspaces"

16 / 16 papers shown

Title
Mitigating Catastrophic Forgetting in the Incremental Learning of Medical Images Sara Yavari Jacob Furst CLL 53 0 0 28 Apr 2025
Continual Learning With Quasi-Newton Methods Steven Vander Eeckt Hugo Van hamme CLL BDL 63 0 0 25 Mar 2025
Orthogonal Calibration for Asynchronous Federated Learning Jiayun Zhang Shuheng Li Haiyu Huang Xiaofan Yu Rajesh K. Gupta Jingbo Shang FedML 58 0 0 21 Feb 2025
Steinmetz Neural Networks for Complex-Valued Data Shyam Venkatasubramanian Ali Pezeshki Vahid Tarokh 115 0 0 17 Feb 2025
CENSOR: Defense Against Gradient Inversion via Orthogonal Subspace Bayesian Sampling Kaiyuan Zhang Siyuan Cheng Guangyu Shen Bruno Ribeiro Shengwei An Pin-Yu Chen X. Zhang Ninghui Li 90 0 0 28 Jan 2025
SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture Jiayi Han Liang Du Hongwei Du Xiangguo Zhou Yiwen Wu Weibo Zheng Donghong Han CLL MoMe MoE 38 2 0 10 Oct 2024
AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models Junfeng Fang Houcheng Jiang Kun Wang Yunshan Ma Shi Jie Xiangnan He Tat-Seng Chua Tat-seng Chua KELM 35 33 0 03 Oct 2024
Breaking Neural Network Scaling Laws with Modularity Akhilan Boopathy Sunshine Jiang William Yue Jaedong Hwang Abhiram Iyer Ila Fiete OOD 34 2 0 09 Sep 2024
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection Jiawei Zhao Zhenyu (Allen) Zhang Beidi Chen Zhangyang Wang A. Anandkumar Yuandong Tian 41 173 0 06 Mar 2024
Clustering-based Domain-Incremental Learning Christiaan Lamers René Vidal A. Belbachir N. V. Stein Thomas Baeck Paris Giampouras CLL OOD 19 10 0 21 Sep 2023
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 91 32 0 29 Apr 2023
A Theoretical Study on Solving Continual Learning Gyuhak Kim Changnan Xiao Tatsuya Konishi Zixuan Ke Bin Liu CLL 19 70 0 04 Nov 2022
A Multi-Head Model for Continual Learning via Out-of-Distribution Replay Gyuhak Kim Zixuan Ke Bin Liu VLM CLL OODD 15 29 0 20 Aug 2022
Memory Bounds for Continual Learning Xi Chen Christos H. Papadimitriou Binghui Peng CLL LRM 20 22 0 22 Apr 2022
Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals Timo Flesch D. G. Nagy Andrew M. Saxe Christopher Summerfield 16 34 0 22 Mar 2022
Generative Kernel Continual learning Mohammad Mahdi Derakhshani Xiantong Zhen Ling Shao Cees G. M. Snoek BDL VLM 33 0 0 26 Dec 2021