Orthogonal Gradient Descent for Continual Learning

15 October 2019

Papers citing "Orthogonal Gradient Descent for Continual Learning"

24 / 74 papers shown

Title
Prompt-aligned Gradient for Prompt Tuning Beier Zhu Yulei Niu Yucheng Han Yuehua Wu Hanwang Zhang VLM 183 271 0 30 May 2022
Memory Bounds for Continual Learning Xi Chen Christos H. Papadimitriou Binghui Peng CLL LRM 29 22 0 22 Apr 2022
Efficient Test-Time Model Adaptation without Forgetting Shuaicheng Niu Jiaxiang Wu Yifan Zhang Yaofo Chen S. Zheng P. Zhao Mingkui Tan OOD VLM TTA 28 308 0 06 Apr 2022
Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals Timo Flesch D. G. Nagy Andrew M. Saxe Christopher Summerfield 26 34 0 22 Mar 2022
Architecture Matters in Continual Learning Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Timothy Nguyen Razvan Pascanu Dilan Görür Mehrdad Farajtabar OOD KELM 116 58 0 01 Feb 2022
Technical Report for ICCV 2021 Challenge SSLAD-Track3B: Transformers Are Better Continual Learners Duo Li Guimei Cao Yunlu Xu Zhanzhan Cheng Yi Niu CLL 22 21 0 13 Jan 2022
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 30 295 0 22 Nov 2021
One Pass ImageNet Huiyi Hu Ang Li Daniele Calandriello Dilan Görür VLM 11 18 0 03 Nov 2021
Provable Lifelong Learning of Representations Xinyuan Cao Weiyang Liu Santosh Vempala CLL 21 13 0 27 Oct 2021
Saliency Guided Experience Packing for Replay in Continual Learning Gobinda Saha Kaushik Roy VLM KELM CLL 94 21 0 10 Sep 2021
A review of mobile robot motion planning methods: from classical motion planning workflows to reinforcement learning-based architectures Jiawei Wang Zicheng He Chunwei Song Changyin Sun 38 54 0 31 Aug 2021
Auxiliary Task Update Decomposition: The Good, The Bad and The Neutral Lucio Dery Yann N. Dauphin David Grangier MoMe 13 29 0 25 Aug 2021
Learning a Neural Diff for Speech Models J. Macoskey Grant P. Strimel Ariya Rastrow 13 2 0 03 Aug 2021
Bayesian Embeddings for Few-Shot Open World Recognition John Willes James Harrison Ali Harakeh Chelsea Finn Marco Pavone Steven Waslander BDL OffRL 22 18 0 29 Jul 2021
Task-agnostic Continual Learning with Hybrid Probabilistic Models Polina Kirichenko Mehrdad Farajtabar Dushyant Rao Balaji Lakshminarayanan Nir Levine Ang Li Huiyi Hu A. Wilson Razvan Pascanu VLM BDL CLL 21 19 0 24 Jun 2021
Continual Learning in Sensor-based Human Activity Recognition: an Empirical Benchmark Analysis Saurav Jha Martin Schiemer F. Zambonelli Juan Ye 23 48 0 19 Apr 2021
Gradient Projection Memory for Continual Learning Gobinda Saha Isha Garg Kaushik Roy VLM CLL 39 266 0 17 Mar 2021
Continual Learning with Deep Artificial Neurons Blake Camp J. Mandivarapu Rolando Estrada 18 8 0 13 Nov 2020
Continual Learning in Low-rank Orthogonal Subspaces Arslan Chaudhry Naeemullah Khan P. Dokania Philip H. S. Torr CLL 33 113 0 22 Oct 2020
Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Dilan Görür Razvan Pascanu H. Ghasemzadeh CLL 29 138 0 09 Oct 2020
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 15 80 0 07 Oct 2020
Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent Mehdi Abbana Bennani Thang Doan Masashi Sugiyama CLL 50 61 0 21 Jun 2020
Disturbance-immune Weight Sharing for Neural Architecture Search Shuaicheng Niu Jiaxiang Wu Yifan Zhang Yong Guo P. Zhao Junzhou Huang Mingkui Tan 15 27 0 29 Mar 2020
Gradient Surgery for Multi-Task Learning Tianhe Yu Saurabh Kumar Abhishek Gupta Sergey Levine Karol Hausman Chelsea Finn 14 1,165 0 19 Jan 2020