Overcoming catastrophic forgetting with hard attention to the task

4 January 2018

Joan Serra

Dídac Surís

M. Miron

Alexandros Karatzoglou

CLL

ArXiv PDF HTML

Papers citing "Overcoming catastrophic forgetting with hard attention to the task"

50 / 134 papers shown

Title
Rethinking Client Drift in Federated Learning: A Logit Perspective Yu-bao Yan Chun-Mei Feng Senior Member Ieee Wangmeng Zuo Senior Member Ieee Mang Ye Mong Goh Ping Li Rick Siow Lei Zhu F. I. C. L. Philip Chen FedML 19 8 0 20 Aug 2023
Heterogeneous Forgetting Compensation for Class-Incremental Learning Jiahua Dong Wenqi Liang Yang Cong Gan Sun CLL 19 19 0 07 Aug 2023
Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detection Xiaohui Zhang Jiangyan Yi J. Tao Chenglong Wang Chuyuan Zhang CLL 19 22 0 07 Aug 2023
Online Prototype Learning for Online Continual Learning Yujie Wei Jiaxin Ye Zhizhong Huang Junping Zhang Hongming Shan CLL OnRL 14 39 0 01 Aug 2023
Embodied Lifelong Learning for Task and Motion Planning Jorge Armando Mendez Mendez L. Kaelbling Tomás Lozano-Pérez 22 16 0 13 Jul 2023
Advances and Challenges in Meta-Learning: A Technical Review Anna Vettoruzzo Mohamed-Rafik Bouguelia Joaquin Vanschoren Thorsteinn Rögnvaldsson K. Santosh OffRL 19 70 0 10 Jul 2023
SHARP: Sparsity and Hidden Activation RePlay for Neuro-Inspired Continual Learning Mustafa Burak Gurbuz J. M. Moorman Constantinos Dovrolis CLL 18 0 0 29 May 2023
Camera-Incremental Object Re-Identification with Identity Knowledge Evolution Hantao Yao Lu Yu Jifei Luo Changsheng Xu 21 0 0 25 May 2023
Task Difficulty Aware Parameter Allocation & Regularization for Lifelong Learning Wenjin Wang Yunqing Hu Qianglong Chen Yin Zhang CLL 19 13 0 11 Apr 2023
Exploring Data Geometry for Continual Learning Zhi Gao C. Xu Feng Li Yunde Jia Mehrtash Harandi Yuwei Wu CLL 21 9 0 08 Apr 2023
Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuning Chi Ian Tang Lorena Qendro Dimitris Spathis F. Kawsar Cecilia Mascolo Akhil Mathur CLL 17 10 0 30 Mar 2023
How Efficient Are Today's Continual Learning Algorithms? Md Yousuf Harun Jhair Gallardo Tyler L. Hayes Christopher Kanan 11 22 0 29 Mar 2023
CoDeC: Communication-Efficient Decentralized Continual Learning Sakshi Choudhary Sai Aparna Aketi Gobinda Saha Kaushik Roy CLL 24 3 0 27 Mar 2023
Fixed Design Analysis of Regularization-Based Continual Learning Haoran Li Jingfeng Wu Vladimir Braverman CLL 18 9 0 17 Mar 2023
ICICLE: Interpretable Class Incremental Continual Learning Dawid Rymarczyk Joost van de Weijer Bartosz Zieliñski Bartlomiej Twardowski CLL 16 28 0 14 Mar 2023
Continual Graph Learning: A Survey Qiao Yuan S. Guan Pin Ni Tianlun Luo Ka Lok Man Prudence W. H. Wong Victor I. Chang CLL 24 14 0 28 Jan 2023
Restricted Orthogonal Gradient Projection for Continual Learning Zeyuan Yang Zonghan Yang Peng Li Yang Liu CLL 19 4 0 28 Jan 2023
Unbiased and Efficient Self-Supervised Incremental Contrastive Learning Cheng Ji Jianxin Li Hao Peng Jia Wu Xingcheng Fu Qingyun Sun Phillip S. Yu SSL CLL 6 5 0 28 Jan 2023
Streaming LifeLong Learning With Any-Time Inference S. Banerjee Vinay K. Verma Vinay P. Namboodiri CLL 22 3 0 27 Jan 2023
A soft nearest-neighbor framework for continual semi-supervised learning Zhiqi Kang Enrico Fini Moin Nabi Elisa Ricci Alahari Karteek SSL BDL CLL 14 17 0 09 Dec 2022
G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks Zhongwei Wan Yichun Yin Wei Zhang Jiaxin Shi Lifeng Shang Guangyong Chen Xin Jiang Qun Liu VLM CLL 21 16 0 07 Dec 2022
Progressive Learning without Forgetting Tao Feng Hangjie Yuan Mang Wang Ziyuan Huang Ang Bian Jianzhou Zhang CLL KELM 26 4 0 28 Nov 2022
Multi-Label Continual Learning using Augmented Graph Convolutional Network Kaile Du Fan Lyu Linyan Li Fuyuan Hu Wei Feng Fenglei Xu Xuefeng Xi Hanjing Cheng CLL 16 13 0 27 Nov 2022
BeGin: Extensive Benchmark Scenarios and An Easy-to-use Framework for Graph Continual Learning Jihoon Ko Shinhwan Kang Taehyung Kwon Heechan Moon Kijung Shin CLL 21 7 0 26 Nov 2022
Semi-Supervised Lifelong Language Learning Ying Zhao Yinhe Zheng Yu Bowen Zhiliang Tian Dongkyu Lee Jian Sun Haiyang Yu Yongbin Li N. Zhang CLL KELM 28 3 0 23 Nov 2022
Continual Learning of Natural Language Processing Tasks: A Survey Zixuan Ke Bin Liu KELM CLL VLM 19 67 0 23 Nov 2022
Cold Start Streaming Learning for Deep Networks Cameron R. Wolfe Anastasios Kyrillidis CLL 12 2 0 09 Nov 2022
A Theoretical Study on Solving Continual Learning Gyuhak Kim Changnan Xiao Tatsuya Konishi Zixuan Ke Bin Liu CLL 19 70 0 04 Nov 2022
Learning Tool Morphology for Contact-Rich Manipulation Tasks with Differentiable Simulation Mengxi Li Rika Antonova Dorsa Sadigh Jeannette Bohg 11 4 0 04 Nov 2022
An Exploration of Data Efficiency in Intra-Dataset Task Transfer for Dialog Understanding Josiah Ross Luke Yoffe Alon Albalak William Yang Wang 22 0 0 21 Oct 2022
Multiple Modes for Continual Learning Siddhartha Datta N. Shadbolt CLL MoMe 33 2 0 29 Sep 2022
A Multi-Head Model for Continual Learning via Out-of-Distribution Replay Gyuhak Kim Zixuan Ke Bin Liu VLM CLL OODD 10 29 0 20 Aug 2022
On the Limitations of Continual Learning for Malware Classification Mohammad Saidur Rahman Scott E. Coull M. Wright 15 13 0 13 Aug 2022
UC-OWOD: Unknown-Classified Open World Object Detection Zhi-zong Wu Yue Lu Xingyu Chen Zhengxing Wu Liwen Kang Junzhi Yu 13 55 0 23 Jul 2022
Don't Stop Learning: Towards Continual Learning for the CLIP Model Yuxuan Ding Lingqiao Liu Chunna Tian Jingyuan Yang Haoxuan Ding CLL VLM KELM 11 50 0 19 Jul 2022
E2-AEN: End-to-End Incremental Learning with Adaptively Expandable Network Guimei Cao Zhanzhan Cheng Yunlu Xu Duo Li Shiliang Pu Yi Niu Fei Wu CLL 15 2 0 14 Jul 2022
A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learning Da-Wei Zhou Qiwen Wang Han-Jia Ye De-Chuan Zhan 19 122 0 26 May 2022
Rethinking Task-Incremental Learning Baselines Md. Rejwanul Hossain P. Saha T. Chowdhury Shafin Rahman Fuad Rahman Nabeel Mohammed CLL 17 5 0 23 May 2022
Energy-based Latent Aligner for Incremental Learning K. J. Joseph Salman Khan F. Khan Rao Muhammad Anwer V. Balasubramanian CLL 20 46 0 28 Mar 2022
Meta-attention for ViT-backed Continual Learning Mengqi Xue Haofei Zhang Jie Song Mingli Song CLL 15 41 0 22 Mar 2022
Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals Timo Flesch D. G. Nagy Andrew M. Saxe Christopher Summerfield 16 34 0 22 Mar 2022
Incremental Few-Shot Learning via Implanting and Compressing Yiting Li H. Zhu Xijia Feng Zilong Cheng Jun Ma Cheng Xiang P. Vadakkepat T. Lee CLL VLM 19 2 0 19 Mar 2022
ConTinTin: Continual Learning from Task Instructions Wenpeng Yin Jia Li Caiming Xiong CLL 14 29 0 16 Mar 2022
Continual Learning with Invertible Generative Models Jary Pomponi Simone Scardapane A. Uncini BDL 30 3 0 11 Feb 2022
Class-Incremental Continual Learning into the eXtended DER-verse Matteo Boschini Lorenzo Bonicelli Pietro Buzzega Angelo Porrello Simone Calderara CLL BDL 16 128 0 03 Jan 2022
Self-Supervised Models are Continual Learners Enrico Fini Victor G. Turrisi da Costa Xavier Alameda-Pineda Elisa Ricci Alahari Karteek Julien Mairal BDL CLL SSL 14 157 0 08 Dec 2021
Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks Zixuan Ke Hu Xu Bing-Quan Liu CLL 222 83 0 06 Dec 2021
CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks Zixuan Ke Bing-Quan Liu Hu Xu Lei Shu CLL 12 55 0 05 Dec 2021
Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning Zixuan Ke Bing-Quan Liu Nianzu Ma Hu Xu Lei Shu CLL 178 122 0 05 Dec 2021
Non-IID data and Continual Learning processes in Federated Learning: A long road ahead Marcos F. Criado F. Casado R. Iglesias Carlos V. Regueiro S. Barro FedML 11 76 0 26 Nov 2021