Overcoming catastrophic forgetting with hard attention to the task

4 January 2018

Joan Serra

Dídac Surís

M. Miron

Alexandros Karatzoglou

CLL

ArXiv PDF HTML

Papers citing "Overcoming catastrophic forgetting with hard attention to the task"

45 / 145 papers shown

Title
Continual Learning with Invertible Generative Models Jary Pomponi Simone Scardapane A. Uncini BDL 30 3 0 11 Feb 2022
Class-Incremental Continual Learning into the eXtended DER-verse Matteo Boschini Lorenzo Bonicelli Pietro Buzzega Angelo Porrello Simone Calderara CLL BDL 16 128 0 03 Jan 2022
Continual Learning with Knowledge Transfer for Sentiment Classification Zixuan Ke Bing-Quan Liu Hao Wang Lei Shu CLL 6 29 0 18 Dec 2021
Self-Supervised Models are Continual Learners Enrico Fini Victor G. Turrisi da Costa Xavier Alameda-Pineda Elisa Ricci Alahari Karteek Julien Mairal BDL CLL SSL 14 157 0 08 Dec 2021
Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks Zixuan Ke Hu Xu Bing-Quan Liu CLL 222 83 0 06 Dec 2021
CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks Zixuan Ke Bing-Quan Liu Hu Xu Lei Shu CLL 12 55 0 05 Dec 2021
Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning Zixuan Ke Bing-Quan Liu Nianzu Ma Hu Xu Lei Shu CLL 178 122 0 05 Dec 2021
Non-IID data and Continual Learning processes in Federated Learning: A long road ahead Marcos F. Criado F. Casado R. Iglesias Carlos V. Regueiro S. Barro FedML 11 76 0 26 Nov 2021
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 30 295 0 22 Nov 2021
Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse Networks Ghada Sokar D. Mocanu Mykola Pechenizkiy CLL 8 8 0 11 Oct 2021
Powerpropagation: A sparsity inducing weight reparameterisation Jonathan Richard Schwarz Siddhant M. Jayakumar Razvan Pascanu P. Latham Yee Whye Teh 87 54 0 01 Oct 2021
Total Recall: a Customized Continual Learning Method for Neural Semantic Parsers Zhuang Li Lizhen Qu Gholamreza Haffari CLL 24 15 0 11 Sep 2021
Saliency Guided Experience Packing for Replay in Continual Learning Gobinda Saha Kaushik Roy VLM KELM CLL 92 21 0 10 Sep 2021
An Investigation of Replay-based Approaches for Continual Learning Benedikt Bagus A. Gepperth CLL 22 31 0 15 Aug 2021
Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observations Zike Yan Yuxin Tian Xuesong Shi Ping Guo Peng Wang H. Zha CLL 17 45 0 12 Aug 2021
Generalized Source-free Domain Adaptation Shiqi Yang Yaxing Wang Joost van de Weijer Luis Herranz Shangling Jui TTA 5 252 0 03 Aug 2021
Co $^2$ L: Contrastive Continual Learning Hyuntak Cha Jaeho Lee Jinwoo Shin CLL SSL VLM 26 291 0 28 Jun 2021
Generative Feature-driven Image Replay for Continual Learning Kevin Thandiackal Tiziano Portenier Andrea Giovannini M. Gabrani O. Goksel CLL VLM DiffM 11 9 0 09 Jun 2021
Overcoming Catastrophic Forgetting with Gaussian Mixture Replay Benedikt Pfülb A. Gepperth VLM BDL 16 12 0 19 Apr 2021
New Insights on Reducing Abrupt Representation Change in Online Continual Learning Lucas Page-Caccia Rahaf Aljundi Nader Asadi Tinne Tuytelaars Joelle Pineau Eugene Belilovsky CLL 21 185 0 11 Apr 2021
Replay in Deep Learning: Current Approaches and Missing Biological Elements Tyler L. Hayes G. Krishnan M. Bazhenov H. Siegelmann T. Sejnowski Christopher Kanan CLL 19 129 0 01 Apr 2021
Efficient Feature Transformations for Discriminative and Generative Continual Learning Vinay K. Verma Kevin J Liang Nikhil Mehta Piyush Rai Lawrence Carin CLL 23 76 0 25 Mar 2021
Gradient Projection Memory for Continual Learning Gobinda Saha Isha Garg Kaushik Roy VLM CLL 24 266 0 17 Mar 2021
Training Networks in Null Space of Feature Covariance for Continual Learning Shipeng Wang Xiaorong Li Jian Sun Zongben Xu CLL 23 129 0 12 Mar 2021
Selective Replay Enhances Learning in Online Continual Analogical Reasoning Tyler L. Hayes Christopher Kanan CLL 16 20 0 06 Mar 2021
Towards Open World Object Detection K. J. Joseph Salman Khan F. Khan V. Balasubramanian ObjD 19 448 0 03 Mar 2021
Understanding Catastrophic Forgetting and Remembering in Continual Learning with Optimal Relevance Mapping Prakhar Kaushik Alex Gain Adam Kortylewski Alan Yuille CLL 11 68 0 22 Feb 2021
Generalized Variational Continual Learning Noel Loo S. Swaroop Richard E. Turner BDL CLL 17 58 0 24 Nov 2020
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data Jonathan Pilault Amine Elhattami C. Pal CLL MoE 19 89 0 19 Sep 2020
A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learning Martin Mundt Yongjun Hong Iuliia Pliushch Visvanathan Ramesh CLL 14 146 0 03 Sep 2020
Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semantics V. Ramasesh Ethan Dyer M. Raghu CLL 22 173 0 14 Jul 2020
RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning Riccardo Del Chiaro Bartlomiej Twardowski Andrew D. Bagdanov Joost van de Weijer CLL VLM 11 40 0 13 Jul 2020
Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent Mehdi Abbana Bennani Thang Doan Masashi Sugiyama CLL 23 61 0 21 Jun 2020
Self-Supervised Learning Aided Class-Incremental Lifelong Learning Song Zhang Gehui Shen Jinsong Huang Zhihong Deng CLL 20 14 0 10 Jun 2020
Few-Shot Class-Incremental Learning Xiaoyu Tao Xiaopeng Hong Xinyuan Chang Songlin Dong Xing Wei Yihong Gong CLL 15 401 0 23 Apr 2020
Conditional Channel Gated Networks for Task-Aware Continual Learning Davide Abati Jakub M. Tomczak Tijmen Blankevoort Simone Calderara Rita Cucchiara B. Bejnordi CLL 23 184 0 31 Mar 2020
Frosting Weights for Better Continual Training Xiaofeng Zhu Feng Liu Goce Trajcevski Dingding Wang FedML AI4CE CLL 28 5 0 07 Jan 2020
REMIND Your Neural Network to Prevent Catastrophic Forgetting Tyler L. Hayes Kushal Kafle Robik Shrestha Manoj Acharya Christopher Kanan CLL 29 293 0 06 Oct 2019
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation Dongmin Park Seokil Hong Bohyung Han Kyoung Mu Lee AAML CLL 16 39 0 08 Aug 2019
Overcoming Catastrophic Forgetting by Neuron-level Plasticity Control Inyoung Paik Sangjun Oh Taeyeong Kwak Injung Kim CLL 21 49 0 31 Jul 2019
Lifelong GAN: Continual Learning for Conditional Image Generation Mengyao Zhai Lei Chen Frederick Tung Jiawei He Megha Nawhal Greg Mori CLL 17 178 0 23 Jul 2019
Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning O. Ostapenko M. Puscas T. Klein P. Jähnichen Moin Nabi CLL 41 296 0 05 Apr 2019
Selfless Sequential Learning Rahaf Aljundi Marcus Rohrbach Tinne Tuytelaars CLL 23 113 0 14 Jun 2018
Overcoming Catastrophic Interference by Conceptors Xu He H. Jaeger BDL 24 13 0 16 Jul 2017
On the Origin of Deep Learning Haohan Wang Bhiksha Raj MedIm 3DV VLM 40 222 0 24 Feb 2017