An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks

21 December 2013

Aaron Courville

Papers citing "An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks"

42 / 292 papers shown

Title
From Video Game to Real Robot: The Transfer between Action Spaces Janne Karttunen Anssi Kanervisto Ville Kyrki Ville Hautamaki 22 8 0 02 May 2019
Semantic-Aware Knowledge Preservation for Zero-Shot Sketch-Based Image Retrieval Qing Liu Lingxi Xie Huiyu Wang Alan Yuille VLM 27 108 0 05 Apr 2019
Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning O. Ostapenko M. Puscas T. Klein P. Jähnichen Moin Nabi CLL 60 297 0 05 Apr 2019
Class-incremental Learning via Deep Model Consolidation Junting Zhang Jie Zhang Shalini Ghosh Dawei Li Serafettin Tasci Larry Heck Heming Zhang C.-C. Jay Kuo CLL 27 335 0 19 Mar 2019
Robust and Communication-Efficient Federated Learning from Non-IID Data Felix Sattler Simon Wiedemann K. Müller Wojciech Samek FedML 24 1,335 0 07 Mar 2019
Never Forget: Balancing Exploration and Exploitation via Learning Optical Flow Hsuan-Kung Yang Po-Han Chiang Kuan-Wei Ho Min-Fong Hong Chun-Yi Lee 35 7 0 24 Jan 2019
Transfer learning to model inertial confinement fusion experiments K. Humbird J. Peterson R. McClarren 8 62 0 14 Dec 2018
Partitioned Variational Inference: A unified framework encompassing federated and continual learning T. Bui Cuong V Nguyen S. Swaroop Richard Turner FedML 27 55 0 27 Nov 2018
Concept-Oriented Deep Learning: Generative Concept Representations Daniel T. Chang DRL GAN BDL 36 12 0 15 Nov 2018
A Survey and Critique of Multiagent Deep Reinforcement Learning Pablo Hernandez-Leal Bilal Kartal Matthew E. Taylor OffRL 43 551 0 12 Oct 2018
Continual Learning of Context-dependent Processing in Neural Networks Guanxiong Zeng Yang Chen Bo Cui Shan Yu CLL 33 295 0 29 Sep 2018
Negative Update Intervals in Deep Multi-Agent Reinforcement Learning Gregory Palmer Rahul Savani K. Tuyls 28 27 0 13 Sep 2018
Life-Long Disentangled Representation Learning with Cross-Domain Latent Homologies Alessandro Achille Tom Eccles Loic Matthey Christopher P. Burgess Nicholas Watters Alexander Lerchner I. Higgins BDL 29 119 0 20 Aug 2018
DynMat, a network that can learn after learning J. H. Lee OffRL 24 5 0 16 Jun 2018
Selfless Sequential Learning Rahaf Aljundi Marcus Rohrbach Tinne Tuytelaars CLL 33 114 0 14 Jun 2018
Adding New Tasks to a Single Network with Weight Transformations using Binary Masks Massimiliano Mancini Elisa Ricci Barbara Caputo Samuel Rota Buló 25 51 0 28 May 2018
Keep and Learn: Continual Learning by Constraining the Latent Space for Knowledge Preservation in Neural Networks Hyo-Eun Kim Seungwook Kim Jaehwan Lee CLL 14 31 0 28 May 2018
Self-Net: Lifelong Learning via Continual Self-Modeling Blake Camp J. Mandivarapu Rolando Estrada CLL SSL 27 16 0 25 May 2018
Towards Robust Evaluations of Continual Learning Sebastian Farquhar Y. Gal CLL 28 305 0 24 May 2018
The Limits and Potentials of Deep Learning for Robotics Niko Sünderhauf Oliver Brock Walter J. Scheirer R. Hadsell Dieter Fox ... B. Upcroft Pieter Abbeel Wolfram Burgard Michael Milford Peter Corke 17 522 0 18 Apr 2018
Combating catastrophic forgetting with developmental compression Shawn L. E. Beaulieu Sam Kriegman Josh Bongard 25 4 0 12 Apr 2018
Selective Experience Replay for Lifelong Learning David Isele Akansel Cosgun CLL 34 449 0 28 Feb 2018
SeNA-CNN: Overcoming Catastrophic Forgetting in Convolutional Neural Networks by Selective Network Augmentation Abel S. Zacarias Luís A. Alexandre CLL 32 12 0 22 Feb 2018
Overcoming catastrophic forgetting with hard attention to the task Joan Serrà Dídac Surís M. Miron Alexandros Karatzoglou CLL 41 1,050 0 04 Jan 2018
Rapid Adaptation with Conditionally Shifted Neurons Tsendsuren Munkhdalai Xingdi Yuan Soroush Mehri Adam Trischler 21 13 0 28 Dec 2017
FearNet: Brain-Inspired Model for Incremental Learning Ronald Kemker Christopher Kanan CLL 41 475 0 28 Nov 2017
Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory Ron Amit Ron Meir BDL MLT 32 175 0 03 Nov 2017
Variational Continual Learning Cuong V Nguyen Yingzhen Li T. Bui Richard Turner CLL VLM BDL 36 728 0 29 Oct 2017
Continual Learning with Deep Generative Replay Hanul Shin Jung Kwon Lee Jaehong Kim Jiwon Kim KELM CLL 21 2,033 0 24 May 2017
Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks Roby Velez Jeff Clune DiffM 16 50 0 20 May 2017
CORe50: a New Dataset and Benchmark for Continuous Object Recognition Vincenzo Lomonaco Davide Maltoni 34 489 0 09 May 2017
Molecular De Novo Design through Deep Reinforcement Learning Marcus Olivecrona T. Blaschke Ola Engkvist Hongming Chen BDL 55 995 0 25 Apr 2017
Overcoming Catastrophic Forgetting by Incremental Moment Matching Sang-Woo Lee Jin-Hwa Kim Jaehyun Jun Jung-Woo Ha Byoung-Tak Zhang CLL 30 668 0 24 Mar 2017
ASP: Learning to Forget with Adaptive Synaptic Plasticity in Spiking Neural Networks Priyadarshini Panda Jason M. Allred S. Ramanathan Kaushik Roy 11 49 0 22 Mar 2017
Continual Learning Through Synaptic Intelligence Friedemann Zenke Ben Poole Surya Ganguli 39 51 0 13 Mar 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 42 7,326 0 02 Dec 2016
Playing SNES in the Retro Learning Environment Nadav Bhonker Shai Rozenberg Itay Hubara 23 19 0 07 Nov 2016
Less-forgetting Learning in Deep Neural Networks Heechul Jung Jeongwoo Ju Minju Jung Junmo Kim 26 227 0 01 Jul 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 101 4,319 0 29 Jun 2016
Active Long Term Memory Networks Tommaso Furlanello Jiaping Zhao Andrew M. Saxe Laurent Itti B. Tjan KELM CLL 32 41 0 07 Jun 2016
Disentangled Representations in Neural Models William F. Whitney OOD OCL DRL 30 18 0 07 Feb 2016
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,639 0 03 Jul 2012