Continual Backprop: Stochastic Gradient Descent with Persistent Randomness

13 August 2021

Papers citing "Continual Backprop: Stochastic Gradient Descent with Persistent Randomness"

50 / 58 papers shown

Title
Plasticity as the Mirror of Empowerment David Abel Michael H. Bowling André Barreto Will Dabney Shi Dong ... Doina Precup Jonathan Richens Mark Rowland Tom Schaul Satinder Singh AI4CE 21 0 0 15 May 2025
PEAKS: Selecting Key Training Examples Incrementally via Prediction Error Anchored by Kernel Similarity Mustafa Burak Gurbuz Xingyu Zheng C. Dovrolis OOD 38 0 0 07 Apr 2025
Improving Plasticity in Non-stationary Reinforcement Learning with Evidential Proximal Policy Optimization Abdullah Akgul Gulcin Baykal Manuel Haußmann M. Kandemir 38 0 0 03 Mar 2025
Activation by Interval-wise Dropout: A Simple Way to Prevent Neural Networks from Plasticity Loss Sangyeon Park Isaac Han Seungwon Oh Kyung-Joong Kim 62 2 0 03 Feb 2025
Computational Analysis of Yaredawi YeZema Silt in Ethiopian Orthodox Tewahedo Church Chants Mequanent Argaw Muluneh Yan-Tsung Peng Li Su 42 0 0 25 Dec 2024
Parseval Regularization for Continual Reinforcement Learning Wesley Chung Lynn Cherif D. Meger Doina Precup CLL 78 2 0 10 Dec 2024
Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Reset Alexandre Galashov Michalis K. Titsias Andras Gyorgy Clare Lyle Razvan Pascanu Yee Whye Teh Maneesh Sahani 38 4 0 06 Nov 2024
Breaking the Reclustering Barrier in Centroid-based Deep Clustering Lukas Miklautz Timo Klein Kevin Sidak Collin Leiber Thomas Lang Andrii Shkabrii Sebastian Tschiatschek Claudia Plant 34 0 0 04 Nov 2024
DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity Baekrok Shin Junsoo Oh Hanseul Cho Chulhee Yun AI4CE 52 1 0 30 Oct 2024
Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Tasks Michael T. Matthews Michael Beukman Chris Xiaoxuan Lu Jakob Foerster OffRL AI4CE 36 2 0 30 Oct 2024
Plastic Learning with Deep Fourier Features Alex Lewandowski Dale Schuurmans Marlos C. Machado CLL 42 3 0 27 Oct 2024
Self-Normalized Resets for Plasticity in Continual Learning Vivek F. Farias Adam D. Jozefiak CLL 43 0 0 26 Oct 2024
Remove Symmetries to Control Model Expressivity and Improve Optimization Liu Ziyin Yizhou Xu Isaac Chuang AAML 38 1 0 28 Aug 2024
Mitigating the Stability-Plasticity Dilemma in Adaptive Train Scheduling with Curriculum-Driven Continual DQN Expansion Achref Jaziri Etienne Kunzel Visvanathan Ramesh CLL 47 0 0 19 Aug 2024
The Need for a Big World Simulator: A Scientific Challenge for Continual Learning Saurabh Kumar Hong Jun Jeon Alex Lewandowski Benjamin Van Roy 26 0 0 06 Aug 2024
Normalization and effective learning rates in reinforcement learning Clare Lyle Zeyu Zheng Khimya Khetarpal James Martens H. V. Hasselt Razvan Pascanu Will Dabney 19 7 0 01 Jul 2024
Weight Clipping for Deep Continual and Reinforcement Learning Mohamed Elsayed Qingfeng Lan Clare Lyle A. Rupam Mahmood 29 9 0 01 Jul 2024
Mixture of Experts in a Mixture of RL settings Timon Willi J. Obando-Ceron Jakob Foerster Karolina Dziugaite Pablo Samuel Castro MoE 41 7 0 26 Jun 2024
Learning Continually by Spectral Regularization Alex Lewandowski Saurabh Kumar Dale Schuurmans András Gyorgy Marlos C. Machado CLL 43 5 0 10 Jun 2024
Fast TRAC: A Parameter-Free Optimizer for Lifelong Reinforcement Learning Aneesh Muppidi Zhiyu Zhang Heng Yang 32 4 0 26 May 2024
No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO Skander Moalla Andrea Miele Razvan Pascanu Çağlar Gülçehre 26 5 0 01 May 2024
K-percent Evaluation for Lifelong RL Golnaz Mesbahi Parham Mohammad Panahi Olya Mastikhina Martha White Adam White CLL OffRL 26 0 0 02 Apr 2024
Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning Mohamed Elsayed A. R. Mahmood CLL 50 20 0 31 Mar 2024
Maxwell's Demon at Work: Efficient Pruning by Leveraging Saturation of Neurons Simon Dufort-Labbé P. DÓro Evgenii Nikishin Razvan Pascanu Pierre-Luc Bacon A. Baratin 32 1 0 12 Mar 2024
Reset & Distill: A Recipe for Overcoming Negative Transfer in Continual Reinforcement Learning Hongjoon Ahn Jinu Hyeon Youngmin Oh Bosun Hwang Taesup Moon CLL OnRL 29 2 0 08 Mar 2024
Bidirectional Progressive Neural Networks with Episodic Return Progress for Emergent Task Sequencing and Robotic Skill Transfer S. E. Ada Hanne Say Emre Ugur Erhan Öztop 18 1 0 06 Mar 2024
Overestimation, Overfitting, and Plasticity in Actor-Critic: the Bitter Lesson of Reinforcement Learning Michal Nauman Michal Bortkiewicz Piotr Milo's Tomasz Trzciñski M. Ostaszewski Marek Cygan OffRL 22 17 0 01 Mar 2024
Disentangling the Causes of Plasticity Loss in Neural Networks Clare Lyle Zeyu Zheng Khimya Khetarpal H. V. Hasselt Razvan Pascanu James Martens Will Dabney AI4CE 53 31 0 29 Feb 2024
Mixtures of Experts Unlock Parameter Scaling for Deep RL J. Obando-Ceron Ghada Sokar Timon Willi Clare Lyle Jesse Farebrother Jakob N. Foerster Gintare Karolina Dziugaite Doina Precup Pablo Samuel Castro 50 29 0 13 Feb 2024
Prediction and Control in Continual Reinforcement Learning N. Anand Doina Precup OffRL CLL 27 11 0 18 Dec 2023
Directions of Curvature as an Explanation for Loss of Plasticity Alex Lewandowski Haruto Tanaka Dale Schuurmans Marlos C. Machado 11 5 0 30 Nov 2023
Reset It and Forget It: Relearning Last-Layer Weights Improves Continual and Transfer Learning Lapo Frati Neil Traft Jeff Clune Nick Cheney CLL 19 0 0 12 Oct 2023
Revisiting Plasticity in Visual Reinforcement Learning: Data, Modules and Training Stages Guozheng Ma Lu Li Sen Zhang Zixuan Liu Zhen Wang Yixin Chen Li Shen Xueqian Wang Dacheng Tao OffRL 45 15 0 11 Oct 2023
Maintaining Plasticity in Continual Learning via Regenerative Regularization Saurabh Kumar Henrik Marklund Benjamin Van Roy CLL KELM 28 16 0 23 Aug 2023
A Definition of Continual Reinforcement Learning David Abel André Barreto Benjamin Van Roy Doina Precup H. V. Hasselt Satinder Singh CLL 20 73 0 20 Jul 2023
Measuring and Mitigating Interference in Reinforcement Learning Vincent Liu Han Wang Ruo Yu Tao Khurram Javed Adam White Martha White 22 5 0 10 Jul 2023
Continual Learning as Computationally Constrained Reinforcement Learning Saurabh Kumar Henrik Marklund Anand Srinivasa Rao Yifan Zhu Hong Jun Jeon Yueyang Liu Benjamin Van Roy CLL 27 22 0 10 Jul 2023
PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement Learning Hojoon Lee Hanseul Cho Hyunseung Kim Daehoon Gwak Joonkee Kim Jaegul Choo Se-Young Yun Chulhee Yun OffRL 82 25 0 19 Jun 2023
Low-rank extended Kalman filtering for online learning of neural networks from streaming data Peter Chang Gerardo Duran-Martín Alexander Y. Shestopaloff Matt Jones Kevin P. Murphy BDL 38 17 0 31 May 2023
SHARP: Sparsity and Hidden Activation RePlay for Neuro-Inspired Continual Learning Mustafa Burak Gurbuz J. M. Moorman Constantinos Dovrolis CLL 18 0 0 29 May 2023
Deep Reinforcement Learning with Plasticity Injection Evgenii Nikishin Junhyuk Oh Georg Ostrovski Clare Lyle Razvan Pascanu Will Dabney André Barreto OffRL 18 49 0 24 May 2023
Meta-Learning Online Adaptation of Language Models Nathan J. Hu E. Mitchell Christopher D. Manning Chelsea Finn KELM 21 34 0 24 May 2023
Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning Nader Asadi Mohammad Davar Sudhir Mudur Rahaf Aljundi Eugene Belilovsky CLL 34 35 0 26 Mar 2023
Loss of Plasticity in Continual Deep Reinforcement Learning Zaheer Abbas Rosie Zhao Joseph Modayil Adam White Marlos C. Machado CLL OffRL 26 73 0 13 Mar 2023
Understanding plasticity in neural networks Clare Lyle Zeyu Zheng Evgenii Nikishin Bernardo Avila-Pires Razvan Pascanu Will Dabney AI4CE 35 97 0 02 Mar 2023
The Dormant Neuron Phenomenon in Deep Reinforcement Learning Ghada Sokar Rishabh Agarwal P. S. Castro Utku Evci CLL 40 88 0 24 Feb 2023
Automatic Noise Filtering with Dynamic Sparse Training in Deep Reinforcement Learning Bram Grooten Ghada Sokar Shibhansh Dohare Elena Mocanu Matthew E. Taylor Mykola Pechenizkiy D. Mocanu 25 11 0 13 Feb 2023
Utility-based Perturbed Gradient Descent: An Optimizer for Continual Learning Mohamed Elsayed A. R. Mahmood CLL 21 6 0 07 Feb 2023
Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction Shaofei Cai Zihao Wang Xiaojian Ma Anji Liu Yitao Liang 40 40 0 21 Jan 2023
Auxiliary task discovery through generate-and-test Banafsheh Rafiee Sina Ghiassian Jun Jin R. Sutton Jun-Jie Luo Adam White 16 0 0 25 Oct 2022