Weight Clipping for Deep Continual and Reinforcement Learning

Weight Clipping for Deep Continual and Reinforcement Learning

1 July 2024

Mohamed Elsayed

A. Rupam Mahmood

Papers citing "Weight Clipping for Deep Continual and Reinforcement Learning"

11 / 11 papers shown

Title
Understanding and Exploiting Plasticity for Non-stationary Network Resource Adaptation Zhiqiang He Zhi Liu CLL 54 0 0 02 May 2025
Variance Control via Weight Rescaling in LLM Pre-training Louis Owen Abhay Kumar Nilabhra Roy Chowdhury Fabian Güra 31 0 0 21 Mar 2025
Understanding Gradient Orthogonalization for Deep Learning via Non-Euclidean Trust-Region Optimization Dmitry Kovalev 52 0 0 16 Mar 2025
Activation by Interval-wise Dropout: A Simple Way to Prevent Neural Networks from Plasticity Loss Sangyeon Park Isaac Han Seungwon Oh Kyung-Joong Kim 62 2 0 03 Feb 2025
Streaming Deep Reinforcement Learning Finally Works Mohamed Elsayed G. Vasan A. R. Mahmood OffRL 35 4 0 18 Oct 2024
MAD-TD: Model-Augmented Data stabilizes High Update Ratio RL C. Voelcker Marcel Hussing Eric Eaton Amir-massoud Farahmand Igor Gilitschenski 39 1 0 11 Oct 2024
Neuroplastic Expansion in Deep Reinforcement Learning Jiashun Liu J. Obando-Ceron Aaron C. Courville L. Pan 31 3 0 10 Oct 2024
Disentangling the Causes of Plasticity Loss in Neural Networks Clare Lyle Zeyu Zheng Khimya Khetarpal H. V. Hasselt Razvan Pascanu James Martens Will Dabney AI4CE 50 30 0 29 Feb 2024
Memory-efficient Reinforcement Learning with Value-based Knowledge Consolidation Qingfeng Lan Yangchen Pan Jun-Jie Luo A. R. Mahmood OffRL 22 6 0 22 May 2022
The Primacy Bias in Deep Reinforcement Learning Evgenii Nikishin Max Schwarzer P. DÓro Pierre-Luc Bacon Aaron C. Courville OnRL 85 178 0 16 May 2022
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 220 510 0 11 Feb 2021