The Dormant Neuron Phenomenon in Deep Reinforcement Learning

24 February 2023

Papers citing "The Dormant Neuron Phenomenon in Deep Reinforcement Learning"

50 / 79 papers shown

Title
Understanding and Exploiting Plasticity for Non-stationary Network Resource Adaptation Zhiqiang He Zhi Liu CLL 51 0 0 02 May 2025
Plasticine: Accelerating Research in Plasticity-Motivated Deep Reinforcement Learning Mingqi Yuan Qi Wang Guozheng Ma Bo-wen Li Xin Jin Yunbo Wang Xiaokang Yang Wenjun Zeng D. Tao OffRL AI4CE 33 0 0 24 Apr 2025
Evaluating Temporal Plasticity in Foundation Time Series Models for Incremental Fine-tuning Jia Liu Cheng Jinguo Xia Fang Zhenyuan Ma Yuankai Wu CLL AI4TS LRM 37 0 0 20 Apr 2025
Neuron-level Balance between Stability and Plasticity in Deep Reinforcement Learning Jiahua Lan Sen Zhang Haixia Pan Ruijun Liu Li Shen Dacheng Tao CLL 20 0 0 09 Apr 2025
Experience Replay Addresses Loss of Plasticity in Continual Learning Jiuqi Wang Rohan Chandra Shangtong Zhang CLL KELM 41 0 0 25 Mar 2025
Mastering Continual Reinforcement Learning through Fine-Grained Sparse Network Allocation and Dormant Neuron Exploration Chengqi Zheng Haiyan Yin Jianda Chen Terence Ng Yew-Soon Ong Ivor Tsang CLL 68 0 0 07 Mar 2025
Multi-Task Reinforcement Learning Enables Parameter Scaling Reginald McLean Evangelos Chataroulas Jordan Terry Isaac Woungang Nariman Farsad P. S. Castro LRM 39 0 0 07 Mar 2025
Impoola: The Power of Average Pooling for Image-Based Deep Reinforcement Learning Raphael Trumpp Ansgar Schäfftlein Mirco Theile Marco Caccamo 34 0 0 07 Mar 2025
Can We Optimize Deep RL Policy Weights as Trajectory Modeling? Hongyao Tang OffRL 67 0 0 06 Mar 2025
Hyperspherical Normalization for Scalable Deep Reinforcement Learning Hojoon Lee Youngdo Lee Takuma Seno Donghu Kim Peter Stone Jaegul Choo 63 1 0 24 Feb 2025
Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation Taeyoung Yun Dinghuai Zhang Jinkyoo Park Ling Pan DiffM 73 2 0 17 Feb 2025
Activation by Interval-wise Dropout: A Simple Way to Prevent Neural Networks from Plasticity Loss Sangyeon Park Isaac Han Seungwon Oh Kyung-Joong Kim 54 2 0 03 Feb 2025
Towards General-Purpose Model-Free Reinforcement Learning Scott Fujimoto P. DÓro Amy Zhang Yuandong Tian Michael Rabbat OffRL 32 3 0 28 Jan 2025
Audiopedia: Audio QA with Knowledge Abhirama Subramanyam Penamakuri Kiran Chhatre Akshat Jain KELM AuLLM RALM 28 0 0 31 Dec 2024
Computational Analysis of Yaredawi YeZema Silt in Ethiopian Orthodox Tewahedo Church Chants Mequanent Argaw Muluneh Yan-Tsung Peng Li Su 35 0 0 25 Dec 2024
Adam on Local Time: Addressing Nonstationarity in RL with Relative Adam Timesteps Benjamin Ellis Matthew Jackson Andrei Lupu Alexander David Goldie Mattie Fellows Shimon Whiteson Jakob Foerster 74 0 0 22 Dec 2024
Parseval Regularization for Continual Reinforcement Learning Wesley Chung Lynn Cherif D. Meger Doina Precup CLL 65 0 0 10 Dec 2024
Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Reset Alexandre Galashov Michalis K. Titsias Andras Gyorgy Clare Lyle Razvan Pascanu Yee Whye Teh Maneesh Sahani 30 3 0 06 Nov 2024
Beyond The Rainbow: High Performance Deep Reinforcement Learning On A Desktop PC Tyler Clark Mark Towers Christine Evers Jonathon Hare OffRL 28 0 0 06 Nov 2024
CALE: Continuous Arcade Learning Environment Jesse Farebrother Pablo Samuel Castro ELM 21 0 0 31 Oct 2024
DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity Baekrok Shin Junsoo Oh Hanseul Cho Chulhee Yun AI4CE 33 1 0 30 Oct 2024
Permutation Invariant Learning with High-Dimensional Particle Filters Akhilan Boopathy Aneesh Muppidi Peggy Yang Abhiram Iyer William Yue Ila R Fiete SSL 31 0 0 30 Oct 2024
Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Tasks Michael T. Matthews Michael Beukman Chris Xiaoxuan Lu Jakob Foerster OffRL AI4CE 30 2 0 30 Oct 2024
Plastic Learning with Deep Fourier Features Alex Lewandowski Dale Schuurmans Marlos C. Machado CLL 36 2 0 27 Oct 2024
Self-Normalized Resets for Plasticity in Continual Learning Vivek F. Farias Adam D. Jozefiak CLL 33 0 0 26 Oct 2024
Prioritized Generative Replay Renhao Wang Kevin Frans Pieter Abbeel Sergey Levine Alexei A. Efros OnRL DiffM 70 2 0 23 Oct 2024
Uncovering RL Integration in SSL Loss: Objective-Specific Implications for Data-Efficient RL Ömer Veysel Çağatan Barış Akgün OffRL 31 0 0 22 Oct 2024
MENTOR: Mixture-of-Experts Network with Task-Oriented Perturbation for Visual Reinforcement Learning Suning Huang Zheyu Zhang Tianhai Liang Yihan Xu Zhehao Kou Chenhao Lu Guowei Xu Zhengrong Xue Huazhe Xu MoE 38 2 0 19 Oct 2024
One Step Diffusion via Shortcut Models Kevin Frans Danijar Hafner Sergey Levine Pieter Abbeel VLM DiffM 26 21 0 16 Oct 2024
SimBa: Simplicity Bias for Scaling Up Parameters in Deep Reinforcement Learning Hojoon Lee Dongyoon Hwang Donghu Kim Hyunseung Kim Jun Jet Tai K. Subramanian Peter R. Wurman Jaegul Choo Peter Stone Takuma Seno OffRL 49 6 0 13 Oct 2024
MAD-TD: Model-Augmented Data stabilizes High Update Ratio RL C. Voelcker Marcel Hussing Eric Eaton Amir-massoud Farahmand Igor Gilitschenski 39 1 0 11 Oct 2024
Neuroplastic Expansion in Deep Reinforcement Learning Jiashun Liu J. Obando-Ceron Aaron C. Courville L. Pan 31 3 0 10 Oct 2024
Don't flatten, tokenize! Unlocking the key to SoftMoE's efficacy in deep RL Ghada Sokar J. Obando-Ceron Aaron C. Courville Hugo Larochelle Pablo Samuel Castro MoE 47 2 0 02 Oct 2024
Scaling Offline Model-Based RL via Jointly-Optimized World-Action Model Pretraining Jie Cheng Ruixi Qiao Gang Xiong Binhua Li Yingwei Ma Binhua Li Yongbin Li Yisheng Lv OffRL OnRL LM&Ro 26 3 0 01 Oct 2024
Generalizing Consistency Policy to Visual RL with Prioritized Proximal Experience Regularization Haoran Li Zhennan Jiang Yuhui Chen Dongbin Zhao OffRL 11 2 0 28 Sep 2024
Improving Deep Reinforcement Learning by Reducing the Chain Effect of Value and Policy Churn Hongyao Tang Glen Berseth OffRL 40 1 0 07 Sep 2024
Diagnosing and Re-learning for Balanced Multimodal Learning Yake Wei Siwei Li Ruoxuan Feng Di Hu 25 3 0 12 Jul 2024
Can Learned Optimization Make Reinforcement Learning Less Difficult? Alexander David Goldie Chris Xiaoxuan Lu Matthew Jackson Shimon Whiteson Jakob N. Foerster 32 3 0 09 Jul 2024
A Role of Environmental Complexity on Representation Learning in Deep Reinforcement Learning Agents Andrew Liu Alla Borisyuk 13 1 0 03 Jul 2024
Normalization and effective learning rates in reinforcement learning Clare Lyle Zeyu Zheng Khimya Khetarpal James Martens H. V. Hasselt Razvan Pascanu Will Dabney 14 7 0 01 Jul 2024
Weight Clipping for Deep Continual and Reinforcement Learning Mohamed Elsayed Qingfeng Lan Clare Lyle A. Rupam Mahmood 21 9 0 01 Jul 2024
Mixture of Experts in a Mixture of RL settings Timon Willi J. Obando-Ceron Jakob Foerster Karolina Dziugaite Pablo Samuel Castro MoE 27 7 0 26 Jun 2024
On the consistency of hyper-parameter selection in value-based deep reinforcement learning J. Obando-Ceron J. G. Araújo Aaron C. Courville Pablo Samuel Castro 29 5 0 25 Jun 2024
Learning Continually by Spectral Regularization Alex Lewandowski Saurabh Kumar Dale Schuurmans András Gyorgy Marlos C. Machado CLL 27 5 0 10 Jun 2024
A Study of Plasticity Loss in On-Policy Deep Reinforcement Learning Arthur Juliani Jordan T. Ash OffRL OnRL CLL 33 0 0 29 May 2024
Fast TRAC: A Parameter-Free Optimizer for Lifelong Reinforcement Learning Aneesh Muppidi Zhiyu Zhang Heng Yang 26 4 0 26 May 2024
The Curse of Diversity in Ensemble-Based Exploration Zhixuan Lin P. DÓro Evgenii Nikishin Aaron C. Courville 31 1 0 07 May 2024
No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO Skander Moalla Andrea Miele Razvan Pascanu Çağlar Gülçehre 16 5 0 01 May 2024
Adaptive Regularization of Representation Rank as an Implicit Constraint of Bellman Equation Qiang He Tianyi Zhou Meng Fang S. Maghsudi 22 3 0 19 Apr 2024
Higher Replay Ratio Empowers Sample-Efficient Multi-Agent Reinforcement Learning Linjie Xu Zichuan Liu Alexander Dockhorn Diego Perez-Liebana Jinyu Wang Lei Song Jiang Bian 30 1 0 15 Apr 2024