Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1711.05136
Cited By
v1
v2
v3
v4
v5 (latest)
Deep Rewiring: Training very sparse deep networks
14 November 2017
G. Bellec
David Kappel
Wolfgang Maass
Robert Legenstein
BDL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Deep Rewiring: Training very sparse deep networks"
50 / 172 papers shown
Cannistraci-Hebb Training on Ultra-Sparse Spiking Neural Networks
Yuan Hua
Jilin Zhang
Yingtao Zhang
Wenqi Gu
Leyi You
Baobo Xiong
C. Cannistraci
Hong Chen
100
0
0
05 Nov 2025
Space as Time Through Neuron Position Learning
Balázs Mészáros
James C. Knight
Danyal Akarca
Thomas Nowotny
72
0
0
03 Nov 2025
Kernelized Sparse Fine-Tuning with Bi-level Parameter Competition for Vision Models
Shufan Shen
Junshu Sun
Shuhui Wang
Qingming Huang
136
0
0
28 Oct 2025
A flexible framework for structural plasticity in GPU-accelerated sparse spiking neural networks
James C. Knight
Johanna Senk
Thomas Nowotny
123
1
0
22 Oct 2025
SpikeFit: Towards Optimal Deployment of Spiking Networks on Neuromorphic Hardware
Ivan Kartashov
M. Pushkareva
Iakov Karandashev
152
1
0
17 Oct 2025
Neuro-inspired Ensemble-to-Ensemble Communication Primitives for Sparse and Efficient ANNs
Orestis Konstantaropoulos
S. Smirnakis
M. Papadopouli
165
0
0
19 Aug 2025
ONG: One-Shot NMF-based Gradient Masking for Efficient Model Sparsification
S. Behera
Yamuna Prasad
92
0
0
18 Aug 2025
A Topological Improvement of the Overall Performance of Sparse Evolutionary Training: Motif-Based Structural Optimization of Sparse MLPs Project
Xiaotian Chen
Hongyun Liu
Seyed Sahand Mohammadi Ziabari
161
0
0
10 Jun 2025
Hyperpruning: Efficient Search through Pruned Variants of Recurrent Neural Networks Leveraging Lyapunov Spectrum
Caleb Zheng
Eli Shlizerman
167
0
0
09 Jun 2025
NeuroTrails: Training with Dynamic Sparse Heads as the Key to Effective Ensembling
Bram Grooten
Farid Hasanov
Chenxiang Zhang
Q. Xiao
Boqian Wu
...
Shiwei Liu
L. Yin
Elena Mocanu
Mykola Pechenizkiy
Decebal Constantin Mocanu
307
0
0
23 May 2025
Balanced and Elastic End-to-end Training of Dynamic LLMs
Mohamed Wahib
Muhammed Abdullah Soyturk
Didem Unat
MoE
328
1
0
20 May 2025
Efficient Unstructured Pruning of Mamba State-Space Models for Resource-Constrained Environments
Ibne Farabi Shihab
Sanjeda Akter
Anuj Sharma
Mamba
468
3
0
13 May 2025
Sparse-to-Sparse Training of Diffusion Models
Inês Cardoso Oliveira
Decebal Constantin Mocanu
Luis A. Leiva
DiffM
458
1
0
30 Apr 2025
The Neural Pruning Law Hypothesis
Eugen Barbulescu
Antonio Alexoaie
Lucian Busoniu
375
0
0
06 Apr 2025
Symmetric Pruning of Large Language Models
Kai Yi
Peter Richtárik
AAML
VLM
320
2
0
31 Jan 2025
Brain network science modelling of sparse neural networks enables Transformers and LLMs to perform as fully connected
Yingtao Zhang
Diego Cerretti
Jialin Zhao
Wenjing Wu
Ziheng Liao
Umberto Michieli
C. Cannistraci
596
1
0
31 Jan 2025
Expanding Sparse Tuning for Low Memory Usage
Neural Information Processing Systems (NeurIPS), 2024
Shufan Shen
Junshu Sun
Xiangyang Ji
Qingming Huang
Shuhui Wang
328
9
0
04 Nov 2024
Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates
Cabrel Teguemne Fokam
Khaleelulla Khan Nazeer
Lukas König
David Kappel
Anand Subramoney
346
1
0
08 Oct 2024
Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption Robustness
International Conference on Learning Representations (ICLR), 2024
Boqian Wu
Q. Xiao
Shunxin Wang
N. Strisciuglio
Mykola Pechenizkiy
M. V. Keulen
Decebal Constantin Mocanu
Elena Mocanu
OOD
3DH
514
6
0
03 Oct 2024
Value-Based Deep Multi-Agent Reinforcement Learning with Dynamic Sparse Training
Neural Information Processing Systems (NeurIPS), 2024
Pihe Hu
Shaolong Li
Zhuoran Li
L. Pan
Longbo Huang
195
1
0
28 Sep 2024
Nerva: a Truly Sparse Implementation of Neural Networks
Wieger Wesselink
Bram Grooten
Qiao Xiao
Cássio Machado de Campos
Mykola Pechenizkiy
172
4
0
24 Jul 2024
Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities
Stephen Zhang
Vardan Papyan
255
0
0
04 Jul 2024
Boosting Robustness in Preference-Based Reinforcement Learning with Dynamic Sparsity
Adaptive Agents and Multi-Agent Systems (AAMAS), 2024
Calarina Muslimani
Bram Grooten
Deepak Ranganatha Sastry Mamillapalli
Mykola Pechenizkiy
Decebal Constantin Mocanu
Matthew E. Taylor
351
0
0
10 Jun 2024
Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning
Yaxin Li
Qi Xu
Jiangrong Shen
Hongming Xu
Long Chen
Gang Pan
401
15
0
03 Jun 2024
Diverse Subset Selection via Norm-Based Sampling and Orthogonality
Noga Bar
Raja Giryes
CVBM
377
1
0
03 Jun 2024
Enhancing Adversarial Robustness in SNNs with Sparse Gradients
Yujia Liu
Tong Bu
Jianhao Ding
Zecheng Hao
Tiejun Huang
Zhaofei Yu
AAML
227
13
0
30 May 2024
Sparse maximal update parameterization: A holistic approach to sparse training dynamics
Nolan Dey
Shane Bergsma
Joel Hestness
257
8
0
24 May 2024
Neural Network Compression for Reinforcement Learning Tasks
Scientific Reports (Sci Rep), 2024
Dmitry A. Ivanov
D. Larionov
Oleg V. Maslennikov
V. Voevodin
OffRL
AI4CE
258
9
0
13 May 2024
Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models
Rishav Mukherji
Mark Schöne
Khaleelulla Khan Nazeer
Christian Mayr
David Kappel
Anand Subramoney
292
3
0
01 May 2024
Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World
Bowen Lei
Dongkuan Xu
Ruqi Zhang
Bani Mallick
UQCV
283
1
0
29 Mar 2024
LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels
Computer Vision and Pattern Recognition (CVPR), 2024
Tuo Feng
Wenguan Wang
Fan Ma
Yi Yang
3DV
217
18
0
22 Mar 2024
LNPT: Label-free Network Pruning and Training
IEEE International Joint Conference on Neural Network (IJCNN), 2024
Jinying Xiao
Ping Li
Zhe Tang
Jie Nie
223
3
0
19 Mar 2024
Shaving Weights with Occam's Razor: Bayesian Sparsification for Neural Networks Using the Marginal Likelihood
Rayen Dhahri
Alexander Immer
Bertrand Charpentier
Stephan Günnemann
Vincent Fortuin
BDL
UQCV
206
7
0
25 Feb 2024
Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers
Abhimanyu Bambhaniya
Amir Yazdanbakhsh
Suvinay Subramanian
Sheng-Chun Kao
Shivani Agrawal
Utku Evci
Tushar Krishna
314
23
0
07 Feb 2024
EPSD: Early Pruning with Self-Distillation for Efficient Model Compression
Dong Chen
Ning Liu
Yichen Zhu
Zhengping Che
Rui Ma
Fachao Zhang
Xiaofeng Mou
Yi Chang
Jian Tang
236
8
0
31 Jan 2024
ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks
Yang Sui
Miao Yin
Yu Gong
Jinqi Xiao
Huy Phan
Bo Yuan
253
9
0
18 Jan 2024
Always-Sparse Training by Growing Connections with Guided Stochastic Exploration
Mike Heddes
Narayan Srinivasa
T. Givargis
Alexandru Nicolau
524
1
0
12 Jan 2024
CRAFT: Contextual Re-Activation of Filters for face recognition Training
IEEE International Conference on Automatic Face & Gesture Recognition (FG), 2023
Aman Bhatta
Domingo Mery
Haiyu Wu
Kevin W. Bowyer
CVBM
251
2
0
29 Nov 2023
Towards Higher Ranks via Adversarial Weight Pruning
Neural Information Processing Systems (NeurIPS), 2023
Yuchuan Tian
Hanting Chen
Tianyu Guo
Chao Xu
Yunhe Wang
231
5
0
29 Nov 2023
Neural Network Pruning by Gradient Descent
Zhang Zhang
Ruyi Tao
Jiang Zhang
201
7
0
21 Nov 2023
Activity Sparsity Complements Weight Sparsity for Efficient RNN Inference
Rishav Mukherji
Mark Schöne
Khaleelulla Khan Nazeer
Christian Mayr
Anand Subramoney
298
2
0
13 Nov 2023
In defense of parameter sharing for model-compression
International Conference on Learning Representations (ICLR), 2023
Aditya Desai
Anshumali Shrivastava
135
6
0
17 Oct 2023
Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reduction
Neural Information Processing Systems (NeurIPS), 2023
Hanhan Zhou
Tian-Shing Lan
Guru Venkataramani
Wenbo Ding
291
45
0
12 Oct 2023
LEMON: Lossless model expansion
International Conference on Learning Representations (ICLR), 2023
Yite Wang
Jiahao Su
Hanlin Lu
Cong Xie
Tianyi Liu
Jianbo Yuan
Yanghua Peng
Tian Ding
Hongxia Yang
214
20
0
12 Oct 2023
Efficient Joint Optimization of Layer-Adaptive Weight Pruning in Deep Neural Networks
IEEE International Conference on Computer Vision (ICCV), 2023
Kaixin Xu
Zhe Wang
Xue Geng
Jie Lin
Ruibing Jin
Xiaoli Li
Weisi Lin
137
20
0
21 Aug 2023
A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Zhenyi Wang
Enneng Yang
Li Shen
Heng-Chiao Huang
KELM
MU
254
85
0
16 Jul 2023
Systematic Investigation of Sparse Perturbed Sharpness-Aware Minimization Optimizer
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Peng Mi
Li Shen
Tianhe Ren
Weihao Ye
Tianshuo Xu
Xiaoshuai Sun
Tongliang Liu
Rongrong Ji
Dacheng Tao
AAML
246
2
0
30 Jun 2023
Maintaining Plasticity in Deep Continual Learning
Shibhansh Dohare
J. F. Hernandez-Garcia
Parash Rahman
A. Rupam Mahmood
Richard S. Sutton
KELM
CLL
418
36
0
23 Jun 2023
Fantastic Weights and How to Find Them: Where to Prune in Dynamic Sparse Training
Neural Information Processing Systems (NeurIPS), 2023
A. Nowak
Bram Grooten
Decebal Constantin Mocanu
Jacek Tabor
250
15
0
21 Jun 2023
Magnitude Attention-based Dynamic Pruning
Expert systems with applications (ESWA), 2023
Jihye Back
Namhyuk Ahn
Jang-Hyun Kim
163
6
0
08 Jun 2023
1
2
3
4
Next
