Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1711.05136
Cited By
v1
v2
v3
v4
v5 (latest)
Deep Rewiring: Training very sparse deep networks
14 November 2017
G. Bellec
David Kappel
Wolfgang Maass
Robert Legenstein
BDL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Deep Rewiring: Training very sparse deep networks"
50 / 172 papers shown
Towards Memory-Efficient Training for Extremely Large Output Spaces -- Learning with 500k Labels on a Single Commodity GPU
Erik Schultheis
Rohit Babbar
192
5
0
06 Jun 2023
Dynamic Sparsity Is Channel-Level Sparsity Learner
Neural Information Processing Systems (NeurIPS), 2023
Lu Yin
Gen Li
Meng Fang
Lijuan Shen
Tianjin Huang
Zinan Lin
Vlado Menkovski
Xiaolong Ma
Mykola Pechenizkiy
Shiwei Liu
295
23
0
30 May 2023
Pruning at Initialization -- A Sketching Perspective
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Noga Bar
Raja Giryes
280
1
0
27 May 2023
Dynamic Sparse Training with Structured Sparsity
International Conference on Learning Representations (ICLR), 2023
Mike Lasby
A. Golubeva
Utku Evci
Mihai Nica
Yani Andrew Ioannou
625
34
0
03 May 2023
Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models
D. Honegger
Konstantin Schurholt
Damian Borth
245
5
0
26 Apr 2023
NTK-SAP: Improving neural network pruning by aligning training dynamics
International Conference on Learning Representations (ICLR), 2023
Yite Wang
Dawei Li
Tian Ding
228
32
0
06 Apr 2023
Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks
Zahra Atashgahi
Xuhao Zhang
Neil Kichler
Shiwei Liu
Lu Yin
Mykola Pechenizkiy
Raymond N. J. Veldhuis
Decebal Constantin Mocanu
277
14
0
10 Mar 2023
Efficient Real Time Recurrent Learning through combined activity and parameter sparsity
Anand Subramoney
127
3
0
10 Mar 2023
Balanced Training for Sparse GANs
Neural Information Processing Systems (NeurIPS), 2023
Yite Wang
Jing Wu
N. Hovakimyan
Tian Ding
298
12
0
28 Feb 2023
Calibrating the Rigged Lottery: Making All Tickets Reliable
International Conference on Learning Representations (ICLR), 2023
Bowen Lei
Ruqi Zhang
Dongkuan Xu
Bani Mallick
UQCV
213
8
0
18 Feb 2023
Automatic Noise Filtering with Dynamic Sparse Training in Deep Reinforcement Learning
Adaptive Agents and Multi-Agent Systems (AAMAS), 2023
Bram Grooten
Ghada Sokar
Shibhansh Dohare
Elena Mocanu
Matthew E. Taylor
Mykola Pechenizkiy
Decebal Constantin Mocanu
181
16
0
13 Feb 2023
SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks
International Conference on Machine Learning (ICML), 2023
Mahdi Nikdan
Tommaso Pegolotti
Eugenia Iofinova
Eldar Kurtic
Dan Alistarh
202
12
0
09 Feb 2023
Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook for Sparse Neural Network Researchers
Shiwei Liu
Zinan Lin
427
34
0
06 Feb 2023
Learnable Heterogeneous Convolution: Learning both topology and strength
Neural Networks (NN), 2021
Rongzhen Zhao
Zhenzhi Wu
Qikun Zhang
217
7
0
13 Jan 2023
Balance is Essence: Accelerating Sparse Training via Adaptive Gradient Correction
Bowen Lei
Dongkuan Xu
Ruqi Zhang
Shuren He
Bani Mallick
289
6
0
09 Jan 2023
Phenomenological modeling of diverse and heterogeneous synaptic dynamics at natural density
Agnes Korcsak-Gorzo
C. Linssen
Jasper Albers
Stefan Dasbach
Renato Duarte
...
Johanna Senk
J. Stapmanns
Tom Tetzlaff
M. Diesmann
Sacha Jennifer van Albada
127
1
0
10 Dec 2022
Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off
Design Automation Conference (DAC), 2022
Shaoyi Huang
Bowen Lei
Dongkuan Xu
Hongwu Peng
Yue Sun
Mimi Xie
Caiwen Ding
252
21
0
30 Nov 2022
Adaptive Sparse Structure Development with Pruning and Regeneration for Spiking Neural Networks
Information Sciences (Inf. Sci.), 2022
Bing Han
Feifei Zhao
Yi Zeng
Wenxuan Pan
136
18
0
22 Nov 2022
Exploiting the Partly Scratch-off Lottery Ticket for Quantization-Aware Training
Mingliang Xu
Gongrui Nan
Yuxin Zhang
Jiayi Ji
Rongrong Ji
MQ
309
3
0
12 Nov 2022
LOFT: Finding Lottery Tickets through Filter-wise Training
International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Qihan Wang
Chen Dun
Fangshuo Liao
C. Jermaine
Anastasios Kyrillidis
181
3
0
28 Oct 2022
Gradient-based Weight Density Balancing for Robust Dynamic Sparse Training
Mathias Parger
Alexander Ertl
Paul Eibensteiner
J. H. Mueller
Martin Winter
M. Steinberger
151
1
0
25 Oct 2022
On the optimization and pruning for Bayesian deep learning
X. Ke
Yanan Fan
BDL
UQCV
216
1
0
24 Oct 2022
Pushing the Efficiency Limit Using Structured Sparse Convolutions
IEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2022
Vinay Kumar Verma
Nikhil Mehta
Shijing Si
Ricardo Henao
Lawrence Carin
182
3
0
23 Oct 2022
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach
Neural Information Processing Systems (NeurIPS), 2022
Peng Mi
Li Shen
Tianhe Ren
Weihao Ye
Xiaoshuai Sun
Rongrong Ji
Dacheng Tao
AAML
270
84
0
11 Oct 2022
Why Random Pruning Is All We Need to Start Sparse
International Conference on Machine Learning (ICML), 2022
Advait Gadhikar
Sohom Mukherjee
R. Burkholz
288
30
0
05 Oct 2022
Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training
Neural Information Processing Systems (NeurIPS), 2022
Geng Yuan
Yanyu Li
Sheng Li
Zhenglun Kong
Sergey Tulyakov
Xulong Tang
Yanzhi Wang
Jian Ren
287
20
0
22 Sep 2022
SparCL: Sparse Continual Learning on the Edge
Neural Information Processing Systems (NeurIPS), 2022
Zifeng Wang
Zheng Zhan
Yifan Gong
Geng Yuan
Wei Niu
T. Jian
Bin Ren
Stratis Ioannidis
Yanzhi Wang
Jennifer Dy
CLL
278
77
0
20 Sep 2022
Training Recipe for N:M Structured Sparsity with Decaying Pruning Mask
Sheng-Chun Kao
Amir Yazdanbakhsh
Suvinay Subramanian
Shivani Agrawal
Utku Evci
T. Krishna
316
15
0
15 Sep 2022
Winning the Lottery Ahead of Time: Efficient Early Network Pruning
International Conference on Machine Learning (ICML), 2022
John Rachwan
Daniel Zügner
Bertrand Charpentier
Simon Geisler
Morgane Ayle
Stephan Günnemann
241
33
0
21 Jun 2022
NISPA: Neuro-Inspired Stability-Plasticity Adaptation for Continual Learning in Sparse Networks
International Conference on Machine Learning (ICML), 2022
Mustafa Burak Gurbuz
C. Dovrolis
CLL
178
52
0
18 Jun 2022
The State of Sparse Training in Deep Reinforcement Learning
International Conference on Machine Learning (ICML), 2022
L. Graesser
Utku Evci
Erich Elsen
Pablo Samuel Castro
OffRL
282
58
0
17 Jun 2022
Superposing Many Tickets into One: A Performance Booster for Sparse Neural Network Training
Conference on Uncertainty in Artificial Intelligence (UAI), 2022
Lu Yin
Vlado Menkovski
Meng Fang
Tianjin Huang
Yulong Pei
Mykola Pechenizkiy
Decebal Constantin Mocanu
Shiwei Liu
275
9
0
30 May 2022
RLx2: Training a Sparse Deep Reinforcement Learning Model from Scratch
International Conference on Learning Representations (ICLR), 2022
Y. Tan
Pihe Hu
L. Pan
Jiatai Huang
Longbo Huang
OffRL
273
34
0
30 May 2022
Spartan: Differentiable Sparsity via Regularized Transportation
Neural Information Processing Systems (NeurIPS), 2022
Kai Sheng Tai
Taipeng Tian
Ser-Nam Lim
235
13
0
27 May 2022
Perturbation of Deep Autoencoder Weights for Model Compression and Classification of Tabular Data
Neural Networks (NN), 2022
Manar D. Samad
Sakib Abrar
126
13
0
17 May 2022
Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey
Artificial Intelligence Review (Artif Intell Rev), 2022
Paul Wimmer
Jens Mehnert
Alexandru Paul Condurache
DD
333
33
0
17 May 2022
Interspace Pruning: Using Adaptive Filter Representations to Improve Training of Sparse CNNs
Computer Vision and Pattern Recognition (CVPR), 2022
Paul Wimmer
Jens Mehnert
Alexandru Paul Condurache
CVBM
159
28
0
15 Mar 2022
Dual Lottery Ticket Hypothesis
International Conference on Learning Representations (ICLR), 2022
Yue Bai
Haiquan Wang
Zhiqiang Tao
Kunpeng Li
Yun Fu
161
48
0
08 Mar 2022
The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training
International Conference on Learning Representations (ICLR), 2022
Shiwei Liu
Tianlong Chen
Xiaohan Chen
Li Shen
Decebal Constantin Mocanu
Zinan Lin
Mykola Pechenizkiy
242
129
0
05 Feb 2022
On the Convergence of Heterogeneous Federated Learning with Arbitrary Adaptive Online Model Pruning
Hanhan Zhou
Tian-Shing Lan
Guru Venkataramani
Wenbo Ding
FedML
185
9
0
27 Jan 2022
Achieving Personalized Federated Learning with Sparse Local Models
Tiansheng Huang
Shiwei Liu
Li Shen
Fengxiang He
Weiwei Lin
Dacheng Tao
FedML
182
49
0
27 Jan 2022
Holistic Deep Learning
Machine-mediated learning (ML), 2021
Dimitris Bertsimas
Kimberly Villalobos Carballo
L. Boussioux
M. Li
Alex Paskov
I. Paskov
329
3
0
29 Oct 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge
Geng Yuan
Xiaolong Ma
Wei Niu
Zhengang Li
Zhenglun Kong
...
Minghai Qin
Bin Ren
Yanzhi Wang
Sijia Liu
Xue Lin
395
114
0
26 Oct 2021
SportsSum2.0: Generating High-Quality Sports News from Live Text Commentary
International Conference on Information and Knowledge Management (CIKM), 2021
Jiaan Wang
Zhixu Li
Qiang Yang
Jianfeng Qu
Zhigang Chen
Qingsheng Liu
Guoping Hu
AI4TS
205
8
0
12 Oct 2021
Powerpropagation: A sparsity inducing weight reparameterisation
Jonathan Richard Schwarz
Siddhant M. Jayakumar
Razvan Pascanu
P. Latham
Yee Whye Teh
380
58
0
01 Oct 2021
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging
Edouard Yvinec
Arnaud Dapogny
Matthieu Cord
Kévin Bailly
228
24
0
30 Sep 2021
Architecture Aware Latency Constrained Sparse Neural Networks
Tianli Zhao
Qinghao Hu
Xiangyu He
Weixiang Xu
Jiaxing Wang
Cong Leng
Jian Cheng
158
0
0
01 Sep 2021
A fast asynchronous MCMC sampler for sparse Bayesian inference
Yves F. Atchadé
Liwei Wang
143
3
0
14 Aug 2021
Towards Structured Dynamic Sparse Pre-Training of BERT
A. Dietrich
Frithjof Gressmann
Douglas Orr
Ivan Chelombiev
Daniel Justus
Carlo Luschi
151
17
0
13 Aug 2021
A Method for Medical Data Analysis Using the LogNNet for Clinical Decision Support Systems and Edge Computing in Healthcare
Italian National Conference on Sensors (INS), 2021
Andrei Velichko
215
21
0
05 Aug 2021
Previous
1
2
3
4
Next
