v1v2v3v4v5 (latest)

Deep Rewiring: Training very sparse deep networks

14 November 2017

Papers citing "Deep Rewiring: Training very sparse deep networks"

50 / 170 papers shown

Title
A Long Short-Term Memory for AI Applications in Spike-based Neuromorphic HardwareNature Machine Intelligence (Nat. Mach. Intell.), 2021 Philipp Plank A. Rao Andreas Wild Wolfgang Maass 173 115 0 08 Jul 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic SparsityInternational Conference on Learning Representations (ICLR), 2021 Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zinan Lin Decebal Constantin Mocanu OOD 339 62 0 28 Jun 2021
AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networks Alexandra Peste Eugenia Iofinova Adrian Vladu Dan Alistarh AI4CE 564 76 0 23 Jun 2021
Sparse Training via Boosting Pruning Plasticity with NeuroregenerationNeural Information Processing Systems (NeurIPS), 2021 Shiwei Liu Tianlong Chen Xiaohan Chen Zahra Atashgahi Lu Yin Huanyu Kou Li Shen Mykola Pechenizkiy Zinan Lin Decebal Constantin Mocanu 259 133 0 19 Jun 2021
Pruning Randomly Initialized Neural Networks with Iterative Randomization Daiki Chijiwa Shin'ya Yamaguchi Yasutoshi Ida Kenji Umakoshi T. Inoue 131 29 0 17 Jun 2021
PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech RecognitionNeural Information Processing Systems (NeurIPS), 2021 Cheng-I Jeff Lai Yang Zhang Alexander H. Liu Shiyu Chang Yi-Lun Liao Yung-Sung Chuang Kaizhi Qian Sameer Khurana David D. Cox James R. Glass VLM 270 86 0 10 Jun 2021
Dynamic Sparse Training for Deep Reinforcement LearningInternational Joint Conference on Artificial Intelligence (IJCAI), 2021 Ghada Sokar Elena Mocanu Decebal Constantin Mocanu Mykola Pechenizkiy Peter Stone 268 68 0 08 Jun 2021
Top-KAST: Top-K Always Sparse TrainingNeural Information Processing Systems (NeurIPS), 2021 Siddhant M. Jayakumar Razvan Pascanu Jack W. Rae Simon Osindero Erich Elsen 318 107 0 07 Jun 2021
Search Spaces for Neural Model Training Darko Stosic Dusan Stosic 139 4 0 27 May 2021
Dynamic Probabilistic Pruning: A general framework for hardware-constrained pruning at different granularitiesIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2021 L. Gonzalez-Carabarin Iris A. M. Huijben Bastian Veeling A. Schmid Ruud J. G. van Sloun 120 16 0 26 May 2021
Livewired Neural Networks: Making Neurons That Fire Together Wire Together Thomas Schumacher 195 4 0 17 May 2021
Pruning of Deep Spiking Neural Networks through Gradient RewiringInternational Joint Conference on Artificial Intelligence (IJCAI), 2021 Yanqing Chen Zhaofei Yu Wei Fang Tiejun Huang Yonghong Tian 238 82 0 11 May 2021
Initialization and Regularization of Factorized Neural LayersInternational Conference on Learning Representations (ICLR), 2021 M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 398 68 0 03 May 2021
Effective Sparsification of Neural Networks with Global Sparsity ConstraintComputer Vision and Pattern Recognition (CVPR), 2021 Xiao Zhou Weizhong Zhang Hang Xu Tong Zhang 247 75 0 03 May 2021
Lottery Jackpots Exist in Pre-trained ModelsIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 Yuxin Zhang Mingbao Lin Yan Wang Jiayi Ji Rongrong Ji 343 18 0 18 Apr 2021
Recent Advances on Neural Network Pruning at InitializationInternational Joint Conference on Artificial Intelligence (IJCAI), 2021 Huan Wang Can Qin Yue Bai Yulun Zhang Yun Fu CVBM 193 80 0 11 Mar 2021
Sparse Training Theory for Scalable and Efficient AgentsAdaptive Agents and Multi-Agent Systems (AAMAS), 2021 Decebal Constantin Mocanu Elena Mocanu T. Pinto Selima Curci Phuong H. Nguyen M. Gibescu D. Ernst Z. Vale 179 18 0 02 Mar 2021
Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable MasksNeural Information Processing Systems (NeurIPS), 2021 Itay Hubara Brian Chmiel Moshe Island Ron Banner S. Naor Daniel Soudry 256 132 0 16 Feb 2021
Learning N:M Fine-grained Structured Sparse Neural Networks From ScratchInternational Conference on Learning Representations (ICLR), 2021 Aojun Zhou Yukun Ma Junnan Zhu Jianbo Liu Zhijie Zhang Kun Yuan Wenxiu Sun Jiaming Song 446 277 0 08 Feb 2021
Truly Sparse Neural Networks at Scale Selima Curci Decebal Constantin Mocanu Mykola Pechenizkiy 301 23 0 02 Feb 2021
Attention-based Convolutional Autoencoders for 3D-Variational Data AssimilationComputer Methods in Applied Mechanics and Engineering (CMAME), 2020 Julian Mack Rossella Arcucci Miguel Molina-Solana Yi-Ke Guo 3DPC 154 38 0 06 Jan 2021
Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for AutoencodersMachine-mediated learning (ML), 2020 Zahra Atashgahi Ghada Sokar T. Lee Elena Mocanu Decebal Constantin Mocanu Raymond N. J. Veldhuis Mykola Pechenizkiy 330 47 0 01 Dec 2020
Improving Neural Network with Uniform Sparse ConnectivityIEEE Access (IEEE Access), 2020 Weijun Luo 55 6 0 29 Nov 2020
FreezeNet: Full Performance by Reduced Storage CostsAsian Conference on Computer Vision (ACCV), 2020 Paul Wimmer Jens Mehnert Alexandru Paul Condurache 112 15 0 28 Nov 2020
Rethinking Weight Decay For Efficient Neural Network PruningJournal of Imaging (JI), 2020 Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel T. Hannagan David Bertrand 275 29 0 20 Nov 2020
Layer-Wise Data-Free CNN CompressionInternational Conference on Pattern Recognition (ICPR), 2020 Maxwell Horton Yanzi Jin Ali Farhadi Mohammad Rastegari MQ 199 19 0 18 Nov 2020
Dynamic Hard Pruning of Neural Networks at the Edge of the InternetJournal of Network and Computer Applications (JNCA), 2020 Lorenzo Valerio F. M. Nardini A. Passarella R. Perego 187 16 0 17 Nov 2020
Using noise to probe recurrent neural network structure and prune synapsesNeural Information Processing Systems (NeurIPS), 2020 Eli Moore Rishidev Chaudhuri 116 8 0 14 Nov 2020
Are wider nets better given the same number of parameters?International Conference on Learning Representations (ICLR), 2020 A. Golubeva Behnam Neyshabur Guy Gur-Ari 202 46 0 27 Oct 2020
Brain-Inspired Learning on Neuromorphic Substrates Friedemann Zenke Emre Neftci 245 95 0 22 Oct 2020
Activation function impact on Sparse Neural Networks A. Dubowski CVBM 92 6 0 12 Oct 2020
FlipOut: Uncovering Redundant Weights via Sign Flipping A. Apostol M. Stol Patrick Forré UQCV 63 1 0 05 Sep 2020
SpaceNet: Make Free Space For Continual LearningNeurocomputing (Neurocomputing), 2020 Ghada Sokar Decebal Constantin Mocanu Mykola Pechenizkiy CLL 198 85 0 15 Jul 2020
ESPN: Extremely Sparse Pruned Networks Minsu Cho Ameya Joshi Chinmay Hegde 143 11 0 28 Jun 2020
Ramanujan Bipartite Graph Products for Efficient Block Sparse Neural NetworksConcurrency and Computation (CCPE), 2020 Dharma Teja Vooturi G. Varma Kishore Kothapalli 178 7 0 24 Jun 2020
Progressive Skeletonization: Trimming more fat from a network at initialization Pau de Jorge Amartya Sanyal Harkirat Singh Behl Juil Sock Grégory Rogez P. Dokania 428 108 0 16 Jun 2020
Finding trainable sparse networks through Neural Tangent Transfer Tianlin Liu Friedemann Zenke 163 39 0 15 Jun 2020
Dynamic Model Pruning with FeedbackInternational Conference on Learning Representations (ICLR), 2020 Tao Lin Sebastian U. Stich Luis Barba Daniil Dmitriev Martin Jaggi 238 222 0 12 Jun 2020
Pruning neural networks without any data by iteratively conserving synaptic flow Hidenori Tanaka D. Kunin Daniel L. K. Yamins Surya Ganguli 510 746 0 09 Jun 2020
An Overview of Neural Network Compression James OÑeill AI4CE 300 112 0 05 Jun 2020
Sparsity in Reservoir Computing Neural Networks Claudio Gallicchio 70 16 0 04 Jun 2020
Pruning via Iterative Ranking of Sensitivity Statistics Stijn Verdenius M. Stol Patrick Forré AAML 165 42 0 01 Jun 2020
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers Junjie Liu Zhe Xu Runbin Shi R. Cheung Hayden Kwok-Hay So 148 132 0 14 May 2020
Spiking Neural Networks Hardware Implementations and Challenges: a SurveyACM Journal on Emerging Technologies in Computing Systems (JETC), 2019 Maxence Bouvier A. Valentian T. Mesquida F. Rummens M. Reyboz Elisa Vianello E. Beigné 214 132 0 04 May 2020
Exposing Hardware Building Blocks to Machine Learning Frameworks Yash Akhauri 73 0 0 10 Apr 2020
Embodied Synaptic Plasticity with Online Reinforcement learning Jacques Kaiser M. Hoff Andreas Konle J. C. V. Tieck David Kappel ... Anand Subramoney Robert Legenstein A. Rönnau Wolfgang Maass Rüdiger Dillmann OffRL 103 16 0 03 Mar 2020
HYDRA: Pruning Adversarially Robust Neural Networks Vikash Sehwag Shiqi Wang Prateek Mittal Suman Jana AAML 196 25 0 24 Feb 2020
Lookahead: A Far-Sighted Alternative of Magnitude-based PruningInternational Conference on Learning Representations (ICLR), 2020 Sejun Park Jaeho Lee Sangwoo Mo Jinwoo Shin 104 100 0 12 Feb 2020
Soft Threshold Weight Reparameterization for Learnable SparsityInternational Conference on Machine Learning (ICML), 2020 Aditya Kusupati Vivek Ramanujan Raghav Somani Mitchell Wortsman Prateek Jain Sham Kakade Ali Farhadi 569 261 0 08 Feb 2020
Looking GLAMORous: Vehicle Re-Id in Heterogeneous Cameras Networks with Global and Local Attention Abhijit Suprem C. Pu 125 31 0 06 Feb 2020

All Papers

Deep Rewiring: Training very sparse deep networks

Papers citing "Deep Rewiring: Training very sparse deep networks"