Learning Sparse Neural Networks through $L_0$ Regularization

4 December 2017

Papers citing "Learning Sparse Neural Networks through $L_0$ Regularization"

50 / 154 papers shown

Title
Partitioning sparse deep neural networks for scalable training and inference G. Demirci Hakan Ferhatosmanoglu 18 11 0 23 Apr 2021
Lottery Jackpots Exist in Pre-trained Models Yu-xin Zhang Mingbao Lin Yan Wang Fei Chao Rongrong Ji 30 15 0 18 Apr 2021
Local Interpretations for Explainable Natural Language Processing: A Survey Siwen Luo Hamish Ivison S. Han Josiah Poon MILM 33 48 0 20 Mar 2021
Quantization-Guided Training for Compact TinyML Models Sedigh Ghamari Koray Ozcan Thu Dinh A. Melnikov Juan Carvajal Jan Ernst S. Chai MQ 16 16 0 10 Mar 2021
hls4ml: An Open-Source Codesign Workflow to Empower Scientific Low-Power Machine Learning Devices F. Fahim B. Hawks C. Herwig J. Hirschauer S. Jindariani ... J. Ngadiuba Miaoyuan Liu Duc Hoang E. Kreinar Zhenbin Wu 22 129 0 09 Mar 2021
Sparse Training Theory for Scalable and Efficient Agents D. Mocanu Elena Mocanu T. Pinto Selima Curci Phuong H. Nguyen M. Gibescu D. Ernst Z. Vale 45 17 0 02 Mar 2021
An Information-Theoretic Justification for Model Pruning Berivan Isik Tsachy Weissman Albert No 84 35 0 16 Feb 2021
Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks Itay Hubara Brian Chmiel Moshe Island Ron Banner S. Naor Daniel Soudry 46 110 0 16 Feb 2021
End-to-end learnable EEG channel selection for deep neural networks with Gumbel-softmax Thomas Strypsteen Alexander Bertrand 28 50 0 11 Feb 2021
SeReNe: Sensitivity based Regularization of Neurons for Structured Sparsity in Neural Networks Enzo Tartaglione Andrea Bragagnolo Francesco Odierna A. Fiandrotti Marco Grangetto 38 18 0 07 Feb 2021
Parameter-Efficient Transfer Learning with Diff Pruning Demi Guo Alexander M. Rush Yoon Kim 11 383 0 14 Dec 2020
Interpreting Neural Networks as Gradual Argumentation Frameworks (Including Proof Appendix) Nico Potyka AI4CE 21 48 0 10 Dec 2020
DiffPrune: Neural Network Pruning with Deterministic Approximate Binary Gates and $L_0$ Regularization Yaniv Shulman 38 3 0 07 Dec 2020
Rethinking Weight Decay For Efficient Neural Network Pruning Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel T. Hannagan David Bertrand 26 25 0 20 Nov 2020
Dynamic Hard Pruning of Neural Networks at the Edge of the Internet Lorenzo Valerio F. M. Nardini A. Passarella R. Perego 12 12 0 17 Nov 2020
LOss-Based SensiTivity rEgulaRization: towards deep sparse neural networks Enzo Tartaglione Andrea Bragagnolo A. Fiandrotti Marco Grangetto ODL UQCV 13 34 0 16 Nov 2020
Learning to Drop: Robust Graph Neural Network via Topological Denoising Dongsheng Luo Wei Cheng Wenchao Yu Bo Zong Jingchao Ni Haifeng Chen Xiang Zhang OOD 16 257 0 13 Nov 2020
Dirichlet Pruning for Neural Network Compression Kamil Adamczewski Mijung Park 27 3 0 10 Nov 2020
Interpreting Graph Neural Networks for NLP With Differentiable Edge Masking M. Schlichtkrull Nicola De Cao Ivan Titov AI4CE 31 214 0 01 Oct 2020
Pruning Convolutional Filters using Batch Bridgeout Najeeb Khan Ian Stavness 19 3 0 23 Sep 2020
Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot Jingtong Su Yihang Chen Tianle Cai Tianhao Wu Ruiqi Gao Liwei Wang J. Lee 6 85 0 22 Sep 2020
Revisiting Loss Modelling for Unstructured Pruning César Laurent Camille Ballas Thomas George Nicolas Ballas Pascal Vincent 20 14 0 22 Jun 2020
Sparse GPU Kernels for Deep Learning Trevor Gale Matei A. Zaharia C. Young Erich Elsen 10 227 0 18 Jun 2020
Progressive Skeletonization: Trimming more fat from a network at initialization Pau de Jorge Amartya Sanyal Harkirat Singh Behl Philip H. S. Torr Grégory Rogez P. Dokania 21 95 0 16 Jun 2020
A Framework for Neural Network Pruning Using Gibbs Distributions Alex Labach S. Valaee 9 5 0 08 Jun 2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning Victor Sanh Thomas Wolf Alexander M. Rush 19 466 0 15 May 2020
Ensembled sparse-input hierarchical networks for high-dimensional datasets Jean Feng N. Simon 11 4 0 11 May 2020
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey Jiayi Liu S. Tripathi Unmesh Kurup Mohak Shah 3DPC MedIm 22 52 0 08 May 2020
Pruning artificial neural networks: a way to find well-generalizing, high-entropy sharp minima Enzo Tartaglione Andrea Bragagnolo Marco Grangetto 18 11 0 30 Apr 2020
Computation on Sparse Neural Networks: an Inspiration for Future Hardware Fei Sun Minghai Qin Tianyun Zhang Liu Liu Yen-kuang Chen Yuan Xie 29 7 0 24 Apr 2020
Learning to Ask Medical Questions using Reinforcement Learning Uri Shaham Tom Zahavy C. Caraballo S. Mahajan D. Massey H. Krumholz OOD 17 1 0 31 Mar 2020
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 224 382 0 05 Mar 2020
MEMO: A Deep Network for Flexible Combination of Episodic Memories Andrea Banino Adria Puigdomenech Badia Raphael Köster Martin Chadwick V. Zambaldi Demis Hassabis Caswell Barry M. Botvinick D. Kumaran Charles Blundell KELM 26 33 0 29 Jan 2020
Quantisation and Pruning for Neural Network Compression and Regularisation Kimessha Paupamah Steven D. James Richard Klein 6 23 0 14 Jan 2020
Sparse Weight Activation Training Md Aamir Raihan Tor M. Aamodt 32 72 0 07 Jan 2020
Fast Sparse ConvNets Erich Elsen Marat Dukhan Trevor Gale Karen Simonyan 12 151 0 21 Nov 2019
Learning Sparse Sharing Architectures for Multiple Tasks Tianxiang Sun Yunfan Shao Xiaonan Li Pengfei Liu Hang Yan Xipeng Qiu Xuanjing Huang MoE 25 128 0 12 Nov 2019
A Latent Morphology Model for Open-Vocabulary Neural Machine Translation Duygu Ataman Wilker Aziz Alexandra Birch 11 16 0 30 Oct 2019
Implicit Deep Learning L. Ghaoui Fangda Gu Bertrand Travacca Armin Askari Alicia Y. Tsai AI4CE 34 176 0 17 Aug 2019
DeepCABAC: A Universal Compression Algorithm for Deep Neural Networks Simon Wiedemann H. Kirchhoffer Stefan Matlage Paul Haase Arturo Marbán ... Ahmed Osman D. Marpe H. Schwarz Thomas Wiegand Wojciech Samek 41 92 0 27 Jul 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 20 333 0 10 Jul 2019
Interpretable Neural Predictions with Differentiable Binary Variables Jasmijn Bastings Wilker Aziz Ivan Titov 20 211 0 20 May 2019
Training CNNs with Selective Allocation of Channels Jongheon Jeong Jinwoo Shin CVBM 31 15 0 11 May 2019
SEALion: a Framework for Neural Network Inference on Encrypted Data Tim van Elsloo Giorgio Patrini Hamish Ivey-Law FedML 8 42 0 29 Apr 2019
Towards Efficient Model Compression via Learned Global Ranking Ting-Wu Chin Ruizhou Ding Cha Zhang Diana Marculescu 13 170 0 28 Apr 2019
DocBERT: BERT for Document Classification Ashutosh Adhikari Achyudh Ram Raphael Tang Jimmy J. Lin LLMAG VLM 11 296 0 17 Apr 2019
$Learning Sparse Neural Networks via $\ell_0$ and T$\ell_1$ by a Relaxed Variable Splitting Method with Application to Multi-scale Curve Classification$ Learning Sparse Neural Networks via $\ell_0$ and T $\ell_1$ by a Relaxed Variable Splitting Method with Application to Multi-scale Curve Classification Fanghui Xue Jack Xin 22 7 0 20 Feb 2019
A Relational Tucker Decomposition for Multi-Relational Link Prediction Yanjie Wang Samuel Broscheit Rainer Gemulla 9 5 0 03 Feb 2019
Structured Pruning of Neural Networks with Budget-Aware Regularization Carl Lemaire Andrew Achkar Pierre-Marc Jodoin 22 92 0 23 Nov 2018
Rethinking the Value of Network Pruning Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell 8 1,449 0 11 Oct 2018