Proving the Lottery Ticket Hypothesis: Pruning is All You Need

3 February 2020

Papers citing "Proving the Lottery Ticket Hypothesis: Pruning is All You Need"

29 / 179 papers shown

Title
Dense for the Price of Sparse: Improved Performance of Sparsely Initialized Networks via a Subspace Offset Ilan Price Jared Tanner 19 15 0 12 Feb 2021
Slot Machines: Discovering Winning Combinations of Random Weights in Neural Networks Maxwell Mbabilla Aladago Lorenzo Torresani 17 10 0 16 Jan 2021
Provable Benefits of Overparameterization in Model Compression: From Double Descent to Pruning Neural Networks Xiangyu Chang Yingcong Li Samet Oymak Christos Thrampoulidis 22 49 0 16 Dec 2020
The Lottery Ticket Hypothesis for Object Recognition Sharath Girish Shishira R. Maiya Kamal Gupta Hao Chen L. Davis Abhinav Shrivastava 75 60 0 08 Dec 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 42 116 0 25 Nov 2020
Rethinking Weight Decay For Efficient Neural Network Pruning Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel T. Hannagan David Bertrand 21 25 0 20 Nov 2020
Greedy Optimization Provably Wins the Lottery: Logarithmic Number of Winning Tickets is Enough Mao Ye Lemeng Wu Qiang Liu 15 17 0 29 Oct 2020
Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win Utku Evci Yani Andrew Ioannou Cem Keskin Yann N. Dauphin 19 74 0 07 Oct 2020
A Gradient Flow Framework For Analyzing Network Pruning Ekdeep Singh Lubana Robert P. Dick 16 51 0 24 Sep 2020
Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot Jingtong Su Yihang Chen Tianle Cai Tianhao Wu Ruiqi Gao Liwei Wang J. Lee 6 85 0 22 Sep 2020
HALO: Learning to Prune Neural Networks with Shrinkage Skyler Seto M. Wells Wenyu Zhang 14 0 0 24 Aug 2020
NCS4CVR: Neuron-Connection Sharing for Multi-Task Learning in Video Conversion Rate Prediction Xuanji Xiao Huabin Chen Yuzhen Liu Xing Yao Pei Liu Chaosheng Fan Nian Ji Xirong Jiang 6 1 0 22 Aug 2020
Kronecker CP Decomposition with Fast Multiplication for Compressing RNNs Dingheng Wang Bijiao Wu Guangshe Zhao Man Yao Hengnu Chen Lei Deng Tianyi Yan Guoqi Li MQ 6 24 0 21 Aug 2020
How Powerful are Shallow Neural Networks with Bandlimited Random Weights? Ming Li Sho Sonoda Feilong Cao Yu Wang Jiye Liang 6 7 0 19 Aug 2020
Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude Pruning Bryn Elesedy Varun Kanade Yee Whye Teh 11 30 0 16 Jul 2020
The curious case of developmental BERTology: On sparsity, transfer learning, generalization and the brain Xin Wang 6 1 0 07 Jul 2020
Statistical Mechanical Analysis of Neural Network Pruning Rupam Acharyya Ankani Chattoraj Boyu Zhang Shouman Das Daniel Stefankovic 16 0 0 30 Jun 2020
The Heterogeneity Hypothesis: Finding Layer-Wise Differentiated Network Architectures Yawei Li Wen Li Martin Danelljan K. Zhang Shuhang Gu Luc Van Gool Radu Timofte 16 18 0 29 Jun 2020
Supermasks in Superposition Mitchell Wortsman Vivek Ramanujan Rosanne Liu Aniruddha Kembhavi Mohammad Rastegari J. Yosinski Ali Farhadi SSL CLL 17 279 0 26 Jun 2020
Logarithmic Pruning is All You Need Laurent Orseau Marcus Hutter Omar Rivasplata 15 88 0 22 Jun 2020
Exploring Weight Importance and Hessian Bias in Model Pruning Mingchen Li Yahya Sattar Christos Thrampoulidis Samet Oymak 20 3 0 19 Jun 2020
Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient Ankit Pensia Shashank Rajput Alliot Nagle Harit Vishwakarma Dimitris Papailiopoulos 17 102 0 14 Jun 2020
Convolutional neural networks compression with low rank and sparse tensor decompositions Pavel Kaloshin 19 1 0 11 Jun 2020
Pruning via Iterative Ranking of Sensitivity Statistics Stijn Verdenius M. Stol Patrick Forré AAML 8 37 0 01 Jun 2020
Random Features for Kernel Approximation: A Survey on Algorithms, Theory, and Beyond Fanghui Liu Xiaolin Huang Yudong Chen Johan A. K. Suykens BDL 27 172 0 23 Apr 2020
CAZSL: Zero-Shot Regression for Pushing Models by Generalizing Through Context Wenyu Zhang Skyler Seto Devesh K. Jha 18 5 0 26 Mar 2020
Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection Mao Ye Chengyue Gong Lizhen Nie Denny Zhou Adam R. Klivans Qiang Liu 24 108 0 03 Mar 2020
Identifying Critical Neurons in ANN Architectures using Mixed Integer Programming M. Elaraby Guy Wolf Margarida Carvalho 26 5 0 17 Feb 2020
Exploring Structural Sparsity of Deep Networks via Inverse Scale Spaces Yanwei Fu Chen Liu Donghao Li Zuyuan Zhong Xinwei Sun Jinshan Zeng Yuan Yao 17 10 0 23 May 2019