Stabilizing the Lottery Ticket Hypothesis

Stabilizing the Lottery Ticket Hypothesis

5 March 2019

Jonathan Frankle

Gintare Karolina Dziugaite

Papers citing "Stabilizing the Lottery Ticket Hypothesis"

19 / 19 papers shown

Title
AdapMTL: Adaptive Pruning Framework for Multitask Learning Model Mingcan Xiang Steven Jiaxun Tang Qizheng Yang Hui Guan Tongping Liu VLM 39 0 0 07 Aug 2024
Iterative Magnitude Pruning as a Renormalisation Group: A Study in The Context of The Lottery Ticket Hypothesis Abu-Al Hassan 27 0 0 06 Aug 2023
Seeking Interpretability and Explainability in Binary Activated Neural Networks Benjamin Leblanc Pascal Germain FAtt 37 1 0 07 Sep 2022
Speedup deep learning models on GPU by taking advantage of efficient unstructured pruning and bit-width reduction Marcin Pietroñ Dominik Zurek 24 13 0 28 Dec 2021
An Experimental Study of the Impact of Pre-training on the Pruning of a Convolutional Neural Network Nathan Hubens M. Mancas B. Gosselin Marius Preda T. Zaharia VLM CVBM 21 8 0 15 Dec 2021
Powerpropagation: A sparsity inducing weight reparameterisation Jonathan Richard Schwarz Siddhant M. Jayakumar Razvan Pascanu P. Latham Yee Whye Teh 90 54 0 01 Oct 2021
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration Shiwei Liu Tianlong Chen Xiaohan Chen Zahra Atashgahi Lu Yin Huanyu Kou Li Shen Mykola Pechenizkiy Zhangyang Wang D. Mocanu 34 111 0 19 Jun 2021
Troubleshooting Blind Image Quality Models in the Wild Zhihua Wang Haotao Wang Tianlong Chen Zhangyang Wang Kede Ma 15 19 0 14 May 2021
The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Michael Carbin Zhangyang Wang 24 122 0 12 Dec 2020
Beyond Signal Propagation: Is Feature Diversity Necessary in Deep Neural Network Initialization? Yaniv Blumenfeld D. Gilboa Daniel Soudry ODL 24 13 0 02 Jul 2020
Data-dependent Pruning to find the Winning Lottery Ticket Dániel Lévai Zsolt Zombori UQCV 11 0 0 25 Jun 2020
Revisiting Loss Modelling for Unstructured Pruning César Laurent Camille Ballas Thomas George Nicolas Ballas Pascal Vincent 22 14 0 22 Jun 2020
Exploring Weight Importance and Hessian Bias in Model Pruning Mingchen Li Yahya Sattar Christos Thrampoulidis Samet Oymak 28 3 0 19 Jun 2020
An Overview of Neural Network Compression James OÑeill AI4CE 45 98 0 05 Jun 2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning Victor Sanh Thomas Wolf Alexander M. Rush 30 466 0 15 May 2020
Deep Randomized Neural Networks Claudio Gallicchio Simone Scardapane OOD 43 61 0 27 Feb 2020
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 14 168 0 19 Dec 2019
Learning Sparse Sharing Architectures for Multiple Tasks Tianxiang Sun Yunfan Shao Xiaonan Li Pengfei Liu Hang Yan Xipeng Qiu Xuanjing Huang MoE 30 128 0 12 Nov 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 20 334 0 10 Jul 2019