Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?

1 July 2021

Papers citing "Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?"

50 / 51 papers shown

Title
Sign-In to the Lottery: Reparameterizing Sparse Training From Scratch Advait Gadhikar Tom Jacobs Chao Zhou R. Burkholz 27 0 0 17 Apr 2025
Hyperflows: Pruning Reveals the Importance of Weights Eugen Barbulescu Antonio Alexoaie 21 0 0 06 Apr 2025
DynST: Dynamic Sparse Training for Resource-Constrained Spatio-Temporal Forecasting Hao Wu Haomin Wen Guibin Zhang Yutong Xia Kai Wang Yuxuan Liang Yu Zheng Kun Wang 60 2 0 17 Jan 2025
Fast Track to Winning Tickets: Repowering One-Shot Pruning for Graph Neural Networks Yanwei Yue Guibin Zhang Haoran Yang Dawei Cheng 77 0 0 10 Dec 2024
Revisiting Machine Unlearning with Dimensional Alignment Seonguk Seo Dongwan Kim Bohyung Han MU 29 0 0 25 Jul 2024
Efficient DNN-Powered Software with Fair Sparse Models Xuanqi Gao Weipeng Jiang Juan Zhai Shiqing Ma Xiaoyu Zhang Chao Shen 33 0 0 03 Jul 2024
Cyclic Sparse Training: Is it Enough? Advait Gadhikar Sree Harsha Nelaturu R. Burkholz CLL 40 0 0 04 Jun 2024
What makes unlearning hard and what to do about it Kairan Zhao M. Kurmanji George-Octavian Barbulescu Eleni Triantafillou Peter Triantafillou MU 58 16 0 03 Jun 2024
Accelerating ViT Inference on FPGA through Static and Dynamic Pruning Dhruv Parikh Shouyi Li Bingyi Zhang Rajgopal Kannan Carl E. Busart Viktor Prasanna 38 1 0 21 Mar 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 37 12 0 07 Mar 2024
Masks, Signs, And Learning Rate Rewinding Advait Gadhikar R. Burkholz 55 8 0 29 Feb 2024
Discriminative Adversarial Unlearning Rohan Sharma Shijie Zhou Kaiyi Ji Changyou Chen MU 22 1 0 10 Feb 2024
Two Heads Are Better Than One: Boosting Graph Sparse Training via Semantic and Topological Awareness Guibin Zhang Yanwei Yue Kun Wang Junfeng Fang Yongduo Sui Kai Wang Yuxuan Liang Dawei Cheng Shirui Pan Tianlong Chen 27 10 0 02 Feb 2024
PriPrune: Quantifying and Preserving Privacy in Pruned Federated Learning Tianyue Chu Mengwei Yang Nikolaos Laoutaris A. Markopoulou 34 4 0 30 Oct 2023
Successfully Applying Lottery Ticket Hypothesis to Diffusion Model Chao Jiang Bo Hui Bohan Liu Da Yan DiffM 29 14 0 28 Oct 2023
Breaking the Trilemma of Privacy, Utility, Efficiency via Controllable Machine Unlearning Zheyuan Liu Guangyao Dou Yijun Tian Chunhui Zhang Eli Chien Ziwei Zhu MU 26 16 0 28 Oct 2023
Unlearning with Fisher Masking Yufang Liu Changzhi Sun Yuanbin Wu Aimin Zhou MU 21 4 0 09 Oct 2023
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training Aochuan Chen Yimeng Zhang Jinghan Jia James Diffenderfer Jiancheng Liu Konstantinos Parasyris Yihua Zhang Zheng-Wei Zhang B. Kailkhura Sijia Liu 30 43 0 03 Oct 2023
Unveiling Invariances via Neural Network Pruning Derek Xu Yizhou Sun Wei Wang 36 0 0 15 Sep 2023
The Snowflake Hypothesis: Training Deep GNN with One Node One Receptive field Kun Wang Guohao Li Shilong Wang Guibin Zhang K. Wang Yang You Xiaojiang Peng Yuxuan Liang Yang Wang 26 8 0 19 Aug 2023
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning Yihua Zhang Prashant Khanduri Ioannis C. Tsaknakis Yuguang Yao Min-Fong Hong Sijia Liu AI4CE 36 25 0 01 Aug 2023
Distilled Pruning: Using Synthetic Data to Win the Lottery Luke McDermott Daniel Cummings SyDa DD 32 1 0 07 Jul 2023
Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning Moonseok Choi Hyungi Lee G. Nam Juho Lee 27 2 0 24 May 2023
Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy T. Shaik Xiaohui Tao Haoran Xie Lin Li Xiaofeng Zhu Qingyuan Li MU 36 25 0 10 May 2023
Rethinking Graph Lottery Tickets: Graph Sparsity Matters Bo Hui Jocelyn M Mora Adrian V. Dalca I. Aganj 37 22 0 03 May 2023
Model Sparsity Can Simplify Machine Unlearning Jinghan Jia Jiancheng Liu Parikshit Ram Yuguang Yao Gaowen Liu Yang Liu Pranay Sharma Sijia Liu MU 22 105 0 11 Apr 2023
Can Adversarial Examples Be Parsed to Reveal Victim Model Information? Yuguang Yao Jiancheng Liu Yifan Gong Xiaoming Liu Yanzhi Wang X. Lin Sijia Liu AAML MLAU 24 1 0 13 Mar 2023
Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook for Sparse Neural Network Researchers Shiwei Liu Zhangyang Wang 27 30 0 06 Feb 2023
Can We Find Strong Lottery Tickets in Generative Models? Sangyeop Yeo Yoojin Jang Jy-yong Sohn Dongyoon Han Jaejun Yoo 13 6 0 16 Dec 2022
Data Level Lottery Ticket Hypothesis for Vision Transformers Xuan Shen Zhenglun Kong Minghai Qin Peiyan Dong Geng Yuan Xin Meng Hao Tang Xiaolong Ma Yanzhi Wang 30 6 0 02 Nov 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 36 68 0 08 Oct 2022
Why Random Pruning Is All We Need to Start Sparse Advait Gadhikar Sohom Mukherjee R. Burkholz 41 19 0 05 Oct 2022
Comprehensive Graph Gradual Pruning for Sparse Training in Graph Neural Networks Chuang Liu Xueqi Ma Yinbing Zhan Liang Ding Dapeng Tao Bo Du Wenbin Hu Danilo P. Mandic 29 28 0 18 Jul 2022
Convolutional and Residual Networks Provably Contain Lottery Tickets R. Burkholz UQCV MLT 35 13 0 04 May 2022
Most Activation Functions Can Win the Lottery Without Excessive Depth R. Burkholz MLT 63 18 0 04 May 2022
CHEX: CHannel EXploration for CNN Model Compression Zejiang Hou Minghai Qin Fei Sun Xiaolong Ma Kun Yuan Yi Xu Yen-kuang Chen Rong Jin Yuan Xie S. Kung 8 71 0 29 Mar 2022
Rare Gems: Finding Lottery Tickets at Initialization Kartik K. Sreenivasan Jy-yong Sohn Liu Yang Matthew Grinde Alliot Nagle Hongyi Wang Eric P. Xing Kangwook Lee Dimitris Papailiopoulos 13 42 0 24 Feb 2022
F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization Qing Jin Jian Ren Richard Zhuang Sumant Hanumante Zhengang Li Zhiyu Chen Yanzhi Wang Kai-Min Yang Sergey Tulyakov MQ 24 48 0 10 Feb 2022
Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets Tianlong Chen Xuxi Chen Xiaolong Ma Yanzhi Wang Zhangyang Wang 11 34 0 09 Feb 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 6 42 0 01 Feb 2022
SPViT: Enabling Faster Vision Transformers via Soft Token Pruning Zhenglun Kong Peiyan Dong Xiaolong Ma Xin Meng Mengshu Sun ... Geng Yuan Bin Ren Minghai Qin H. Tang Yanzhi Wang ViT 26 141 0 27 Dec 2021
Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better Sameer Bibikar H. Vikalo Zhangyang Wang Xiaohan Chen FedML 17 95 0 18 Dec 2021
Toward Compact Parameter Representations for Architecture-Agnostic Neural Network Compression Yuezhou Sun Wenlong Zhao Lijun Zhang Xiao Liu Hui Guan Matei A. Zaharia 21 0 0 19 Nov 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 15 89 0 26 Oct 2021
Lottery Tickets with Nonzero Biases Jonas Fischer Advait Gadhikar R. Burkholz 6 6 0 21 Oct 2021
Playing Lottery Tickets with Vision and Language Zhe Gan Yen-Chun Chen Linjie Li Tianlong Chen Yu Cheng Shuohang Wang Jingjing Liu Lijuan Wang Zicheng Liu VLM 101 53 0 23 Apr 2021
Recent Advances on Neural Network Pruning at Initialization Huan Wang Can Qin Yue Bai Yulun Zhang Yun Fu CVBM 31 64 0 11 Mar 2021
The Lottery Ticket Hypothesis for Object Recognition Sharath Girish Shishira R. Maiya Kamal Gupta Hao Chen L. Davis Abhinav Shrivastava 75 60 0 08 Dec 2020
The Lottery Ticket Hypothesis for Pre-trained BERT Networks Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Zhangyang Wang Michael Carbin 148 376 0 23 Jul 2020
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 222 382 0 05 Mar 2020