Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2012.06908
Cited By
v1
v2 (latest)
The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models
Computer Vision and Pattern Recognition (CVPR), 2020
12 December 2020
Tianlong Chen
Jonathan Frankle
Shiyu Chang
Sijia Liu
Yang Zhang
Michael Carbin
Zinan Lin
Re-assign community
ArXiv (abs)
PDF
HTML
Github (69★)
Papers citing
"The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models"
50 / 84 papers shown
The Graphon Limit Hypothesis: Understanding Neural Network Pruning via Infinite Width Analysis
Hoang Pham
T. Ta
Tom Jacobs
R. Burkholz
Long Tran-Thanh
163
1
0
20 Oct 2025
Pruning Overparameterized Multi-Task Networks for Degraded Web Image Restoration
Thomas Katraouras
Dimitrios Rafailidis
VLM
141
0
0
16 Oct 2025
SliceFine: The Universal Winning-Slice Hypothesis for Pretrained Networks
Md. Kowsher
Ali O. Polat
Ehsan Mohammady Ardehaly
Mehrdad Salehi
Zia Ghiasi
Prasanth Murali
Chen Chen
252
2
0
09 Oct 2025
Expand Neurons, Not Parameters
Linghao Kong
Inimai Subramanian
Yonadav Shavit
Micah Adler
Dan Alistarh
Nir Shavit
245
0
0
06 Oct 2025
BLaST: High Performance Inference and Pretraining using BLock Sparse Transformers
Patrik Okanovic
Sameer Deshmukh
Grzegorz Kwa'sniewski
Yi Zhu
Haruto Fujii
...
Maciej Besta
Kentaro Katayama
Takumi Honda
Yusuke Nagasaka
Torsten Hoefler
249
0
0
03 Jul 2025
Navigating Extremes: Dynamic Sparsity in Large Output Spaces
Neural Information Processing Systems (NeurIPS), 2024
Nasib Ullah
Erik Schultheis
Mike Lasby
Yani Andrew Ioannou
Rohit Babbar
496
3
0
05 Nov 2024
Chasing Better Deep Image Priors between Over- and Under-parameterization
Qiming Wu
Xiaohan Chen
Lezhi Li
Zhangyang Wang
385
1
0
31 Oct 2024
Non-transferable Pruning
European Conference on Computer Vision (ECCV), 2024
Ruyi Ding
Lili Su
A. A. Ding
Yunsi Fei
AAML
233
4
0
10 Oct 2024
Learning Representation for Multitask learning through Self Supervised Auxiliary learning
European Conference on Computer Vision (ECCV), 2024
Seokwon Shin
Hyungrok Do
Youngdoo Son
SSL
315
2
0
25 Sep 2024
3D Point Cloud Network Pruning: When Some Weights Do not Matter
British Machine Vision Conference (BMVC), 2024
Amrijit Biswas
M. Hossain
M. M. L. Elahi
A. Cheraghian
Fuad Rahman
Nabeel Mohammed
Shafin Rahman
3DPC
336
5
0
26 Aug 2024
Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning
Leonardo Iurada
Marco Ciccone
Tatiana Tommasi
264
13
0
03 Jun 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare
Xingyu Li
Lu Peng
Yuping Wang
Weihua Zhang
AI4CE
MedIm
LM&MA
386
45
0
10 May 2024
Transferable and Principled Efficiency for Open-Vocabulary Segmentation
Jingxuan Xu
Wuyang Chen
Yao-Min Zhao
Yunchao Wei
VLM
344
2
0
11 Apr 2024
MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning
Matteo Farina
Goran Frehse
Elia Cunegatti
Gaowen Liu
Giovanni Iacca
Elisa Ricci
VLM
318
8
0
08 Apr 2024
A Survey of Lottery Ticket Hypothesis
Bohan Liu
Zijie Zhang
Peixiong He
Zhensen Wang
Yang Xiao
Ruimeng Ye
Yang Zhou
Wei-Shinn Ku
Bo Hui
UQCV
408
25
0
07 Mar 2024
Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective
AAAI Conference on Artificial Intelligence (AAAI), 2023
Can Jin
Tianjin Huang
Yihua Zhang
Mykola Pechenizkiy
Sijia Liu
Shiwei Liu
Tianlong Chen
VLM
537
30
0
03 Dec 2023
Successfully Applying Lottery Ticket Hypothesis to Diffusion Model
Chao Jiang
Bo Hui
Bohan Liu
Da Yan
DiffM
317
16
0
28 Oct 2023
Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization
International Journal of Computer Vision (IJCV), 2023
Zhuo Huang
Muyang Li
Li Shen
Jun-chen Yu
Chen Gong
Bo Han
Tongliang Liu
OOD
359
19
0
25 Oct 2023
Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning
Neural Information Processing Systems (NeurIPS), 2023
Yihua Zhang
Yimeng Zhang
Chenyi Zi
Jinghan Jia
Jiancheng Liu
Gaowen Liu
Min-Fong Hong
Shiyu Chang
Sijia Liu
AAML
421
16
0
13 Oct 2023
Sleep Stage Classification Using a Pre-trained Deep Learning Model
Hassan Ardeshir
Mohammad Araghi
166
1
0
12 Sep 2023
Can Unstructured Pruning Reduce the Depth in Deep Neural Networks?
Liao Zhu
Victor Quétu
Van-Tam Nguyen
Enzo Tartaglione
288
33
0
12 Aug 2023
Accurate Neural Network Pruning Requires Rethinking Sparse Optimization
Denis Kuznedelev
Eldar Kurtic
Eugenia Iofinova
Elias Frantar
Alexandra Peste
Dan Alistarh
VLM
379
13
0
03 Aug 2023
SparseOptimizer: Sparsify Language Models through Moreau-Yosida Regularization and Accelerate via Compiler Co-design
Fu-Ming Guo
MoE
331
0
0
27 Jun 2023
Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models
International Conference on Machine Learning (ICML), 2023
A. Jaiswal
Shiwei Liu
Tianlong Chen
Ying Ding
Zinan Lin
VLM
263
24
0
18 Jun 2023
Transferability of Winning Lottery Tickets in Neural Network Differential Equation Solvers
Edward Prideaux-Ghee
180
0
0
16 Jun 2023
Improving Generalization in Meta-Learning via Meta-Gradient Augmentation
International Joint Conference on Artificial Intelligence (IJCAI), 2023
Ren Wang
Haoliang Sun
Qinglai Wei
Xiushan Nie
Yuling Ma
Yilong Yin
264
1
0
14 Jun 2023
Pruning at Initialization -- A Sketching Perspective
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Noga Bar
Raja Giryes
334
1
0
27 May 2023
Towards Compute-Optimal Transfer Learning
Massimo Caccia
Alexandre Galashov
Arthur Douillard
Amal Rannen-Triki
Dushyant Rao
Michela Paganini
Laurent Charlin
MarcÁurelio Ranzato
Razvan Pascanu
191
4
0
25 Apr 2023
Robust Tickets Can Transfer Better: Drawing More Transferable Subnetworks in Transfer Learning
Design Automation Conference (DAC), 2023
Y. Fu
Ye Yuan
Shang Wu
Jiayi Yuan
Yingyan Lin
OOD
337
4
0
24 Apr 2023
Model Sparsity Can Simplify Machine Unlearning
Neural Information Processing Systems (NeurIPS), 2023
Jinghan Jia
Jiancheng Liu
Parikshit Ram
Yuguang Yao
Gaowen Liu
Yang Liu
Pranay Sharma
Sijia Liu
MU
1.0K
229
0
11 Apr 2023
Exploring the Performance of Pruning Methods in Neural Networks: An Empirical Study of the Lottery Ticket Hypothesis
Eirik Fladmark
Muhammad Hamza Sajjad
Laura Brinkholm Justesen
222
3
0
26 Mar 2023
Vision Models Can Be Efficiently Specialized via Few-Shot Task-Aware Compression
Denis Kuznedelev
Soroush Tabesh
Kimia Noorbakhsh
Elias Frantar
Sara Beery
Eldar Kurtic
Dan Alistarh
MQ
VLM
238
4
0
25 Mar 2023
Considering Layerwise Importance in the Lottery Ticket Hypothesis
Benjamin Vandersmissen
José Oramas
245
1
0
22 Feb 2023
SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks
International Conference on Machine Learning (ICML), 2023
Mahdi Nikdan
Tommaso Pegolotti
Eugenia Iofinova
Eldar Kurtic
Dan Alistarh
244
14
0
09 Feb 2023
Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook for Sparse Neural Network Researchers
Shiwei Liu
Zinan Lin
508
37
0
06 Feb 2023
Unifying Synergies between Self-supervised Learning and Dynamic Computation
British Machine Vision Conference (BMVC), 2023
Tarun Krishna
Ayush K. Rai
Alexandru Drimbarean
Eric Arazo
Paul Albert
Alan F. Smeaton
Kevin McGuinness
Noel E. O'Connor
493
0
0
22 Jan 2023
Reproducible scaling laws for contrastive language-image learning
Computer Vision and Pattern Recognition (CVPR), 2022
Mehdi Cherti
Romain Beaumont
Ross Wightman
Mitchell Wortsman
Gabriel Ilharco
Cade Gordon
Christoph Schuhmann
Ludwig Schmidt
J. Jitsev
VLM
CLIP
672
1,298
0
14 Dec 2022
Is Smaller Always Faster? Tradeoffs in Compressing Self-Supervised Speech Transformers
Tzu-Quan Lin
Tsung-Huan Yang
Chun-Yao Chang
Kuang-Ming Chen
Tzu-hsun Feng
Hung-yi Lee
Hao Tang
334
6
0
17 Nov 2022
LOFT: Finding Lottery Tickets through Filter-wise Training
International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Qihan Wang
Chen Dun
Fangshuo Liao
C. Jermaine
Anastasios Kyrillidis
202
4
0
28 Oct 2022
XPrompt: Exploring the Extreme of Prompt Tuning
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Fang Ma
Chen Zhang
Lei Ren
Jingang Wang
Qifan Wang
Wei Wu
Xiaojun Quan
Dawei Song
VLM
343
52
0
10 Oct 2022
Advancing Model Pruning via Bi-level Optimization
Neural Information Processing Systems (NeurIPS), 2022
Yihua Zhang
Yuguang Yao
Parikshit Ram
Pu Zhao
Tianlong Chen
Min-Fong Hong
Yanzhi Wang
Sijia Liu
484
89
0
08 Oct 2022
One-shot Network Pruning at Initialization with Discriminative Image Patches
British Machine Vision Conference (BMVC), 2022
Yinan Yang
Yu Wang
Yi Ji
Heng Qi
Jien Kato
VLM
323
5
0
13 Sep 2022
Group Activity Recognition in Basketball Tracking Data -- Neural Embeddings in Team Sports (NETS)
European Conference on Artificial Intelligence (ECAI), 2022
Sandro Hauri
Slobodan Vučetić
204
16
0
31 Aug 2022
CrAM: A Compression-Aware Minimizer
International Conference on Learning Representations (ICLR), 2022
Alexandra Peste
Adrian Vladu
Eldar Kurtic
Christoph H. Lampert
Dan Alistarh
344
11
0
28 Jul 2022
Training Your Sparse Neural Network Better with Any Mask
International Conference on Machine Learning (ICML), 2022
Ajay Jaiswal
Haoyu Ma
Tianlong Chen
Ying Ding
Zinan Lin
CVBM
377
39
0
26 Jun 2022
Data-Efficient Double-Win Lottery Tickets from Robust Pre-training
International Conference on Machine Learning (ICML), 2022
Tianlong Chen
Zhenyu Zhang
Sijia Liu
Yang Zhang
Shiyu Chang
Zinan Lin
AAML
172
8
0
09 Jun 2022
Understanding the Role of Nonlinearity in Training Dynamics of Contrastive Learning
International Conference on Learning Representations (ICLR), 2022
Yuandong Tian
MLT
301
19
0
02 Jun 2022
Diverse Lottery Tickets Boost Ensemble from a Single Pretrained Model
Sosuke Kobayashi
Shun Kiyono
Jun Suzuki
Kentaro Inui
MoMe
270
10
0
24 May 2022
Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Free
Computer Vision and Pattern Recognition (CVPR), 2022
Tianlong Chen
Zhenyu Zhang
Yihua Zhang
Shiyu Chang
Sijia Liu
Zinan Lin
AAML
330
29
0
24 May 2022
Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey
Artificial Intelligence Review (Artif Intell Rev), 2022
Paul Wimmer
Jens Mehnert
Alexandru Paul Condurache
DD
381
35
0
17 May 2022
1
2
Next
Page 1 of 2
