Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2003.02389
Cited By
Comparing Rewinding and Fine-tuning in Neural Network Pruning
International Conference on Learning Representations (ICLR), 2020
5 March 2020
Alex Renda
Jonathan Frankle
Michael Carbin
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Comparing Rewinding and Fine-tuning in Neural Network Pruning"
50 / 238 papers shown
CAMP-HiVe: Cyclic Pair Merging based Efficient DNN Pruning with Hessian-Vector Approximation for Resource-Constrained Systems
M. H. Uddin
Sai Krishna Ghanta
Liam Seymour
S. Baidya
246
0
0
09 Nov 2025
TwIST: Rigging the Lottery in Transformers with Independent Subnetwork Training
Michael Menezes
Barbara Su
Xinze Feng
Yehya Farhat
Hamza Shili
Anastasios Kyrillidis
225
1
0
06 Nov 2025
Effective Model Pruning: Measure The Redundancy of Model Components
Yixuan Wang
Dan Guralnik
Saiedeh Akbari
Warren E. Dixon
102
0
0
30 Sep 2025
CAST: Continuous and Differentiable Semi-Structured Sparsity-Aware Training for Large Language Models
Weiyu Huang
Yuezhou Hu
Jun Zhu
Jianfei Chen
CLL
142
0
0
30 Sep 2025
One Shot vs. Iterative: Rethinking Pruning Strategies for Model Compression
Mikołaj Janusz
Tomasz Wojnar
Yawei Li
Luca Benini
Kamil Adamczewski
VLM
172
3
0
19 Aug 2025
Z-Pruner: Post-Training Pruning of Large Language Models for Efficiency without Retraining
Samiul Basir Bhuiyan
Md. Sazzad Hossain Adib
Mohammed Aman Bhuiyan
Muhammad Rafsan Kabir
Moshiur Farazi
Shafin Rahman
Nabeel Mohammed
278
1
0
18 Aug 2025
AI and the Net-Zero Journey: Energy Demand, Emissions, and the Potential for Transition
Pandu Devarakota
Nicolas Tsesmetzis
Faruk O. Alpak
Apurva Gala
Detlef Hohl
155
1
0
14 Jul 2025
Hyperbolic Aware Minimization: Implicit Bias for Sparsity
Tom Jacobs
Advait Gadhikar
Celia Rubio-Madrigal
R. Burkholz
305
1
0
03 Jun 2025
Are Spatial-Temporal Graph Convolution Networks for Human Action Recognition Over-Parameterized?
Computer Vision and Pattern Recognition (CVPR), 2025
Jianyang Xie
Yitian Zhao
Y. Meng
He Zhao
Anh Nguyen
Yalin Zheng
279
3
0
15 May 2025
Sparse Training from Random Initialization: Aligning Lottery Ticket Masks using Weight Symmetry
Mohammed Adnan
Rohan Jain
Ekansh Sharma
Rahul Krishnan
Yani Andrew Ioannou
382
1
0
08 May 2025
Sign-In to the Lottery: Reparameterizing Sparse Training From Scratch
Advait Gadhikar
Tom Jacobs
Chao Zhou
R. Burkholz
490
2
0
17 Apr 2025
As easy as PIE: understanding when pruning causes language models to disagree
North American Chapter of the Association for Computational Linguistics (NAACL), 2025
Pietro Tropeano
Maria Maistro
Tuukka Ruotsalo
Christina Lioma
296
0
0
27 Mar 2025
SSVQ: Unleashing the Potential of Vector Quantization with Sign-Splitting
Shuaiting Li
Juncan Deng
Chenxuan Wang
Kedong Xu
Rongtao Deng
Hong Gu
Haibin Shen
Kejie Huang
MQ
400
1
0
11 Mar 2025
Federated Multimodal Learning with Dual Adapters and Selective Pruning for Communication and Computational Efficiency
IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2025
Duy Phuong Nguyen
J. P. Muñoz
Tanya Roosta
Ali Jannesari
FedML
402
2
0
10 Mar 2025
Personalized Federated Learning for Egocentric Video Gaze Estimation with Comprehensive Parameter Frezzing
Yuhu Feng
Keisuke Maeda
Takahiro Ogawa
Miki Haseyama
FedML
EgoV
276
0
0
25 Feb 2025
Signal Collapse in One-Shot Pruning: When Sparse Models Fail to Distinguish Neural Representations
Dhananjay Saikumar
Blesson Varghese
235
2
0
18 Feb 2025
Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity
Alessandro Pierro
Steven Abreu
Jonathan Timcheck
Philipp Stratmann
Andreas Wild
S. Shrestha
402
6
0
03 Feb 2025
Pruning-based Data Selection and Network Fusion for Efficient Deep Learning
Humaira Kousar
Hasnain Irshad Bhatti
Jaekyun Moon
428
1
0
03 Jan 2025
PTSBench: A Comprehensive Post-Training Sparsity Benchmark Towards Algorithms and Models
ACM Multimedia (MM), 2024
Zining Wnag
Jinpei Guo
Yazhe Niu
Yang Yong
Aishan Liu
Yushi Huang
Jiaheng Liu
Xianglong Liu
317
8
0
10 Dec 2024
Is Oracle Pruning the True Oracle?
Sicheng Feng
Keda Tao
Haoyu Wang
VLM
384
5
0
28 Nov 2024
Preserving Deep Representations In One-Shot Pruning: A Hessian-Free Second-Order Optimization Framework
International Conference on Learning Representations (ICLR), 2024
Ryan Lucas
Rahul Mazumder
364
8
0
27 Nov 2024
Chasing Better Deep Image Priors between Over- and Under-parameterization
Qiming Wu
Xiaohan Chen
Lezhi Li
Zhangyang Wang
389
1
0
31 Oct 2024
Superficial Safety Alignment Hypothesis
Jianwei Li
Jung-Eun Kim
LLMSV
416
8
0
07 Oct 2024
Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption Robustness
International Conference on Learning Representations (ICLR), 2024
Boqian Wu
Q. Xiao
Shunxin Wang
N. Strisciuglio
Mykola Pechenizkiy
M. V. Keulen
Decebal Constantin Mocanu
Elena Mocanu
OOD
3DH
542
7
0
03 Oct 2024
Are Sparse Neural Networks Better Hard Sample Learners?
British Machine Vision Conference (BMVC), 2024
Q. Xiao
Boqian Wu
Lu Yin
Christopher Neil Gadzinski
Tianjin Huang
Mykola Pechenizkiy
Decebal Constantin Mocanu
269
2
0
13 Sep 2024
Mask in the Mirror: Implicit Sparsification
International Conference on Learning Representations (ICLR), 2024
Tom Jacobs
R. Burkholz
638
8
0
19 Aug 2024
Compress and Compare: Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experiments
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2024
Angie Boggust
Venkatesh Sivaraman
Yannick Assogba
Donghao Ren
Dominik Moritz
Fred Hohman
VLM
280
10
0
06 Aug 2024
Pruning Large Language Models with Semi-Structural Adaptive Sparse Training
Weiyu Huang
Yuezhou Hu
Guohao Jian
Jun Zhu
Jianfei Chen
377
24
0
30 Jul 2024
Optimal Eye Surgeon: Finding Image Priors through Sparse Generators at Initialization
International Conference on Machine Learning (ICML), 2024
Avrajit Ghosh
Xitong Zhang
Kenneth K. Sun
Qing Qu
S. Ravishankar
Rongrong Wang
MedIm
311
6
0
07 Jun 2024
VTrans: Accelerating Transformer Compression with Variational Information Bottleneck based Pruning
Oshin Dutta
Ritvik Gupta
Sumeet Agarwal
376
4
0
07 Jun 2024
Federated LoRA with Sparse Communication
Kevin Kuo
Arian Raje
Kousik Rajesh
Virginia Smith
559
25
0
07 Jun 2024
Cyclic Sparse Training: Is it Enough?
Advait Gadhikar
Sree Harsha Nelaturu
R. Burkholz
CLL
496
1
0
04 Jun 2024
Optimization Techniques for Sentiment Analysis Based on LLM (GPT-3)
Applied and Computational Engineering (ACE), 2024
Tong Zhan
Chenxi Shi
Yadong Shi
Huixiang Li
Yiyu Lin
182
28
0
16 May 2024
SSFL: Discovering Sparse Unified Subnetworks at Initialization for Efficient Federated Learning
Riyasat Ohib
Bishal Thapaliya
Gintare Karolina Dziugaite
Jingyu Liu
Vince D. Calhoun
Sergey Plis
FedML
290
1
0
15 May 2024
Iterative Filter Pruning for Concatenation-based CNN Architectures
IEEE International Joint Conference on Neural Network (IJCNN), 2024
Svetlana Pavlitska
Oliver Bagge
Federico Nicolás Peccia
Toghrul Mammadov
J. Marius Zöllner
VLM
3DPC
260
8
0
04 May 2024
Transferable and Principled Efficiency for Open-Vocabulary Segmentation
Jingxuan Xu
Wuyang Chen
Yao-Min Zhao
Yunchao Wei
VLM
347
2
0
11 Apr 2024
Simultaneous linear connectivity of neural networks modulo permutation
Ekansh Sharma
Devin Kwok
Tom Denton
Daniel M. Roy
David Rolnick
Gintare Karolina Dziugaite
497
9
0
09 Apr 2024
MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning
Matteo Farina
Goran Frehse
Elia Cunegatti
Gaowen Liu
Giovanni Iacca
Elisa Ricci
VLM
318
8
0
08 Apr 2024
What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data Pretrained Language Models
Busayo Awobade
Mardiyyah Oduwole
Steven Kolawole
237
1
0
06 Apr 2024
DRIVE: Dual Gradient-Based Rapid Iterative Pruning
Dhananjay Saikumar
Blesson Varghese
273
4
0
01 Apr 2024
Effectively Prompting Small-sized Language Models for Cross-lingual Tasks via Winning Tickets
Mingqi Li
Feng Luo
LRM
209
0
0
01 Apr 2024
Insights into the Lottery Ticket Hypothesis and Iterative Magnitude Pruning
Tausifa Jan Saleem
Ramanjit Ahuja
Surendra Prasad
Brejesh Lall
389
0
0
22 Mar 2024
A Survey of Lottery Ticket Hypothesis
Bohan Liu
Zijie Zhang
Peixiong He
Zhensen Wang
Yang Xiao
Ruimeng Ye
Yang Zhou
Wei-Shinn Ku
Bo Hui
UQCV
408
25
0
07 Mar 2024
Masks, Signs, And Learning Rate Rewinding
Advait Gadhikar
R. Burkholz
280
15
0
29 Feb 2024
Unveiling Linguistic Regions in Large Language Models
Zhihao Zhang
Jun Zhao
Tao Gui
Tao Gui
Xuanjing Huang
403
21
0
22 Feb 2024
Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers
Abhimanyu Bambhaniya
Amir Yazdanbakhsh
Suvinay Subramanian
Sheng-Chun Kao
Shivani Agrawal
Utku Evci
Tushar Krishna
367
25
0
07 Feb 2024
A Survey on Transformer Compression
Yehui Tang
Yunhe Wang
Jianyuan Guo
Zhijun Tu
Kai Han
Hailin Hu
Dacheng Tao
577
74
0
05 Feb 2024
Ultrafast jet classification on FPGAs for the HL-LHC
Patrick Odagiu
Zhiqiang Que
Javier Mauricio Duarte
J. Haller
Gregor Kasieczka
...
Arpita Seksaria
S. Summers
A. Sznajder
A. Tapper
Thea Klæboe Årrestad
335
16
0
02 Feb 2024
EPSD: Early Pruning with Self-Distillation for Efficient Model Compression
Dong Chen
Ning Liu
Yichen Zhu
Zhengping Che
Rui Ma
Fachao Zhang
Xiaofeng Mou
Yi Chang
Jian Tang
276
9
0
31 Jan 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks
Tim Whitaker
Darrell Whitley
386
1
0
16 Jan 2024
1
2
3
4
5
Next
Page 1 of 5
