ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2002.04809
  4. Cited By
Lookahead: A Far-Sighted Alternative of Magnitude-based Pruning

Lookahead: A Far-Sighted Alternative of Magnitude-based Pruning

International Conference on Learning Representations (ICLR), 2020
12 February 2020
Sejun Park
Jaeho Lee
Sangwoo Mo
Jinwoo Shin
ArXiv (abs)PDFHTMLGithub (33★)

Papers citing "Lookahead: A Far-Sighted Alternative of Magnitude-based Pruning"

50 / 57 papers shown
EfficientXpert: Efficient Domain Adaptation for Large Language Models via Propagation-Aware Pruning
EfficientXpert: Efficient Domain Adaptation for Large Language Models via Propagation-Aware Pruning
Songlin Zhao
Michael Pitts
Zhuwei Qin
121
0
0
25 Nov 2025
Pruning and Quantization Impact on Graph Neural Networks
Pruning and Quantization Impact on Graph Neural Networks
Khatoon Khedri
Reza Rawassizadeh
Qifu Wen
M. Hosseinzadeh
GNN
257
0
0
24 Oct 2025
Investigating Structural Pruning and Recovery Techniques for Compressing Multimodal Large Language Models: An Empirical Study
Investigating Structural Pruning and Recovery Techniques for Compressing Multimodal Large Language Models: An Empirical Study
Yiran Huang
Lukas Thede
Goran Frehse
Wenjia Xu
Zeynep Akata
235
0
0
28 Jul 2025
Sparsified State-Space Models are Efficient Highway Networks
Sparsified State-Space Models are Efficient Highway Networks
Woomin Song
Jihoon Tack
Sangwoo Mo
Seunghyuk Oh
Jinwoo Shin
Mamba
396
0
0
27 May 2025
Efficient Privacy-Preserving Cross-Silo Federated Learning with Multi-Key Homomorphic Encryption
Efficient Privacy-Preserving Cross-Silo Federated Learning with Multi-Key Homomorphic Encryption
Abdullah Al Omar
Xin Yang
Euijin Choo
Omid Ardakanian
210
0
0
20 May 2025
CUT: Pruning Pre-Trained Multi-Task Models into Compact Models for Edge Devices
CUT: Pruning Pre-Trained Multi-Task Models into Compact Models for Edge DevicesInternational Conference on Intelligent Computing (ICIC), 2025
Jingxuan Zhou
Weidong Bao
Ji Wang
Zhengyi Zhong
249
0
0
14 Apr 2025
Pruning-based Data Selection and Network Fusion for Efficient Deep Learning
Humaira Kousar
Hasnain Irshad Bhatti
Jaekyun Moon
381
1
0
03 Jan 2025
AutoSculpt: A Pattern-based Model Auto-pruning Framework Using Reinforcement Learning and Graph Learning
AutoSculpt: A Pattern-based Model Auto-pruning Framework Using Reinforcement Learning and Graph Learning
Lixian Jing
Haobing Liu
Junyu Dong
Yanwei Yu
3DPCAI4CE
330
1
0
24 Dec 2024
DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization
DiP-GO: A Diffusion Pruner via Few-step Gradient OptimizationNeural Information Processing Systems (NeurIPS), 2024
Haowei Zhu
Dehua Tang
Ji Liu
Mingjie Lu
Jintu Zheng
...
Spandan Tiwari
Ashish Sirasao
Jun-Hai Yong
Bin Wang
E. Barsoum
DiffM
206
35
0
22 Oct 2024
AMD: Automatic Multi-step Distillation of Large-scale Vision Models
AMD: Automatic Multi-step Distillation of Large-scale Vision Models
Cheng Han
Qifan Wang
S. Dianat
Majid Rabbani
Raghuveer M. Rao
Yi Fang
Qiang Guan
Lifu Huang
Dongfang Liu
VLM
236
16
0
05 Jul 2024
A Comprehensive Study of Structural Pruning for Vision Models
A Comprehensive Study of Structural Pruning for Vision Models
Haoling Li
Haoling Li
Mengqi Xue
Gongfan Fang
Sheng Zhou
Zunlei Feng
Huiqiong Wang
Mingli Song
Lechao Cheng
VLM
603
0
0
18 Jun 2024
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of
  Deep Neural Networks
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural NetworksIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2024
Xue Geng
Zhe Wang
Chunyun Chen
Qing Xu
Kaixin Xu
...
Zhenghua Chen
M. Aly
Jie Lin
Ruibing Jin
Xiaoli Li
340
8
0
09 May 2024
Torch2Chip: An End-to-end Customizable Deep Neural Network Compression
  and Deployment Toolkit for Prototype Hardware Accelerator Design
Torch2Chip: An End-to-end Customizable Deep Neural Network Compression and Deployment Toolkit for Prototype Hardware Accelerator DesignConference on Machine Learning and Systems (MLSys), 2024
Jian Meng
Yuan Liao
Anupreetham Anupreetham
Ahmed Hassan
Shixing Yu
Han-Sok Suh
Xiaofeng Hu
Jae-sun Seo
MQ
243
3
0
02 May 2024
Data-independent Module-aware Pruning for Hierarchical Vision
  Transformers
Data-independent Module-aware Pruning for Hierarchical Vision Transformers
Yang He
Qiufeng Wang
ViT
272
10
0
21 Apr 2024
ONNXPruner: ONNX-Based General Model Pruning Adapter
ONNXPruner: ONNX-Based General Model Pruning AdapterIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
Dongdong Ren
Wenbin Li
Tianyu Ding
Lei Wang
Qi Fan
Jing Huo
Hongbing Pan
Yang Gao
352
5
0
10 Apr 2024
Addressing Loss of Plasticity and Catastrophic Forgetting in Continual
  Learning
Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning
Mohamed Elsayed
A. Rupam Mahmood
CLL
374
43
0
31 Mar 2024
Towards Explaining Deep Neural Network Compression Through a Probabilistic Latent Space
Towards Explaining Deep Neural Network Compression Through a Probabilistic Latent Space
Mahsa Mozafari-Nia
Salimeh Yasaei Sekeh
411
0
0
29 Feb 2024
SlimSAM: 0.1% Data Makes Segment Anything Slim
SlimSAM: 0.1% Data Makes Segment Anything SlimNeural Information Processing Systems (NeurIPS), 2023
Zigeng Chen
Gongfan Fang
Xinyin Ma
Xinchao Wang
389
29
0
08 Dec 2023
F3-Pruning: A Training-Free and Generalized Pruning Strategy towards
  Faster and Finer Text-to-Video Synthesis
F3-Pruning: A Training-Free and Generalized Pruning Strategy towards Faster and Finer Text-to-Video Synthesis
Jingkuan Song
Jianzhi Liu
Lianli Gao
Jingkuan Song
DiffMVGen
228
11
0
06 Dec 2023
Archtree: on-the-fly tree-structured exploration for latency-aware
  pruning of deep neural networks
Archtree: on-the-fly tree-structured exploration for latency-aware pruning of deep neural networks
Rémi Ouazan Reboul
Edouard Yvinec
Arnaud Dapogny
Kévin Bailly
296
0
0
17 Nov 2023
PriPrune: Quantifying and Preserving Privacy in Pruned Federated
  Learning
PriPrune: Quantifying and Preserving Privacy in Pruned Federated LearningACM Transactions on Modeling and Performance Evaluation of Computing Systems (TOMPECS), 2023
Tianyue Chu
Mengwei Yang
Nikolaos Laoutaris
A. Markopoulou
309
10
0
30 Oct 2023
eDKM: An Efficient and Accurate Train-time Weight Clustering for Large
  Language Models
eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language ModelsIEEE computer architecture letters (CAL), 2023
Minsik Cho
Keivan Alizadeh Vahid
Qichen Fu
Saurabh N. Adya
C. C. D. Mundo
Mohammad Rastegari
Devang Naik
Peter Zatloukal
MQ
295
9
0
02 Sep 2023
Resource Efficient Neural Networks Using Hessian Based Pruning
Resource Efficient Neural Networks Using Hessian Based Pruning
J. Chong
Manas Gupta
Lihui Chen
245
6
0
12 Jun 2023
Neural Sculpting: Uncovering hierarchically modular task structure in
  neural networks through pruning and network analysis
Neural Sculpting: Uncovering hierarchically modular task structure in neural networks through pruning and network analysisNeural Information Processing Systems (NeurIPS), 2023
S. M. Patil
Loizos Michael
C. Dovrolis
272
0
0
28 May 2023
Sparse Weight Averaging with Multiple Particles for Iterative Magnitude
  Pruning
Sparse Weight Averaging with Multiple Particles for Iterative Magnitude PruningInternational Conference on Learning Representations (ICLR), 2023
Moonseok Choi
Hyungi Lee
G. Nam
Juho Lee
309
4
0
24 May 2023
Layer-adaptive Structured Pruning Guided by Latency
Layer-adaptive Structured Pruning Guided by Latency
Siyuan Pan
Linna Zhang
Jie Zhang
Xiaoshuang Li
Liang Hou
Xiaobing Tu
264
3
0
23 May 2023
Structural Pruning for Diffusion Models
Structural Pruning for Diffusion ModelsNeural Information Processing Systems (NeurIPS), 2023
Gongfan Fang
Xinyin Ma
Xinchao Wang
469
210
0
18 May 2023
Bespoke: A Block-Level Neural Network Optimization Framework for
  Low-Cost Deployment
Bespoke: A Block-Level Neural Network Optimization Framework for Low-Cost DeploymentAAAI Conference on Artificial Intelligence (AAAI), 2023
Jong-Ryul Lee
Yong-Hyuk Moon
233
0
0
03 Mar 2023
Utility-based Perturbed Gradient Descent: An Optimizer for Continual
  Learning
Utility-based Perturbed Gradient Descent: An Optimizer for Continual Learning
Mohamed Elsayed
A. R. Mahmood
CLL
306
8
0
07 Feb 2023
DepGraph: Towards Any Structural Pruning
DepGraph: Towards Any Structural PruningComputer Vision and Pattern Recognition (CVPR), 2023
Gongfan Fang
Xinyin Ma
Weilong Dai
Michael Bi Mi
Xinchao Wang
GNN
460
461
0
30 Jan 2023
AP: Selective Activation for De-sparsifying Pruned Neural Networks
AP: Selective Activation for De-sparsifying Pruned Neural Networks
Shiyu Liu
Rohan Ghosh
Dylan Tan
Mehul Motani
AAML
212
0
0
09 Dec 2022
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural
  Networks
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks
Shiyu Liu
Rohan Ghosh
John Tan Chong Min
Mehul Motani
271
1
0
09 Dec 2022
Is Complexity Required for Neural Network Pruning? A Case Study on
  Global Magnitude Pruning
Is Complexity Required for Neural Network Pruning? A Case Study on Global Magnitude PruningConference on Algebraic Informatics (CAI), 2022
Manas Gupta
Efe Camci
Vishandi Rudy Keneta
Abhishek Vaidyanathan
Ritwik Kanodia
Chuan-Sheng Foo
Wu Min
Lin Jie
355
25
0
29 Sep 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning
  Models: A Survey
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey
Dalin Zhang
Kaixuan Chen
Yan Zhao
B. Yang
Li-Ping Yao
Christian S. Jensen
363
7
0
22 Aug 2022
SInGE: Sparsity via Integrated Gradients Estimation of Neuron Relevance
SInGE: Sparsity via Integrated Gradients Estimation of Neuron RelevanceNeural Information Processing Systems (NeurIPS), 2022
Edouard Yvinec
Arnaud Dapogny
Matthieu Cord
Kévin Bailly
236
11
0
08 Jul 2022
ViNNPruner: Visual Interactive Pruning for Deep Learning
ViNNPruner: Visual Interactive Pruning for Deep Learning
U. Schlegel
Samuel Schiegg
Daniel A. Keim
VLM
137
2
0
31 May 2022
Perturbation of Deep Autoencoder Weights for Model Compression and
  Classification of Tabular Data
Perturbation of Deep Autoencoder Weights for Model Compression and Classification of Tabular DataNeural Networks (NN), 2022
Manar D. Samad
Sakib Abrar
153
13
0
17 May 2022
Aligned Weight Regularizers for Pruning Pretrained Neural Networks
Aligned Weight Regularizers for Pruning Pretrained Neural NetworksFindings (Findings), 2022
J. Ó. Neill
Sourav Dutta
H. Assem
VLM
245
3
0
04 Apr 2022
MKQ-BERT: Quantized BERT with 4-bits Weights and Activations
MKQ-BERT: Quantized BERT with 4-bits Weights and Activations
Hanlin Tang
Xipeng Zhang
Kai Liu
Jianchen Zhu
Zhanhui Kang
VLMMQ
170
17
0
25 Mar 2022
Applications and Techniques for Fast Machine Learning in Science
Applications and Techniques for Fast Machine Learning in ScienceFrontiers in Big Data (Front. Big Data), 2021
A. Deiana
Nhan Tran
Joshua C. Agar
Michaela Blott
G. D. Guglielmo
...
Ashish Sharma
S. Summers
Pietro Vischia
J. Vlimant
Olivia Weng
279
84
0
25 Oct 2021
Deep Neural Compression Via Concurrent Pruning and Self-Distillation
Deep Neural Compression Via Concurrent Pruning and Self-Distillation
J. Ó. Neill
Sourav Dutta
H. Assem
VLM
154
5
0
30 Sep 2021
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting
  and Output Merging
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging
Edouard Yvinec
Arnaud Dapogny
Matthieu Cord
Kévin Bailly
309
27
0
30 Sep 2021
GDP: Stabilized Neural Network Pruning via Gates with Differentiable
  Polarization
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization
Yi Guo
Huan Yuan
Jianchao Tan
Zinan Lin
Sen Yang
Ji Liu
329
52
0
06 Sep 2021
Pruning with Compensation: Efficient Channel Pruning for Deep
  Convolutional Neural Networks
Pruning with Compensation: Efficient Channel Pruning for Deep Convolutional Neural Networks
Zhouyang Xie
Yan Fu
Sheng-Zhao Tian
Junlin Zhou
Duanbing Chen
3DV
144
0
0
31 Aug 2021
DKM: Differentiable K-Means Clustering Layer for Neural Network
  Compression
DKM: Differentiable K-Means Clustering Layer for Neural Network CompressionInternational Conference on Learning Representations (ICLR), 2021
Minsik Cho
Keivan Alizadeh Vahid
Saurabh N. Adya
Mohammad Rastegari
353
37
0
28 Aug 2021
Learned Token Pruning for Transformers
Learned Token Pruning for Transformers
Sehoon Kim
Sheng Shen
D. Thorsley
A. Gholami
Woosuk Kwon
Joseph Hassoun
Kurt Keutzer
440
201
0
02 Jul 2021
Dep-$L_0$: Improving $L_0$-based Network Sparsification via Dependency
  Modeling
Dep-L0L_0L0​: Improving L0L_0L0​-based Network Sparsification via Dependency Modeling
Yang Li
Shihao Ji
129
1
0
30 Jun 2021
AdaptCL: Efficient Collaborative Learning with Dynamic and Adaptive
  Pruning
AdaptCL: Efficient Collaborative Learning with Dynamic and Adaptive Pruning
Guangmeng Zhou
Ke Xu
Qi Li
Yang Liu
Yi Zhao
172
10
0
27 Jun 2021
RED : Looking for Redundancies for Data-Free Structured Compression of
  Deep Neural Networks
RED : Looking for Redundancies for Data-Free Structured Compression of Deep Neural NetworksNeural Information Processing Systems (NeurIPS), 2021
Edouard Yvinec
Arnaud Dapogny
Matthieu Cord
Kévin Bailly
CVBM
172
31
0
31 May 2021
LEAP: Learnable Pruning for Transformer-based Models
LEAP: Learnable Pruning for Transformer-based Models
Z. Yao
Xiaoxia Wu
Linjian Ma
Sheng Shen
Kurt Keutzer
Michael W. Mahoney
Yuxiong He
276
8
0
30 May 2021
12
Next
Page 1 of 2