ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1705.07565
  4. Cited By
Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain
  Surgeon
v1v2 (latest)

Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeon

22 May 2017
Xin Luna Dong
Shangyu Chen
Sinno Jialin Pan
ArXiv (abs)PDFHTML

Papers citing "Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeon"

50 / 275 papers shown
Title
HEAPr: Hessian-based Efficient Atomic Expert Pruning in Output Space
HEAPr: Hessian-based Efficient Atomic Expert Pruning in Output Space
Ke Li
Zheng Yang
Zhongbin Zhou
Feng Xue
Zhonglin Jiang
Wenxiao Wang
MoE
0
0
0
26 Sep 2025
Sensitivity-Aware Post-Training Quantization for Deep Neural Networks
Sensitivity-Aware Post-Training Quantization for Deep Neural Networks
Zekang Zheng
Haokun Li
Yaofo Chen
Mingkui Tan
Qing Du
MQ
48
0
0
06 Sep 2025
Sparse-Reg: Improving Sample Complexity in Offline Reinforcement Learning using Sparsity
Sparse-Reg: Improving Sample Complexity in Offline Reinforcement Learning using Sparsity
Samin Yeasar Arnob
Scott Fujimoto
Doina Precup
OffRL
135
0
0
20 Jun 2025
$μ$-MoE: Test-Time Pruning as Micro-Grained Mixture-of-Experts
μμμ-MoE: Test-Time Pruning as Micro-Grained Mixture-of-Experts
T. Koike-Akino
Jing Liu
Ye Wang
MoE
86
0
0
24 May 2025
TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networks
TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networks
Mohammad Maheri
Hamed Haddadi
Alex Davidson
194
2
0
27 Apr 2025
CUT: Pruning Pre-Trained Multi-Task Models into Compact Models for Edge Devices
CUT: Pruning Pre-Trained Multi-Task Models into Compact Models for Edge Devices
Jingxuan Zhou
Weidong Bao
Ji Wang
Zhengyi Zhong
97
0
0
14 Apr 2025
The Effects of Grouped Structural Global Pruning of Vision Transformers on Domain Generalisation
The Effects of Grouped Structural Global Pruning of Vision Transformers on Domain Generalisation
Hamza Riaz
Alan F. Smeaton
ViT
112
0
0
05 Apr 2025
GPTAQ: Efficient Finetuning-Free Quantization for Asymmetric Calibration
GPTAQ: Efficient Finetuning-Free Quantization for Asymmetric Calibration
Yuhang Li
Ruokai Yin
Donghyun Lee
Shiting Xiao
Priyadarshini Panda
MQ
217
9
0
03 Apr 2025
STADE: Standard Deviation as a Pruning Metric
STADE: Standard Deviation as a Pruning Metric
Diego Coello de Portugal Mecke
Haya Alyoussef
Ilia Koloiarov
Ilia Koloiarov
Lars Schmidt-Thieme
Lars Schmidt-Thieme
150
0
0
28 Mar 2025
An Efficient Training Algorithm for Models with Block-wise Sparsity
An Efficient Training Algorithm for Models with Block-wise Sparsity
Ding Zhu
Zhiqun Zuo
Mohammad Mahdi Khalili
105
0
0
27 Mar 2025
Safe Vision-Language Models via Unsafe Weights Manipulation
Safe Vision-Language Models via Unsafe Weights Manipulation
Moreno DÍncà
E. Peruzzo
Xingqian Xu
Humphrey Shi
N. Sebe
Goran Frehse
MU
172
0
0
14 Mar 2025
Optimal Brain Apoptosis
Optimal Brain Apoptosis
Mingyuan Sun
Zheng Fang
Jiaxu Wang
Junjie Jiang
Delei Kong
Chenming Hu
Yuetong Fang
Renjing Xu
AAML
166
1
0
25 Feb 2025
Systematic Weight Evaluation for Pruning Large Language Models: Enhancing Performance and Sustainability
Systematic Weight Evaluation for Pruning Large Language Models: Enhancing Performance and Sustainability
Ashhadul Islam
S. Belhaouari
Amine Bermak
124
0
0
24 Feb 2025
PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation
PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation
Tao Fan
Guoqiang Ma
Yuanfeng Song
Lixin Fan
Kai Chen
Qiang Yang
122
2
0
21 Feb 2025
Compressing Model with Few Class-Imbalance Samples: An Out-of-Distribution Expedition
Compressing Model with Few Class-Imbalance Samples: An Out-of-Distribution Expedition
Tian-Shuang Wu
Shen-Huan Lyu
Ning Chen
Zhihao Qu
Baoliu Ye
OODD
182
0
0
09 Feb 2025
Training-Free Restoration of Pruned Neural Networks
Training-Free Restoration of Pruned Neural Networks
Keonho Lee
Minsoo Kim
Dong-Wan Choi
125
1
0
06 Feb 2025
Hardware-Aware DNN Compression for Homogeneous Edge Devices
Kunlong Zhang
Guiying Li
Ning Lu
Peng Yang
Shengcai Liu
177
1
0
28 Jan 2025
Pruning-based Data Selection and Network Fusion for Efficient Deep Learning
Humaira Kousar
Hasnain Irshad Bhatti
Jaekyun Moon
172
1
0
03 Jan 2025
Preserving Deep Representations In One-Shot Pruning: A Hessian-Free
  Second-Order Optimization Framework
Preserving Deep Representations In One-Shot Pruning: A Hessian-Free Second-Order Optimization Framework
Ryan Lucas
Rahul Mazumder
170
3
0
27 Nov 2024
Expanding Sparse Tuning for Low Memory Usage
Expanding Sparse Tuning for Low Memory Usage
Shufan Shen
Junshu Sun
Xiangyang Ji
Qingming Huang
Shuhui Wang
161
0
0
04 Nov 2024
DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization
DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization
Haowei Zhu
Dehua Tang
Ji Liu
Mingjie Lu
Jintu Zheng
...
Spandan Tiwari
Ashish Sirasao
Jun-Hai Yong
Bin Wang
E. Barsoum
DiffM
115
15
0
22 Oct 2024
Debiasing Mini-Batch Quadratics for Applications in Deep Learning
Debiasing Mini-Batch Quadratics for Applications in Deep Learning
Lukas Tatzel
Bálint Mucsányi
Osane Hackel
Philipp Hennig
187
1
0
18 Oct 2024
DISP-LLM: Dimension-Independent Structural Pruning for Large Language
  Models
DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models
Shangqian Gao
Chi-Heng Lin
Ting Hua
Tang Zheng
Yilin Shen
Hongxia Jin
Yen-Chang Hsu
106
12
0
15 Oct 2024
SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing
  Large Deep Models
SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Models
Yuqi Li
Yao Lu
Zhihong Zhu
Chuanguang Yang
Yihao Chen
Jianping Gou
100
19
0
14 Oct 2024
Differentiable Weightless Neural Networks
Differentiable Weightless Neural Networks
Alan T. L. Bacellar
Zachary Susskind
Mauricio Breternitz Jr.
E. John
L. John
P. Lima
F. M. G. França
287
9
0
14 Oct 2024
Non-transferable Pruning
Non-transferable Pruning
Ruyi Ding
Lili Su
A. A. Ding
Yunsi Fei
AAML
96
3
0
10 Oct 2024
Aggressive Post-Training Compression on Extremely Large Language Models
Aggressive Post-Training Compression on Extremely Large Language Models
Zining Zhang
Yao Chen
Bingsheng He
Zhenjie Zhang
54
0
0
30 Sep 2024
Value-Based Deep Multi-Agent Reinforcement Learning with Dynamic Sparse
  Training
Value-Based Deep Multi-Agent Reinforcement Learning with Dynamic Sparse Training
Pihe Hu
Shaolong Li
Zhuoran Li
L. Pan
Longbo Huang
78
0
0
28 Sep 2024
The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by
  Leveraging Second-Order Information
The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information
Diyuan Wu
Ionut-Vlad Modoranu
M. Safaryan
Denis Kuznedelev
Dan Alistarh
135
5
0
30 Aug 2024
Force-Guided Bridge Matching for Full-Atom Time-Coarsened Dynamics of
  Peptides
Force-Guided Bridge Matching for Full-Atom Time-Coarsened Dynamics of Peptides
Ziyang Yu
Wenbing Huang
Yang Liu
OODAI4CE
220
2
0
27 Aug 2024
Learning effective pruning at initialization from iterative pruning
Learning effective pruning at initialization from iterative pruning
Shengkai Liu
Yaofeng Cheng
Fusheng Zha
Wei Guo
Lining Sun
Zhenshan Bing
Chenguang Yang
99
1
0
27 Aug 2024
MoDeGPT: Modular Decomposition for Large Language Model Compression
MoDeGPT: Modular Decomposition for Large Language Model Compression
Chi-Heng Lin
Shangqian Gao
James Seale Smith
Abhishek Patel
Shikhar Tuli
Yilin Shen
Hongxia Jin
Yen-Chang Hsu
294
21
0
19 Aug 2024
An Effective Information Theoretic Framework for Channel Pruning
An Effective Information Theoretic Framework for Channel Pruning
Yihao Chen
Zefang Wang
121
5
0
14 Aug 2024
Greedy Output Approximation: Towards Efficient Structured Pruning for
  LLMs Without Retraining
Greedy Output Approximation: Towards Efficient Structured Pruning for LLMs Without Retraining
Jianwei Li
Yijun Dong
Qi Lei
151
8
0
26 Jul 2024
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey
Guanqiao Qu
Qiyuan Chen
Wei Wei
Zheng Lin
Xianhao Chen
Kaibin Huang
287
99
0
09 Jul 2024
AMD: Automatic Multi-step Distillation of Large-scale Vision Models
AMD: Automatic Multi-step Distillation of Large-scale Vision Models
Cheng Han
Qifan Wang
S. Dianat
Majid Rabbani
Raghuveer M. Rao
Yi Fang
Qiang Guan
Lifu Huang
Dongfang Liu
VLM
122
8
0
05 Jul 2024
ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
Xiang Meng
Kayhan Behdin
Haoyue Wang
Rahul Mazumder
112
10
0
12 Jun 2024
ONNXPruner: ONNX-Based General Model Pruning Adapter
ONNXPruner: ONNX-Based General Model Pruning Adapter
Dongdong Ren
Wenbin Li
Tianyu Ding
Lei Wang
Qi Fan
Jing Huo
Hongbing Pan
Yang Gao
130
3
0
10 Apr 2024
MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning
MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning
Matteo Farina
Goran Frehse
Elia Cunegatti
Gaowen Liu
Giovanni Iacca
Elisa Ricci
VLM
127
6
0
08 Apr 2024
Lightweight Deep Learning for Resource-Constrained Environments: A
  Survey
Lightweight Deep Learning for Resource-Constrained Environments: A Survey
Hou-I Liu
Marco Galindo
Hongxia Xie
Lai-Kuan Wong
Hong-Han Shuai
Yung-Hui Li
Wen-Huang Cheng
178
104
0
08 Apr 2024
DRIVE: Dual Gradient-Based Rapid Iterative Pruning
DRIVE: Dual Gradient-Based Rapid Iterative Pruning
Dhananjay Saikumar
Blesson Varghese
100
3
0
01 Apr 2024
Addressing Loss of Plasticity and Catastrophic Forgetting in Continual
  Learning
Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning
Mohamed Elsayed
A. Rupam Mahmood
CLL
146
32
0
31 Mar 2024
Computation and Communication Efficient Lightweighting Vertical Federated Learning for Smart Building IoT
Computation and Communication Efficient Lightweighting Vertical Federated Learning for Smart Building IoT
Heqiang Wang
Jieming Bian
Lei Wang
Jia Zhou
Weihong Yang
Xiaoxiong Zhong
FedML
108
0
0
30 Mar 2024
Dense Vision Transformer Compression with Few Samples
Dense Vision Transformer Compression with Few Samples
Hanxiao Zhang
Yifan Zhou
Guo-Hua Wang
Jianxin Wu
ViTVLM
116
7
0
27 Mar 2024
FALCON: FLOP-Aware Combinatorial Optimization for Neural Network Pruning
FALCON: FLOP-Aware Combinatorial Optimization for Neural Network Pruning
Xiang Meng
Wenyu Chen
Riade Benbaki
Rahul Mazumder
100
7
0
11 Mar 2024
Structurally Prune Anything: Any Architecture, Any Framework, Any Time
Structurally Prune Anything: Any Architecture, Any Framework, Any Time
Xun Wang
John Rachwan
Stephan Günnemann
Bertrand Charpentier
95
6
0
03 Mar 2024
OSSCAR: One-Shot Structured Pruning in Vision and Language Models with
  Combinatorial Optimization
OSSCAR: One-Shot Structured Pruning in Vision and Language Models with Combinatorial Optimization
Xiang Meng
Shibal Ibrahim
Kayhan Behdin
Hussein Hazimeh
Natalia Ponomareva
Rahul Mazumder
VLM
134
9
0
02 Mar 2024
Less is KEN: a Universal and Simple Non-Parametric Pruning Algorithm for
  Large Language Models
Less is KEN: a Universal and Simple Non-Parametric Pruning Algorithm for Large Language Models
Michele Mastromattei
Fabio Massimo Zanzotto
VLM
135
3
0
05 Feb 2024
OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning
OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning
Chu Myaet Thwal
Minh N. H. Nguyen
Ye Lin Tun
Seongjin Kim
My T. Thai
Choong Seon Hong
173
8
0
22 Jan 2024
Always-Sparse Training by Growing Connections with Guided Stochastic Exploration
Always-Sparse Training by Growing Connections with Guided Stochastic Exploration
Mike Heddes
Narayan Srinivasa
T. Givargis
Alexandru Nicolau
351
1
0
12 Jan 2024
123456
Next