v1v2 (latest)

Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeon

22 May 2017

Papers citing "Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeon"

50 / 275 papers shown

Title
LOFT: Finding Lottery Tickets through Filter-wise Training Qihan Wang Chen Dun Fangshuo Liao C. Jermaine Anastasios Kyrillidis 90 3 0 28 Oct 2022
Pruning's Effect on Generalization Through the Lens of Training and Regularization Tian Jin Michael Carbin Daniel M. Roy Jonathan Frankle Gintare Karolina Dziugaite 140 31 0 25 Oct 2022
HesScale: Scalable Computation of Hessian Diagonals Mohamed Elsayed A. R. Mahmood 127 9 0 20 Oct 2022
Attaining Class-level Forgetting in Pretrained Model using Few Samples Pravendra Singh Pratik Mazumder M. A. Karim VLM CLL MU 67 2 0 19 Oct 2022
Post-Training Quantization for Energy Efficient Realization of Deep Neural Networks Cecilia Latotzke Batuhan Balim T. Gemmeke MQ 62 3 0 14 Oct 2022
CAP: Correlation-Aware Pruning for Highly-Accurate Sparse Vision Models Denis Kuznedelev Eldar Kurtic Elias Frantar Dan Alistarh VLM ViT 125 17 0 14 Oct 2022
Pruning Adversarially Robust Neural Networks without Adversarial Examples T. Jian Zifeng Wang Yanzhi Wang Jennifer Dy Stratis Ioannidis AAML VLM 98 14 0 09 Oct 2022
Why Random Pruning Is All We Need to Start Sparse Advait Gadhikar Sohom Mukherjee R. Burkholz 152 23 0 05 Oct 2022
Diving into Unified Data-Model Sparsity for Class-Imbalanced Graph Representation Learning Chunhui Zhang Chao Huang Yijun Tian Qianlong Wen Z. Ouyang Youhuan Li Yanfang Ye Chuxu Zhang 93 8 0 01 Oct 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions M. Tukan Loay Mualem Alaa Maalouf 3DPC 123 24 0 18 Sep 2022
CWP: Instance complexity weighted channel-wise soft masks for network pruning Jiapeng Wang Ming Ma Zhenhua Yu 125 0 0 08 Sep 2022
Efficient Methods for Natural Language Processing: A Survey Marcos Vinícius Treviso Ji-Ung Lee Tianchu Ji Betty van Aken Qingqing Cao ... Emma Strubell Niranjan Balasubramanian Leon Derczynski Iryna Gurevych Roy Schwartz 237 127 0 31 Aug 2022
Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning Elias Frantar Sidak Pal Singh Dan Alistarh MQ 238 283 0 24 Aug 2022
Restructurable Activation Networks Kartikeya Bhardwaj James Ward Caleb Tung Dibakar Gope Lingchuan Meng Igor Fedorov A. Chalfin P. Whatmough Danny Loh 138 5 0 17 Aug 2022
WeightMom: Learning Sparse Networks using Iterative Momentum-based pruning Elvis Johnson Xiao-Ming Tang Sriramacharyulu Samudrala 63 1 0 11 Aug 2022
Quiver neural networks I. Ganev Robin Walters 89 4 0 26 Jul 2022
Model Compression for Resource-Constrained Mobile Robots Timotheos Souroulla Alberto Hata Ahmad Terra Özer Özkahraman Rafia Inam 33 0 0 20 Jul 2022
Neural Network Compression via Effective Filter Analysis and Hierarchical Pruning Ziqi Zhou Li Lian Yilong Yin Ze Wang 61 1 0 07 Jun 2022
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm Aidan Good Jia-Huei Lin Hannah Sieg Mikey Ferguson Xin Yu Shandian Zhe J. Wieczorek Thiago Serra 178 11 0 07 Jun 2022
Dynamic Kernel Selection for Improved Generalization and Memory Efficiency in Meta-learning Arnav Chavan Rishabh Tiwari Udbhav Bamba D. K. Gupta 106 5 0 03 Jun 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks Y. Fu Haichuan Yang Jiayi Yuan Meng Li Cheng Wan Raghuraman Krishnamoorthi Vikas Chandra Yingyan Lin 223 22 0 02 Jun 2022
RLx2: Training a Sparse Deep Reinforcement Learning Model from Scratch Y. Tan Pihe Hu L. Pan Jiatai Huang Longbo Huang OffRL 129 31 0 30 May 2022
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Tri Dao Daniel Y. Fu Stefano Ermon Atri Rudra Christopher Ré VLM 636 2,758 0 27 May 2022
Converting Artificial Neural Networks to Spiking Neural Networks via Parameter Calibration Yuhang Li Shi-Wee Deng Xin Dong Shi Gu 103 25 0 06 May 2022
Convolutional and Residual Networks Provably Contain Lottery Tickets R. Burkholz UQCV MLT 121 14 0 04 May 2022
Most Activation Functions Can Win the Lottery Without Excessive Depth R. Burkholz MLT 182 19 0 04 May 2022
Boosting Pruned Networks with Linear Over-parameterization Yundi Qian Siyuan Pan Xiaoshuang Li Jie Zhang Liang Hou Xiaobing Tu 117 3 0 25 Apr 2022
Masking Adversarial Damage: Finding Adversarial Saliency for Robust and Sparse Network Byung-Kwan Lee Junho Kim Y. Ro AAML 80 23 0 06 Apr 2022
Aligned Weight Regularizers for Pruning Pretrained Neural Networks J. Ó. Neill Sourav Dutta H. Assem VLM 119 2 0 04 Apr 2022
Monarch: Expressive Structured Matrices for Efficient and Accurate Training Tri Dao Beidi Chen N. Sohoni Arjun D Desai Michael Poli Jessica Grogan Alexander Liu Aniruddh Rao Atri Rudra Christopher Ré 177 101 0 01 Apr 2022
Unified Visual Transformer Compression Shixing Yu Tianlong Chen Jiayi Shen Huan Yuan Jianchao Tan Sen Yang Ji Liu Zhangyang Wang ViT 126 104 0 15 Mar 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 181 54 0 09 Mar 2022
Practical Network Acceleration with Tiny Sets G. Wang Jianxin Wu 130 12 0 16 Feb 2022
Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters Mingbao Lin Liujuan Cao Yuxin Zhang Ling Shao Chia-Wen Lin Rongrong Ji 94 61 0 15 Feb 2022
SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation Cong Guo Yuxian Qiu Jingwen Leng Xiaotian Gao Chen Zhang Yunxin Liu Fan Yang Yuhao Zhu Minyi Guo MQ 164 80 0 14 Feb 2022
Nonlinear Initialization Methods for Low-Rank Neural Networks Kiran Vodrahalli Rakesh Shivanna M. Sathiamoorthy Sagar Jain Ed H. Chi 123 4 0 02 Feb 2022
Single-Shot Pruning for Offline Reinforcement Learning Samin Yeasar Arnob Riyasat Ohib Sergey Plis Doina Precup OffRL 95 25 0 31 Dec 2021
Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better Sameer Bibikar H. Vikalo Zhangyang Wang Xiaohan Chen FedML 125 115 0 18 Dec 2021
Batch Normalization Tells You Which Filter is Important Junghun Oh Heewon Kim Sungyong Baik Chee Hong Kyoung Mu Lee CVBM 129 8 0 02 Dec 2021
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models Tri Dao Beidi Chen Kaizhao Liang Jiaming Yang Zhao Song Atri Rudra Christopher Ré 237 83 0 30 Nov 2021
Plant ñ' Seek: Can You Find the Winning Ticket? Jonas Fischer R. Burkholz 106 21 0 22 Nov 2021
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI Jiangchao Yao Shengyu Zhang Yang Yao Feng Wang Jianxin Ma ... Kun Kuang Chao-Xiang Wu Leilei Gan Jingren Zhou Hongxia Yang 212 120 0 11 Nov 2021
MQBench: Towards Reproducible and Deployable Model Quantization Benchmark Yuhang Li Mingzhu Shen Jian Ma Yan Ren Mingxin Zhao Tao Gui Yazhe Niu F. Yu Junjie Yan MQ 114 61 0 05 Nov 2021
Learning Pruned Structure and Weights Simultaneously from Scratch: an Attention based Approach Qisheng He Weisong Shi Ming Dong 121 3 0 01 Nov 2021
You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownership Xuxi Chen Tianlong Chen Zhenyu Zhang Zhangyang Wang WIGM 94 25 0 30 Oct 2021
Applications and Techniques for Fast Machine Learning in Science A. Deiana Nhan Tran Joshua C. Agar Michaela Blott G. D. Guglielmo ... Ashish Sharma S. Summers Pietro Vischia J. Vlimant Olivia Weng 128 74 0 25 Oct 2021
Reconstructing Pruned Filters using Cheap Spatial Transformations Roy Miles K. Mikolajczyk 127 0 0 25 Oct 2021
Lottery Tickets with Nonzero Biases Jonas Fischer Advait Gadhikar R. Burkholz 85 6 0 21 Oct 2021
Class-Discriminative CNN Compression Yuchen Liu D. Wentzlaff S. Kung 89 1 0 21 Oct 2021
Neural Network Pruning Through Constrained Reinforcement Learning Shehryar Malik Muhammad Umair Haider O. Iqbal M. Taj 107 1 0 16 Oct 2021