Channel Pruning for Accelerating Very Deep Neural Networks

19 July 2017

Xiangyu Zhang

Papers citing "Channel Pruning for Accelerating Very Deep Neural Networks"

50 / 1,090 papers shown

Title
EBJR: Energy-Based Joint Reasoning for Adaptive Inference Mohammad Akbari Amin Banitalebi-Dehkordi Yong Zhang BDL MQ 14 6 0 20 Oct 2021
SOSP: Efficiently Capturing Global Correlations by Second-Order Structured Pruning Manuel Nonnenmacher Thomas Pfeil Ingo Steinwart David Reeb 19 25 0 19 Oct 2021
Channel redundancy and overlap in convolutional neural networks with channel-wise NNK graphs David Bonet Antonio Ortega Javier Ruiz-Hidalgo Sarath Shekkizhar GNN 33 7 0 18 Oct 2021
Sub-bit Neural Networks: Learning to Compress and Accelerate Binary Neural Networks Yikai Wang Yi Yang Gang Hua Anbang Yao MQ 29 15 0 18 Oct 2021
A Dimensionality Reduction Approach for Convolutional Neural Networks L. Meneghetti N. Demo G. Rozza 93 14 0 18 Oct 2021
Finding Everything within Random Binary Networks Kartik K. Sreenivasan Shashank Rajput Jy-yong Sohn Dimitris Papailiopoulos 25 10 0 18 Oct 2021
Dynamic Slimmable Denoising Network Zutao Jiang Changlin Li Xiaojun Chang Jihua Zhu Yi Yang AI4CE 14 15 0 17 Oct 2021
Network Augmentation for Tiny Deep Learning Han Cai Chuang Gan Ji Lin Song Han 25 29 0 17 Oct 2021
Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction Sara Elkerdawy Mostafa Elhoushi Hong Zhang Nilanjan Ray CVBM 31 38 0 15 Oct 2021
Joint Channel and Weight Pruning for Model Acceleration on Moblie Devices Tianli Zhao Xi Sheryl Zhang Wentao Zhu Jiaxing Wang Sen Yang Ji Liu Jian Cheng 56 2 0 15 Oct 2021
Mining the Weights Knowledge for Optimizing Neural Network Structures Mengqiao Han Xiabi Liu Zhaoyang Hai Xin Duan 11 1 0 11 Oct 2021
Weight Evolution: Improving Deep Neural Networks Training through Evolving Inferior Weight Values Zhenquan Lin K. Guo Xiaofen Xing Xiangmin Xu ODL 24 1 0 09 Oct 2021
Designing the Architecture of a Convolutional Neural Network Automatically for Diabetic Retinopathy Diagnosis Fahman Saeed M. Hussain Hatim Aboalsamh Fadwa Al Adel A. Owaifeer 24 6 0 08 Oct 2021
GNN is a Counter? Revisiting GNN for Question Answering Kuan-Chieh Wang Yuyu Zhang Diyi Yang Le Song Tao Qin LMTD 29 30 0 07 Oct 2021
Towards Efficient Post-training Quantization of Pre-trained Language Models Haoli Bai Lu Hou Lifeng Shang Xin Jiang Irwin King M. Lyu MQ 82 47 0 30 Sep 2021
Prune Your Model Before Distill It Jinhyuk Park Albert No VLM 51 27 0 30 Sep 2021
Distribution-sensitive Information Retention for Accurate Binary Neural Network Haotong Qin Xiangguo Zhang Ruihao Gong Yifu Ding Yi Xu Xianglong Liu MQ 25 87 0 25 Sep 2021
Neural network relief: a pruning algorithm based on neural activity Aleksandr Dekhovich David Tax M. Sluiter Miguel A. Bessa 46 10 0 22 Sep 2021
Bayesian Optimization with Clustering and Rollback for CNN Auto Pruning Hanwei Fan Jiandong Mu W. Zhang 38 5 0 22 Sep 2021
DS-Net++: Dynamic Weight Slicing for Efficient Inference in CNNs and Transformers Changlin Li Guangrun Wang Bing Wang Xiaodan Liang Zhihui Li Xiaojun Chang 35 9 0 21 Sep 2021
Learning Versatile Convolution Filters for Efficient Visual Recognition Kai Han Yunhe Wang Chang Xu Chunjing Xu Enhua Wu Dacheng Tao 27 8 0 20 Sep 2021
Dense Pruning of Pointwise Convolutions in the Frequency Domain Mark Buckler Neil Adit Yuwei Hu Zhiru Zhang Adrian Sampson 3DPC 48 2 0 16 Sep 2021
AdaPruner: Adaptive Channel Pruning and Effective Weights Inheritance Xiangcheng Liu Jian Cao Hongyi Yao Wenyu Sun Yuan Zhang 42 2 0 14 Sep 2021
Dynamic Collective Intelligence Learning: Finding Efficient Sparse Model via Refined Gradients for Pruned Weights Jang-Hyun Kim Jayeon Yoo Yeji Song Kiyoon Yoo Nojun Kwak 34 6 0 10 Sep 2021
$ECQ$^{\text{x}}$: Explainability-Driven Quantization for Low-Bit and Sparse DNNs$ ECQ $^{\text{x}}$ : Explainability-Driven Quantization for Low-Bit and Sparse DNNs Daniel Becking Maximilian Dreyer Wojciech Samek Karsten Müller Sebastian Lapuschkin MQ 196 13 0 09 Sep 2021
RepNAS: Searching for Efficient Re-parameterizing Blocks Mingyang Zhang Xinyi Yu Jingtao Rong L. Ou 22 19 0 08 Sep 2021
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization Yi Guo Huan Yuan Jianchao Tan Zhangyang Wang Sen Yang Ji Liu 31 46 0 06 Sep 2021
Quantization of Generative Adversarial Networks for Efficient Inference: a Methodological Study Pavel Andreev Alexander Fritzler Dmitry Vetrov MQ 19 10 0 31 Aug 2021
Pruning with Compensation: Efficient Channel Pruning for Deep Convolutional Neural Networks Zhouyang Xie Yan Fu Sheng-Zhao Tian Junlin Zhou Duanbing Chen 3DV 15 0 0 31 Aug 2021
AIP: Adversarial Iterative Pruning Based on Knowledge Transfer for Convolutional Neural Networks Jingfei Chang Yang Lu Ping Xue Yiqun Xu Zhen Wei 30 0 0 31 Aug 2021
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions Yang Wu Dingheng Wang Xiaotong Lu Fan Yang Guoqi Li W. Dong Jianbo Shi 29 18 0 30 Aug 2021
Auto-Split: A General Framework of Collaborative Edge-Cloud AI Amin Banitalebi-Dehkordi Naveen Vedula J. Pei Fei Xia Lanjun Wang Yong Zhang 22 89 0 30 Aug 2021
NeuroCartography: Scalable Automatic Visual Summarization of Concepts in Deep Neural Networks Haekyu Park Nilaksh Das Rahul Duggal Austin P. Wright Omar Shaikh Fred Hohman Duen Horng Chau HAI 29 25 0 29 Aug 2021
Compact representations of convolutional neural networks via weight pruning and quantization Giosuè Cataldo Marinò A. Petrini D. Malchiodi Marco Frasca MQ 21 4 0 28 Aug 2021
Layer-wise Model Pruning based on Mutual Information Chun Fan Jiwei Li Xiang Ao Fei Wu Yuxian Meng Xiaofei Sun 48 19 0 28 Aug 2021
GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity Wei Niu Zhengang Xiaolong Ma Peiyan Dong Gang Zhou Xuehai Qian Xue Lin Yanzhi Wang Bin Ren 22 19 0 25 Aug 2021
Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Zheng Zhan Yifan Gong Pu Zhao Geng Yuan Wei Niu ... Malith Jayaweera David Kaeli Bin Ren Xue Lin Yanzhi Wang SupR 38 41 0 18 Aug 2021
Differentiable Subset Pruning of Transformer Heads Jiaoda Li Ryan Cotterell Mrinmaya Sachan 45 54 0 10 Aug 2021
Basis Scaling and Double Pruning for Efficient Inference in Network-Based Transfer Learning Ken C. L. Wong Satyananda Kashyap Mehdi Moradi 27 2 0 06 Aug 2021
Generalizable Mixed-Precision Quantization via Attribution Rank Preservation Ziwei Wang Han Xiao Jiwen Lu Jie Zhou MQ 22 32 0 05 Aug 2021
Group Fisher Pruning for Practical Network Compression Liyang Liu Shilong Zhang Zhanghui Kuang Aojun Zhou Jingliang Xue Xinjiang Wang Yimin Chen Wenming Yang Q. Liao Wayne Zhang 25 146 0 02 Aug 2021
How much pre-training is enough to discover a good subnetwork? Cameron R. Wolfe Fangshuo Liao Qihan Wang J. Kim Anastasios Kyrillidis 30 3 0 31 Jul 2021
Model Preserving Compression for Neural Networks Jerry Chee Megan Flynn Anil Damle Chris De Sa 16 7 0 30 Jul 2021
Tiny Machine Learning for Concept Drift Simone Disabato M. Roveri 21 27 0 30 Jul 2021
Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNN Xiaohan Ding Tianxiang Hao Jungong Han Yuchen Guo Guiguang Ding 27 12 0 30 Jul 2021
Towards Efficient Tensor Decomposition-Based DNN Model Compression with Optimization Framework Miao Yin Yang Sui Siyu Liao Bo Yuan 28 79 0 26 Jul 2021
Compressing Neural Networks: Towards Determining the Optimal Layer-wise Decomposition Lucas Liebenwein Alaa Maalouf O. Gal Dan Feldman Daniela Rus 40 46 0 23 Jul 2021
Pruning Ternary Quantization Danyang Liu Xiangshan Chen Jie Fu Chen Ma Xue Liu MQ 47 0 0 23 Jul 2021
Boosting the Convergence of Reinforcement Learning-based Auto-pruning Using Historical Data Jiandong Mu Mengdi Wang Feiwen Zhu Jun Yang Weiran Lin Wei Zhang OnRL 37 2 0 16 Jul 2021
DANCE: DAta-Network Co-optimization for Efficient Segmentation Model Training and Inference Chaojian Li Wuyang Chen Yuchen Gu Tianlong Chen Yonggan Fu Zhangyang Wang Yingyan Lin 35 0 0 16 Jul 2021