Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers

1 February 2018

Papers citing "Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers"

50 / 193 papers shown

Title
To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding Edouard Yvinec Arnaud Dapogny Kévin Bailly 27 7 0 28 Mar 2022
DyRep: Bootstrapping Training with Dynamic Re-parameterization Tao Huang Shan You Bohan Zhang Yuxuan Du Fei Wang Chao Qian Chang Xu 30 26 0 24 Mar 2022
Dual Lottery Ticket Hypothesis Yue Bai Haiquan Wang Zhiqiang Tao Kunpeng Li Yun Fu 21 37 0 08 Mar 2022
Provable and Efficient Continual Representation Learning Yingcong Li Mingchen Li M. Salman Asif Samet Oymak CLL 30 11 0 03 Mar 2022
Optimal channel selection with discrete QCQP Yeonwoo Jeong Deokjae Lee Gaon An Changyong Son Hyun Oh Song 16 1 0 24 Feb 2022
Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters Mingbao Lin Liujuan Cao Yu-xin Zhang Ling Shao Chia-Wen Lin Rongrong Ji 35 51 0 15 Feb 2022
Accelerating DNN Training with Structured Data Gradient Pruning Bradley McDanel Helia Dinh J. Magallanes 9 7 0 01 Feb 2022
UDC: Unified DNAS for Compressible TinyML Models Igor Fedorov Ramon Matas Hokchhay Tann Chu Zhou Matthew Mattina P. Whatmough AI4CE 21 13 0 15 Jan 2022
Automatic Sparse Connectivity Learning for Neural Networks Zhimin Tang Linkai Luo Bike Xie Yiyu Zhu Rujie Zhao Lvqing Bi Chao Lu 24 40 0 13 Jan 2022
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space Arnav Chavan Zhiqiang Shen Zhuang Liu Zechun Liu Kwang-Ting Cheng Eric P. Xing ViT 30 70 0 03 Jan 2022
SNF: Filter Pruning via Searching the Proper Number of Filters Pengkun Liu Yaru Yue Yanjun Guo Xingxiang Tao Xiaoguang Zhou 3DPC 20 0 0 14 Dec 2021
Channel Exchanging Networks for Multimodal and Multitask Dense Image Prediction Yikai Wang Gang Hua Wenbing Huang Fengxiang He Dacheng Tao 54 29 0 04 Dec 2021
Batch Normalization Tells You Which Filter is Important Junghun Oh Heewon Kim Sungyong Baik Chee Hong Kyoung Mu Lee CVBM 27 8 0 02 Dec 2021
A Highly Effective Low-Rank Compression of Deep Neural Networks with Modified Beam-Search and Modified Stable Rank Moonjung Eo Suhyun Kang Wonjong Rhee 24 1 0 30 Nov 2021
Automatic Neural Network Pruning that Efficiently Preserves the Model Accuracy Thibault Castells Seul-Ki Yeom 3DV 18 3 0 18 Nov 2021
A Unified Approach to Coreset Learning Alaa Maalouf Gilad Eini Ben Mussay Dan Feldman Margarita Osadchy DD 9 16 0 04 Nov 2021
Evolving Transferable Neural Pruning Functions Yuchen Liu S. Kung D. Wentzlaff 24 1 0 21 Oct 2021
Class-Discriminative CNN Compression Yuchen Liu D. Wentzlaff S. Kung 26 1 0 21 Oct 2021
Domain Generalization through Audio-Visual Relative Norm Alignment in First Person Action Recognition M. Planamente Chiara Plizzari Emanuele Alberti Barbara Caputo EgoV 14 33 0 19 Oct 2021
Weight Evolution: Improving Deep Neural Networks Training through Evolving Inferior Weight Values Zhenquan Lin K. Guo Xiaofen Xing Xiangmin Xu ODL 24 1 0 09 Oct 2021
ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint Search Jiaqi Li Haoran Li Yaran Chen Zixiang Ding Nannan Li Mingjun Ma Zicheng Duan Dong Zhao 40 9 0 08 Oct 2021
Deep Neural Compression Via Concurrent Pruning and Self-Distillation J. Ó. Neill Sourav Dutta H. Assem VLM 21 5 0 30 Sep 2021
Prune Your Model Before Distill It Jinhyuk Park Albert No VLM 46 27 0 30 Sep 2021
Neural network relief: a pruning algorithm based on neural activity Aleksandr Dekhovich David Tax M. Sluiter Miguel A. Bessa 46 10 0 22 Sep 2021
$On the Compression of Neural Networks Using $\ell_0$-Norm Regularization and Weight Pruning$ On the Compression of Neural Networks Using $\ell_0$ -Norm Regularization and Weight Pruning F. Oliveira E. Batista R. Seara 12 9 0 10 Sep 2021
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization Yi Guo Huan Yuan Jianchao Tan Zhangyang Wang Sen Yang Ji Liu 23 46 0 06 Sep 2021
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions Yang Wu Dingheng Wang Xiaotong Lu Fan Yang Guoqi Li W. Dong Jianbo Shi 29 18 0 30 Aug 2021
Basis Scaling and Double Pruning for Efficient Inference in Network-Based Transfer Learning Ken C. L. Wong Satyananda Kashyap Mehdi Moradi 17 2 0 06 Aug 2021
Group Fisher Pruning for Practical Network Compression Liyang Liu Shilong Zhang Zhanghui Kuang Aojun Zhou Jingliang Xue Xinjiang Wang Yimin Chen Wenming Yang Q. Liao Wayne Zhang 25 146 0 02 Aug 2021
Compressing Neural Networks: Towards Determining the Optimal Layer-wise Decomposition Lucas Liebenwein Alaa Maalouf O. Gal Dan Feldman Daniela Rus 34 46 0 23 Jul 2021
LANA: Latency Aware Network Acceleration Pavlo Molchanov Jimmy Hall Hongxu Yin Jan Kautz Nicolò Fusi Arash Vahdat 25 11 0 12 Jul 2021
Model compression as constrained optimization, with application to neural nets. Part V: combining compressions Miguel Á. Carreira-Perpiñán Yerlan Idelbayev 25 6 0 09 Jul 2021
Dep- $L_0$ : Improving $L_0$ -based Network Sparsification via Dependency Modeling Yang Li Shihao Ji 15 1 0 30 Jun 2021
AdaptCL: Efficient Collaborative Learning with Dynamic and Adaptive Pruning Guangmeng Zhou Ke Xu Qi Li Yang Liu Yi Zhao 16 8 0 27 Jun 2021
Cogradient Descent for Dependable Learning Runqi Wang Baochang Zhang Lian Zhuo QiXiang Ye David Doermann 21 0 0 20 Jun 2021
Feature Flow Regularization: Improving Structured Sparsity in Deep Neural Networks Yue Wu Yuan Lan Luchan Zhang Yang Xiang 14 6 0 05 Jun 2021
Patch Slimming for Efficient Vision Transformers Yehui Tang Kai Han Yunhe Wang Chang Xu Jianyuan Guo Chao Xu Dacheng Tao ViT 16 163 0 05 Jun 2021
Single Image Depth Prediction with Wavelet Decomposition Michael Ramamonjisoa Michael Firman Jamie Watson Vincent Lepetit Daniyar Turmukhambetov MDE 16 55 0 03 Jun 2021
Accelerating Large Scale Real-Time GNN Inference using Channel Pruning Hongkuan Zhou Ajitesh Srivastava Hanqing Zeng R. Kannan Viktor Prasanna GNN 19 64 0 10 May 2021
Network Pruning That Matters: A Case Study on Retraining Variants Duong H. Le Binh-Son Hua 24 41 0 07 May 2021
Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safety Sebastian Houben Stephanie Abrecht Maram Akila Andreas Bär Felix Brockherde ... Serin Varghese Michael Weber Sebastian J. Wirkert Tim Wirtz Matthias Woehrle AAML 13 58 0 29 Apr 2021
Content-Aware GAN Compression Yuchen Liu Zhixin Shu Yijun Li Zhe-nan Lin Federico Perazzi S. Kung GAN 35 58 0 06 Apr 2021
Self-Reorganizing and Rejuvenating CNNs for Increasing Model Capacity Utilization Wissam J. Baddar Seungju Han Seon-Min Rhee Jae-Joon Han 20 1 0 13 Feb 2021
A Deeper Look into Convolutions via Eigenvalue-based Pruning Ilke Çugu Emre Akbas FAtt 13 1 0 04 Feb 2021
Pruning and Quantization for Deep Neural Network Acceleration: A Survey Tailin Liang C. Glossner Lei Wang Shaobo Shi Xiaotong Zhang MQ 147 674 0 24 Jan 2021
Baseline Pruning-Based Approach to Trojan Detection in Neural Networks P. Bajcsy Michael Majurski AAML 34 8 0 22 Jan 2021
KCP: Kernel Cluster Pruning for Dense Labeling Neural Networks Po-Hsiang Yu Sih-Sian Wu Liang-Gee Chen VLM 14 0 0 17 Jan 2021
Neural Pruning via Growing Regularization Huan Wang Can Qin Yulun Zhang Y. Fu 21 144 0 16 Dec 2020
Multimodal In-bed Pose and Shape Estimation under the Blankets Yu Yin Joseph P. Robinson Y. Fu 3DH 60 18 0 12 Dec 2020
ProtoPShare: Prototype Sharing for Interpretable Image Classification and Similarity Discovery Dawid Rymarczyk Lukasz Struski Jacek Tabor Bartosz Zieliñski 19 111 0 29 Nov 2020