Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers

1 February 2018

Papers citing "Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers"

50 / 193 papers shown

Title
Optimal Brain Apoptosis Mingyuan Sun Zheng Fang Jiaxu Wang Junjie Jiang Delei Kong Chenming Hu Yuetong Fang Renjing Xu AAML 68 0 0 25 Feb 2025
Optimal ablation for interpretability Maximilian Li Lucas Janson FAtt 49 2 0 16 Sep 2024
Straightforward Layer-wise Pruning for More Efficient Visual Adaptation Ruizi Han Jinglei Tang 50 1 0 19 Jul 2024
Isomorphic Pruning for Vision Models Gongfan Fang Xinyin Ma Michael Bi Mi Xinchao Wang VLM ViT 34 6 0 05 Jul 2024
MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion Jing Zou Lanqing Liu Qi Chen Shujun Wang Zhanli Hu Xiaohan Xing Jing Qin Mamba 45 2 0 27 Jun 2024
Subspace Node Pruning Joshua Offergeld Marcel van Gerven Nasir Ahmad 40 0 0 26 May 2024
Aux-NAS: Exploiting Auxiliary Labels with Negligibly Extra Inference Cost Yuan Gao Weizhong Zhang Wenhan Luo Lin Ma Jin-Gang Yu Gui-Song Xia Jiayi Ma 29 1 0 09 May 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 58 48 0 08 Apr 2024
Maxwell's Demon at Work: Efficient Pruning by Leveraging Saturation of Neurons Simon Dufort-Labbé P. DÓro Evgenii Nikishin Razvan Pascanu Pierre-Luc Bacon A. Baratin 42 1 0 12 Mar 2024
Towards Explaining Deep Neural Network Compression Through a Probabilistic Latent Space Mahsa Mozafari-Nia S. Y. Sekeh 21 0 0 29 Feb 2024
REPrune: Channel Pruning via Kernel Representative Selection Mincheol Park Dongjin Kim Cheonjun Park Yuna Park Gyeong Eun Gong Won Woo Ro Suhyun Kim VLM 46 1 0 27 Feb 2024
One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training Lianbo Ma Yuee Zhou Jianlun Ma Guo-Ding Yu Qing Li MQ 25 1 0 30 Jan 2024
Cooperative Learning for Cost-Adaptive Inference Xingli Fang Richard M. Bradford Jung-Eun Kim 32 1 0 13 Dec 2023
Contrastive Learning-Based Spectral Knowledge Distillation for Multi-Modality and Missing Modality Scenarios in Semantic Segmentation Aniruddh Sikdar Jayant Teotia Suresh Sundaram 32 2 0 04 Dec 2023
Deep Learning-Based Object Detection in Maritime Unmanned Aerial Vehicle Imagery: Review and Experimental Comparisons Chenjie Zhao Ryan Wen Liu Jingxiang Qu Ruobin Gao 32 37 0 14 Nov 2023
Going Beyond Neural Network Feature Similarity: The Network Feature Complexity and Its Interpretation Using Category Theory Yiting Chen Zhanpeng Zhou Junchi Yan 18 9 0 10 Oct 2023
Denoising Diffusion Step-aware Models Shuai Yang Yukang Chen Luozhou Wang Shu Liu Ying-Cong Chen DiffM 43 13 0 05 Oct 2023
Highly Efficient SNNs for High-speed Object Detection Nemin Qiu Zhiguo Li Yuan Li Chuang Zhu 22 0 0 27 Sep 2023
Influence Function Based Second-Order Channel Pruning-Evaluating True Loss Changes For Pruning Is Possible Without Retraining Hongrong Cheng Miao Zhang Javen Qinfeng Shi AAML 33 1 0 13 Aug 2023
Resource Constrained Model Compression via Minimax Optimization for Spiking Neural Networks Jue Chen Huan Yuan Jianchao Tan Bin Chen Chengru Song Di Zhang 25 3 0 09 Aug 2023
D-Score: A Synapse-Inspired Approach for Filter Pruning Doyoung Park Jinsoo Kim Ji-Min Nam Jooyoung Chang S. Park 16 0 0 08 Aug 2023
Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotion James Z. Wang Sicheng Zhao Chenyan Wu Reginald B. Adams M. Newman T. Shafir Rachelle Tsachor 36 29 0 25 Jul 2023
Differentiable Transportation Pruning Yun-qiang Li J. C. V. Gemert Torsten Hoefler Bert Moons E. Eleftheriou Bram-Ernst Verhoef OT 22 7 0 17 Jul 2023
Structured Network Pruning by Measuring Filter-wise Interactions Wenting Tang Xingxing Wei Bo-wen Li 16 0 0 03 Jul 2023
Filter Pruning for Efficient CNNs via Knowledge-driven Differential Filter Sampler Shaohui Lin Wenxuan Huang Jiao Xie Baochang Zhang Yunhang Shen Zhou Yu Jungong Han David Doermann 20 2 0 01 Jul 2023
Homological Neural Networks: A Sparse Architecture for Multivariate Complexity Yuanrong Wang Antonio Briola T. Aste 36 5 0 27 Jun 2023
Improving Knowledge Distillation via Regularizing Feature Norm and Direction Yuzhu Wang Lechao Cheng Manni Duan Yongheng Wang Zunlei Feng Shu Kong 31 19 0 26 May 2023
Structural Pruning for Diffusion Models Gongfan Fang Xinyin Ma Xinchao Wang 25 128 0 18 May 2023
Efficient CNNs via Passive Filter Pruning Arshdeep Singh Mark D. Plumbley 21 1 0 05 Apr 2023
Progressive Channel-Shrinking Network Jianhong Pan Siyuan Yang Lin Geng Foo Qiuhong Ke Hossein Rahmani Zhipeng Fan Xiaozhong Liu 11 1 0 01 Apr 2023
Protective Self-Adaptive Pruning to Better Compress DNNs Liang Li Pengfei Zhao AAML 21 0 0 21 Mar 2023
Greedy Pruning with Group Lasso Provably Generalizes for Matrix Sensing Nived Rajaraman Devvrit Aryan Mokhtari Kannan Ramchandran 25 0 0 20 Mar 2023
Dynamic Structure Pruning for Compressing CNNs Jun-Hyung Park Yeachan Kim Junho Kim Joon-Young Choi SangKeun Lee GNN 13 15 0 17 Mar 2023
Filter Pruning based on Information Capacity and Independence Xiaolong Tang Shuo Ye Yufeng Shi Tianheng Hu Qinmu Peng Xinge You VLM 34 0 0 07 Mar 2023
Structured Pruning for Deep Convolutional Neural Networks: A survey Yang He Lingao Xiao 3DPC 30 117 0 01 Mar 2023
WHC: Weighted Hybrid Criterion for Filter Pruning on Convolutional Neural Networks Shaowu Chen Weize Sun Lei Huang 6 10 0 16 Feb 2023
DepGraph: Towards Any Structural Pruning Gongfan Fang Xinyin Ma Mingli Song Michael Bi Mi Xinchao Wang GNN 91 257 0 30 Jan 2023
Rewarded meta-pruning: Meta Learning with Rewards for Channel Pruning Athul Shibu Abhishek Kumar Heechul Jung Dong-Gyu Lee 14 1 0 26 Jan 2023
GOHSP: A Unified Framework of Graph and Optimization-based Heterogeneous Structured Pruning for Vision Transformer Miao Yin Burak Uzkent Yilin Shen Hongxia Jin Bo Yuan ViT 26 13 0 13 Jan 2023
Soft Masking for Cost-Constrained Channel Pruning Ryan Humble Maying Shen J. Latorre Eric Darve1 J. Álvarez 22 13 0 04 Nov 2022
Exploring the Effects of Channel Sparsity on Neural Network Pruning for Acoustic Scene Classification Yiqian Cai Shengchen Li 6 0 0 28 Oct 2022
Sauron U-Net: Simple automated redundancy elimination in medical image segmentation via filter pruning Juan Miguel Valverde Artem Shatillo Jussi Tohka AAML 29 5 0 27 Sep 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions M. Tukan Loay Mualem Alaa Maalouf 3DPC 46 22 0 18 Sep 2022
Entropy Induced Pruning Framework for Convolutional Neural Networks Yihe Lu Ziyu Guan Yaming Yang Maoguo Gong Wei Zhao Kaiyuan Feng 35 2 0 13 Aug 2022
Trainability Preserving Neural Pruning Huan Wang Yun Fu AAML 22 17 0 25 Jul 2022
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations Steffen Schotthöfer Emanuele Zangrando J. Kusch Gianluca Ceruti Francesco Tudisco 53 30 0 26 May 2022
Revisiting Random Channel Pruning for Neural Network Compression Yawei Li Kamil Adamczewski Wen Li Shuhang Gu Radu Timofte Luc Van Gool 24 81 0 11 May 2022
Attentive Fine-Grained Structured Sparsity for Image Restoration Junghun Oh Heewon Kim Seungjun Nah Chee Hong Jonghyun Choi Kyoung Mu Lee 19 18 0 26 Apr 2022
Aligned Weight Regularizers for Pruning Pretrained Neural Networks J. Ó. Neill Sourav Dutta H. Assem VLM 13 2 0 04 Apr 2022
CHEX: CHannel EXploration for CNN Model Compression Zejiang Hou Minghai Qin Fei Sun Xiaolong Ma Kun Yuan Yi Xu Yen-kuang Chen Rong Jin Yuan Xie S. Kung 16 71 0 29 Mar 2022