v1v2 (latest)

Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers

1 February 2018

Papers citing "Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers"

50 / 198 papers shown

Title
Compress to Impress: Efficient LLM Adaptation Using a Single Gradient Step on 100 Samples Shiva Sreeram Alaa Maalouf Pratyusha Sharma Daniela Rus 92 0 0 23 Oct 2025
One Shot vs. Iterative: Rethinking Pruning Strategies for Model Compression Mikołaj Janusz Tomasz Wojnar Yawei Li Luca Benini Kamil Adamczewski VLM 94 2 0 19 Aug 2025
VLCD: Vision-Language Contrastive Distillation for Accurate and Efficient Automatic Placenta Analysis Manas Mehta Yimu Pan Kelly Gallagher Alison D. Gernand Jeffery A. Goldstein Delia Mwinyelle Leena Mithal J. Z. Wang 110 0 0 02 Jun 2025
Smooth Model Compression without Fine-Tuning Christina Runkel Natacha Kuete Meli Jovita Lukasik A. Biguri Carola-Bibiane Schönlieb Michael Moeller 169 0 0 30 May 2025
Optimal Brain ApoptosisInternational Conference on Learning Representations (ICLR), 2025 Mingyuan Sun Zheng Fang Jiaxu Wang Junjie Jiang Delei Kong Chenming Hu Yuetong Fang Zhanchen Zhu AAML 283 2 0 25 Feb 2025
Optimal ablation for interpretabilityNeural Information Processing Systems (NeurIPS), 2024 Maximilian Li Lucas Janson FAtt 295 9 0 16 Sep 2024
Straightforward Layer-wise Pruning for More Efficient Visual Adaptation Ruizi Han Jinglei Tang 201 3 0 19 Jul 2024
Isomorphic Pruning for Vision Models Gongfan Fang Xinyin Ma Michael Bi Mi Xinchao Wang VLM ViT 188 17 0 05 Jul 2024
MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion Jing Zou Lanqing Liu Qi Chen Shujun Wang Zhanli Hu Xiaohan Xing Jing Qin Mamba 182 18 0 27 Jun 2024
A Comprehensive Study of Structural Pruning for Vision Models Haoling Li Haoling Li Mengqi Xue Gongfan Fang Sheng Zhou Zunlei Feng Huiqiong Wang Mingli Song Lechao Cheng VLM 317 0 0 18 Jun 2024
Subspace Node Pruning Joshua Offergeld Marcel van Gerven Nasir Ahmad 221 0 0 26 May 2024
Aux-NAS: Exploiting Auxiliary Labels with Negligibly Extra Inference CostInternational Conference on Learning Representations (ICLR), 2024 Yuan Gao Weizhong Zhang Tong Lu Lin Ma Jin-Gang Yu Gui-Song Xia Jiayi Ma 152 1 0 09 May 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 275 135 0 08 Apr 2024
Maxwell's Demon at Work: Efficient Pruning by Leveraging Saturation of Neurons Simon Dufort-Labbé P. DÓro Evgenii Nikishin Razvan Pascanu Pierre-Luc Bacon A. Baratin 259 4 0 12 Mar 2024
Towards Explaining Deep Neural Network Compression Through a Probabilistic Latent Space Mahsa Mozafari-Nia Salimeh Yasaei Sekeh 239 0 0 29 Feb 2024
REPrune: Channel Pruning via Kernel Representative Selection Mincheol Park Dongjin Kim Cheonjun Park Yuna Park Gyeong Eun Gong Won Woo Ro Suhyun Kim VLM 198 2 0 27 Feb 2024
One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training Lianbo Ma Yuee Zhou Jianlun Ma Guo-Ding Yu Qing Li MQ 143 5 0 30 Jan 2024
Cooperative Learning for Cost-Adaptive Inference Xingli Fang Richard M. Bradford Jung-Eun Kim 264 1 0 13 Dec 2023
Contrastive Learning-Based Spectral Knowledge Distillation for Multi-Modality and Missing Modality Scenarios in Semantic Segmentation Aniruddh Sikdar Jayant Teotia Suresh Sundaram 278 4 0 04 Dec 2023
Deep Learning-Based Object Detection in Maritime Unmanned Aerial Vehicle Imagery: Review and Experimental ComparisonsEngineering applications of artificial intelligence (Eng. Appl. Artif. Intell.), 2023 Chenjie Zhao Ryan Wen Liu Jingxiang Qu Ruobin Gao 155 72 0 14 Nov 2023
Going Beyond Neural Network Feature Similarity: The Network Feature Complexity and Its Interpretation Using Category TheoryInternational Conference on Learning Representations (ICLR), 2023 Yiting Chen Zhanpeng Zhou Junchi Yan 220 10 0 10 Oct 2023
Denoising Diffusion Step-aware ModelsInternational Conference on Learning Representations (ICLR), 2023 Shuai Yang Yukang Chen Luozhou Wang Shu Liu Ying-Cong Chen DiffM 341 22 0 05 Oct 2023
Highly Efficient SNNs for High-speed Object DetectionBritish Machine Vision Conference (BMVC), 2023 Nemin Qiu Zhiguo Li Yuan Li Chuang Zhu 217 0 0 27 Sep 2023
Influence Function Based Second-Order Channel Pruning-Evaluating True Loss Changes For Pruning Is Possible Without RetrainingIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Hongrong Cheng Miao Zhang Javen Qinfeng Shi AAML 160 6 0 13 Aug 2023
Resource Constrained Model Compression via Minimax Optimization for Spiking Neural NetworksACM Multimedia (ACM MM), 2023 Jue Chen Huan Yuan Jianchao Tan Bin Chen Chengru Song Chen Zhang 137 6 0 09 Aug 2023
D-Score: A Synapse-Inspired Approach for Filter Pruning Doyoung Park Jinsoo Kim Ji-Min Nam Jooyoung Chang S. Park 86 0 0 08 Aug 2023
Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding EmotionProceedings of the IEEE (Proc. IEEE), 2023 James Z. Wang Sicheng Zhao Chenyan Wu Reginald B. Adams M. Newman T. Shafir Rachelle Tsachor 304 52 0 25 Jul 2023
Differentiable Transportation PruningIEEE International Conference on Computer Vision (ICCV), 2023 Yun-qiang Li Jan van Gemert Torsten Hoefler Bert Moons E. Eleftheriou Bram-Ernst Verhoef OT 237 14 0 17 Jul 2023
Structured Network Pruning by Measuring Filter-wise Interactions Wenting Tang Xingxing Wei Yue Liu 146 0 0 03 Jul 2023
Filter Pruning for Efficient CNNs via Knowledge-driven Differential Filter Sampler Shaohui Lin Hao Wu Jiao Xie Baochang Zhang Chunjiang Ge Zhou Yu Jungong Han David Doermann 158 3 0 01 Jul 2023
Homological Neural Networks: A Sparse Architecture for Multivariate Complexity Yuanrong Wang Antonio Briola T. Aste 152 7 0 27 Jun 2023
Improving Knowledge Distillation via Regularizing Feature Norm and Direction Yuzhu Wang Lechao Cheng Manni Duan Yongheng Wang Zunlei Feng Shu Kong 178 28 0 26 May 2023
Structural Pruning for Diffusion ModelsNeural Information Processing Systems (NeurIPS), 2023 Gongfan Fang Xinyin Ma Xinchao Wang 292 184 0 18 May 2023
Efficient CNNs via Passive Filter PruningIEEE Transactions on Audio, Speech, and Language Processing (IEEE TASLP), 2023 Arshdeep Singh Mark D. Plumbley 106 3 0 05 Apr 2023
Progressive Channel-Shrinking NetworkIEEE transactions on multimedia (IEEE TMM), 2023 Jianhong Pan Siyuan Yang Lin Geng Foo Qiuhong Ke Hossein Rahmani Zhipeng Fan Jing Liu 153 4 0 01 Apr 2023
Protective Self-Adaptive Pruning to Better Compress DNNs Liang Li Pengfei Zhao AAML 116 0 0 21 Mar 2023
Greedy Pruning with Group Lasso Provably Generalizes for Matrix SensingNeural Information Processing Systems (NeurIPS), 2023 Nived Rajaraman Devvrit Aryan Mokhtari Kannan Ramchandran 220 2 0 20 Mar 2023
Dynamic Structure Pruning for Compressing CNNsAAAI Conference on Artificial Intelligence (AAAI), 2023 Jun-Hyung Park Yeachan Kim Junho Kim Joon-Young Choi SangKeun Lee GNN 121 22 0 17 Mar 2023
Filter Pruning based on Information Capacity and IndependenceIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2023 Xiaolong Tang Shuo Ye Yufeng Shi Tianheng Hu Qinmu Peng Xinge You VLM 214 4 0 07 Mar 2023
Structured Pruning for Deep Convolutional Neural Networks: A surveyIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Yang He Lingao Xiao 3DPC 324 243 0 01 Mar 2023
WHC: Weighted Hybrid Criterion for Filter Pruning on Convolutional Neural NetworksIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 Shaowu Chen Weize Sun Lei Huang 135 13 0 16 Feb 2023
DepGraph: Towards Any Structural PruningComputer Vision and Pattern Recognition (CVPR), 2023 Gongfan Fang Xinyin Ma Weilong Dai Michael Bi Mi Xinchao Wang GNN 343 393 0 30 Jan 2023
Rewarded meta-pruning: Meta Learning with Rewards for Channel Pruning Athul Shibu Abhishek Kumar Heechul Jung Dong-Gyu Lee 162 2 0 26 Jan 2023
GOHSP: A Unified Framework of Graph and Optimization-based Heterogeneous Structured Pruning for Vision TransformerAAAI Conference on Artificial Intelligence (AAAI), 2023 Miao Yin Burak Uzkent Yilin Shen Hongxia Jin Bo Yuan ViT 208 20 0 13 Jan 2023
Soft Masking for Cost-Constrained Channel PruningEuropean Conference on Computer Vision (ECCV), 2022 Ryan Humble Maying Shen J. Latorre Eric Darve1 J. Álvarez 133 16 0 04 Nov 2022
Exploring the Effects of Channel Sparsity on Neural Network Pruning for Acoustic Scene Classification Yiqian Cai Shengchen Li 147 0 0 28 Oct 2022
Sauron U-Net: Simple automated redundancy elimination in medical image segmentation via filter pruningNeurocomputing (Neurocomputing), 2022 Juan Miguel Valverde Artem Shatillo Jussi Tohka AAML 162 9 0 27 Sep 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No AssumptionsNeural Information Processing Systems (NeurIPS), 2022 M. Tukan Loay Mualem Alaa Maalouf 3DPC 163 26 0 18 Sep 2022
Entropy Induced Pruning Framework for Convolutional Neural NetworksAAAI Conference on Artificial Intelligence (AAAI), 2022 Yihe Lu Ziyu Guan Yaming Yang Maoguo Gong Ziyu Guan Kaiyuan Feng 165 5 0 13 Aug 2022
Trainability Preserving Neural PruningInternational Conference on Learning Representations (ICLR), 2022 Huan Wang Yun Fu AAML 158 23 0 25 Jul 2022