Revisiting Random Channel Pruning for Neural Network Compression

11 May 2022

Radu Timofte

Luc Van Gool

ArXiv PDF HTML

Papers citing "Revisiting Random Channel Pruning for Neural Network Compression"

43 / 43 papers shown

Title
Efficient LLMs with AMP: Attention Heads and MLP Pruning Leandro Giusti Mugnaini Bruno Yamamoto Lucas Lauton de Alcantara Victor Zacarias Edson Bollis Lucas Pellicer A. H. R. Costa Artur Jordao 44 0 0 29 Apr 2025
Expanding-and-Shrinking Binary Neural Networks Xulong Shi Caiyi Sun Zhi Qi Liu Hao Xiaodong Yang MQ 54 0 0 31 Mar 2025
Towards Extreme Pruning of LLMs with Plug-and-Play Mixed Sparsity Chi Xu Gefei Zhang Yantong Zhu Luca Benini Guosheng Hu Yawei Li Zhihong Zhang 29 0 0 14 Mar 2025
Is Oracle Pruning the True Oracle? Sicheng Feng Keda Tao H. Wang VLM 70 0 0 28 Nov 2024
PSE-Net: Channel Pruning for Convolutional Neural Networks with Parallel-subnets Estimator Shiguang Wang Tao Xie Haijun Liu Xingcheng Zhang Jian Cheng 36 2 0 29 Aug 2024
Characterizing Disparity Between Edge Models and High-Accuracy Base Models for Vision Tasks Zhenyu Wang S. Nirjon 24 0 0 13 Jul 2024
Towards Generalized Entropic Sparsification for Convolutional Neural Networks Tin Barisin I. Horenko 16 1 0 06 Apr 2024
Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment Alireza Ganjdanesh Shangqian Gao Heng-Chiao Huang 36 5 0 28 Mar 2024
Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch Xidong Wu Shangqian Gao Zeyu Zhang Zhenzhen Li Runxue Bao Yanfu Zhang Xiaoqian Wang Heng-Chiao Huang 33 7 0 21 Mar 2024
PYRA: Parallel Yielding Re-Activation for Training-Inference Efficient Task Adaptation Yizhe Xiong Hui Chen Tianxiang Hao Zijia Lin Jungong Han Yuesong Zhang Guoxin Wang Yongjun Bao Guiguang Ding 43 16 0 14 Mar 2024
Self-Adapting Large Visual-Language Models to Edge Devices across Visual Modalities Kaiwen Cai Zhekai Duan Gaowen Liu Charles Fleming Chris Xiaoxuan Lu VLM 28 3 0 07 Mar 2024
Lightweight Pixel Difference Networks for Efficient Visual Representation Learning Z. Su Jiehua Zhang Longguang Wang Hua Zhang Zhen Liu M. Pietikäinen Li Liu 32 21 0 01 Feb 2024
SCoTTi: Save Computation at Training Time with an adaptive framework Ziyu Li Enzo Tartaglione Van-Tam Nguyen 31 0 0 19 Dec 2023
OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators Tianyi Chen Tianyu Ding Zhihui Zhu Zeyu Chen HsiangTao Wu Ilya Zharkov Luming Liang 16 3 0 15 Dec 2023
Accelerating Learnt Video Codecs with Gradient Decay and Layer-wise Distillation Tianhao Peng Ge Gao Heming Sun Fan Zhang David Bull 16 4 0 05 Dec 2023
Quantized Distillation: Optimizing Driver Activity Recognition Models for Resource-Constrained Environments Calvin Tanama Kunyu Peng Zdravko Marinov Rainer Stiefelhagen Alina Roitberg 17 1 0 10 Nov 2023
Edge-InversionNet: Enabling Efficient Inference of InversionNet on Edge Devices Zhepeng Wang Isaacshubhanand Putla Weiwen Jiang Youzuo Lin 24 2 0 14 Oct 2023
Dynamic Shuffle: An Efficient Channel Mixture Method Kaijun Gong Zhuowen Yin Yushu Li K. Guo Xiangmin Xu 25 0 0 04 Oct 2023
The Sparsity Roofline: Understanding the Hardware Limits of Sparse Neural Networks Cameron Shinn Collin McCarthy Saurav Muralidharan Muhammad Osama John Douglas Owens 16 2 0 30 Sep 2023
ThinResNet: A New Baseline for Structured Convolutional Networks Pruning Hugo Tessier Ghouti Boukli Hacene Vincent Gripon 16 1 0 22 Sep 2023
Knowledge Distillation Layer that Lets the Student Decide Ada Gorgun Y. Z. Gürbüz Aydin Alatan 21 0 0 06 Sep 2023
Can Unstructured Pruning Reduce the Depth in Deep Neural Networks? Liao Zhu Victor Quétu Van-Tam Nguyen Enzo Tartaglione 43 13 0 12 Aug 2023
Resource Constrained Model Compression via Minimax Optimization for Spiking Neural Networks Jue Chen Huan Yuan Jianchao Tan Bin Chen Chengru Song Di Zhang 25 3 0 09 Aug 2023
UPSCALE: Unconstrained Channel Pruning Alvin Wan Hanxiang Hao K. Patnaik Yueyang Xu Omer Hadad David Guera Zhile Ren Qi Shan 26 4 0 17 Jul 2023
Differentiable Transportation Pruning Yun-qiang Li J. C. V. Gemert Torsten Hoefler Bert Moons E. Eleftheriou Bram-Ernst Verhoef OT 22 7 0 17 Jul 2023
Canvas: End-to-End Kernel Architecture Search in Neural Networks Chenggang Zhao Genghan Zhang Mingyu Gao 13 1 0 16 Apr 2023
Structured Pruning for Multi-Task Deep Neural Networks Siddhant Garg Lijun Zhang Hui Guan 19 1 0 13 Apr 2023
Solving Oscillation Problem in Post-Training Quantization Through a Theoretical Perspective Yuexiao Ma Huixia Li Xiawu Zheng Xuefeng Xiao Rui Wang Shilei Wen Xin Pan Fei Chao Rongrong Ji MQ 10 12 0 21 Mar 2023
Dynamic Structure Pruning for Compressing CNNs Jun-Hyung Park Yeachan Kim Junho Kim Joon-Young Choi SangKeun Lee GNN 11 15 0 17 Mar 2023
OTOV2: Automatic, Generic, User-Friendly Tianyi Chen Luming Liang Tian Ding Zhihui Zhu Ilya Zharkov VLM MQ 45 31 0 13 Mar 2023
Structured Pruning for Deep Convolutional Neural Networks: A survey Yang He Lingao Xiao 3DPC 30 117 0 01 Mar 2023
WHC: Weighted Hybrid Criterion for Filter Pruning on Convolutional Neural Networks Shaowu Chen Weize Sun Lei Huang 6 10 0 16 Feb 2023
EVC: Towards Real-Time Neural Image Compression with Mask Decay G. Wang Jiahao Li Bin Li Yan Lu 22 63 0 10 Feb 2023
ZipLM: Inference-Aware Structured Pruning of Language Models Eldar Kurtic Elias Frantar Dan Alistarh MQ 25 24 0 07 Feb 2023
Rewarded meta-pruning: Meta Learning with Rewards for Channel Pruning Athul Shibu Abhishek Kumar Heechul Jung Dong-Gyu Lee 9 1 0 26 Jan 2023
Can We Find Strong Lottery Tickets in Generative Models? Sangyeop Yeo Yoojin Jang Jy-yong Sohn Dongyoon Han Jaejun Yoo 13 6 0 16 Dec 2022
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks Shiyu Liu Rohan Ghosh John Tan Chong Min Mehul Motani 31 0 0 09 Dec 2022
NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results Yawei Li K. Zhang Radu Timofte Luc Van Gool F. Kong ... Deng-Guang Zhou Kun Zeng Han-Yuan Lin Xinyu Chen Jin-Tao Fang SupR 36 77 0 11 May 2022
Practical Network Acceleration with Tiny Sets G. Wang Jianxin Wu 27 8 0 16 Feb 2022
Decomposing the Deep: Finding Class Specific Filters in Deep CNNs Akshay Badola Cherian Roy V. Padmanabhan R. Lal FAtt 8 2 0 14 Dec 2021
A Dimensionality Reduction Approach for Convolutional Neural Networks L. Meneghetti N. Demo G. Rozza 85 14 0 18 Oct 2021
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression Yawei Li Shuhang Gu Christoph Mayer Luc Van Gool Radu Timofte 129 189 0 19 Mar 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 188 1,027 0 06 Mar 2020