Operation-Aware Soft Channel Pruning using Differentiable Masks

8 July 2020

Papers citing "Operation-Aware Soft Channel Pruning using Differentiable Masks"

50 / 70 papers shown

Title
Advancing Weight and Channel Sparsification with Enhanced Saliency Xinglong Sun Maying Shen Hongxu Yin Lei Mao Pavlo Molchanov Jose M. Alvarez 46 1 0 05 Feb 2025
Playing the Lottery With Concave Regularizers for Sparse Trainable Neural Networks Giulia Fracastoro Sophie M. Fosson Andrea Migliorati G. Calafiore 40 1 0 19 Jan 2025
AutoSculpt: A Pattern-based Model Auto-pruning Framework Using Reinforcement Learning and Graph Learning Lixian Jing Jianpeng Qi Junyu Dong Yanwei Yu 3DPC AI4CE 39 0 0 24 Dec 2024
S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning Weihao Lin Shengji Tang Chong Yu Peng Ye Tao Chen 16 0 0 09 Oct 2024
A Greedy Hierarchical Approach to Whole-Network Filter-Pruning in CNNs Kiran Purohit Anurag Parvathgari Sourangshu Bhattacharya VLM 30 0 0 22 Aug 2024
Decay Pruning Method: Smooth Pruning With a Self-Rectifying Procedure Minghao Yang Linlin Gao Pengyuan Li Wenbo Li Yihong Dong Zhiying Cui 34 1 0 06 Jun 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 52 48 0 08 Apr 2024
Separate, Dynamic and Differentiable (SMART) Pruner for Block/Output Channel Pruning on Computer Vision Tasks Guanhua Ding Zexi Ye Zhen Zhong Gang Li David Shao 34 0 0 29 Mar 2024
Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment Alireza Ganjdanesh Shangqian Gao Heng-Chiao Huang 36 5 0 28 Mar 2024
Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch Xidong Wu Shangqian Gao Zeyu Zhang Zhenzhen Li Runxue Bao Yanfu Zhang Xiaoqian Wang Heng-Chiao Huang 27 7 0 21 Mar 2024
REPrune: Channel Pruning via Kernel Representative Selection Mincheol Park Dongjin Kim Cheonjun Park Yuna Park Gyeong Eun Gong Won Woo Ro Suhyun Kim VLM 36 1 0 27 Feb 2024
SequentialAttention++ for Block Sparsification: Differentiable Pruning Meets Combinatorial Optimization T. Yasuda Kyriakos Axiotis Gang Fu M. Bateni Vahab Mirrokni 39 0 0 27 Feb 2024
BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation Peng-Tao Xu Wenqi Shao Mengzhao Chen Shitao Tang Kai-Chuang Zhang Peng Gao Fengwei An Yu Qiao Ping Luo MoE 27 27 0 18 Feb 2024
OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators Tianyi Chen Tianyu Ding Zhihui Zhu Zeyu Chen HsiangTao Wu Ilya Zharkov Luming Liang 16 3 0 15 Dec 2023
Class-Aware Pruning for Efficient Neural Networks Mengnan Jiang Jingcun Wang Amro Eldebiky Xunzhao Yin Cheng Zhuo Ing-Chao Lin Grace Li Zhang AAML 14 7 0 10 Dec 2023
SUBP: Soft Uniform Block Pruning for 1xN Sparse CNNs Multithreading Acceleration Jingyang Xiang Siqi Li Jun Chen Shipeng Bai Yukai Ma Guang Dai Yong-Jin Liu 24 1 0 10 Oct 2023
ThinResNet: A New Baseline for Structured Convolutional Networks Pruning Hugo Tessier Ghouti Boukli Hacene Vincent Gripon 16 1 0 22 Sep 2023
A Differentiable Framework for End-to-End Learning of Hybrid Structured Compression Moonjung Eo Suhyun Kang Wonjong Rhee 22 1 0 21 Sep 2023
Influence Function Based Second-Order Channel Pruning-Evaluating True Loss Changes For Pruning Is Possible Without Retraining Hongrong Cheng Miao Zhang Javen Qinfeng Shi AAML 20 1 0 13 Aug 2023
Differentiable Transportation Pruning Yun-qiang Li J. C. V. Gemert Torsten Hoefler Bert Moons E. Eleftheriou Bram-Ernst Verhoef OT 22 7 0 17 Jul 2023
Filter Pruning for Efficient CNNs via Knowledge-driven Differential Filter Sampler Shaohui Lin Wenxuan Huang Jiao Xie Baochang Zhang Yunhang Shen Zhou Yu Jungong Han David Doermann 20 2 0 01 Jul 2023
DiffRate : Differentiable Compression Rate for Efficient Vision Transformers Mengzhao Chen Wenqi Shao Peng Xu Mingbao Lin Kaipeng Zhang Fei Chao Rongrong Ji Yu Qiao Ping Luo ViT 34 43 0 29 May 2023
PDP: Parameter-free Differentiable Pruning is All You Need Minsik Cho Saurabh N. Adya Devang Naik VLM 15 10 0 18 May 2023
NTK-SAP: Improving neural network pruning by aligning training dynamics Yite Wang Dawei Li Ruoyu Sun 28 19 0 06 Apr 2023
Information-Theoretic GAN Compression with Variational Energy-based Model Minsoo Kang Hyewon Yoo Eunhee Kang Sehwan Ki Hyong-Euk Lee Bohyung Han GAN 20 3 0 28 Mar 2023
Protective Self-Adaptive Pruning to Better Compress DNNs Liang Li Pengfei Zhao AAML 16 0 0 21 Mar 2023
Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions Kaiqi Zhao Animesh Jain Ming Zhao 19 9 0 14 Mar 2023
OTOV2: Automatic, Generic, User-Friendly Tianyi Chen Luming Liang Tian Ding Zhihui Zhu Ilya Zharkov VLM MQ 40 31 0 13 Mar 2023
Structured Pruning for Deep Convolutional Neural Networks: A survey Yang He Lingao Xiao 3DPC 28 116 0 01 Mar 2023
Balanced Training for Sparse GANs Yite Wang Jing Wu N. Hovakimyan Ruoyu Sun 32 9 0 28 Feb 2023
Soft Masking for Cost-Constrained Channel Pruning Ryan Humble Maying Shen J. Latorre Eric Darve1 J. Álvarez 14 13 0 04 Nov 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions M. Tukan Loay Mualem Alaa Maalouf 3DPC 38 22 0 18 Sep 2022
Memory Consistent Unsupervised Off-the-Shelf Model Adaptation for Source-Relaxed Medical Image Segmentation Xiaofeng Liu Fangxu Xing G. El Fakhri Jonghye Woo OOD 37 30 0 16 Sep 2022
CWP: Instance complexity weighted channel-wise soft masks for network pruning Jiapeng Wang Ming Ma Zhenhua Yu 11 0 0 08 Sep 2022
Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps Alireza Ganjdanesh Shangqian Gao Heng-Chiao Huang FAtt AAML 19 19 0 07 Sep 2022
Network Pruning via Feature Shift Minimization Y. Duan Yue Zhou Peng He Qiang Liu Shukai Duan Xiaofang Hu 18 4 0 06 Jul 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks Y. Fu Haichuan Yang Jiayi Yuan Meng Li Cheng Wan Raghuraman Krishnamoorthi Vikas Chandra Yingyan Lin 28 18 0 02 Jun 2022
Pooling Revisited: Your Receptive Field is Suboptimal Dong-Hwan Jang Sanghyeok Chu Joonhyuk Kim Bohyung Han 22 11 0 30 May 2022
Online Hybrid Lightweight Representations Learning: Its Application to Visual Tracking Ilchae Jung Minji Kim Eunhyeok Park Bohyung Han 13 3 0 23 May 2022
Attentive Fine-Grained Structured Sparsity for Image Restoration Junghun Oh Heewon Kim Seungjun Nah Chee Hong Jonghyun Choi Kyoung Mu Lee 19 18 0 26 Apr 2022
CHEX: CHannel EXploration for CNN Model Compression Zejiang Hou Minghai Qin Fei Sun Xiaolong Ma Kun Yuan Yi Xu Yen-kuang Chen Rong Jin Yuan Xie S. Kung 13 71 0 29 Mar 2022
PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression D. Vo Akihiro Sugimoto Hideki Nakayama 13 5 0 16 Mar 2022
Optimal channel selection with discrete QCQP Yeonwoo Jeong Deokjae Lee Gaon An Changyong Son Hyun Oh Song 11 1 0 24 Feb 2022
Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters Mingbao Lin Liujuan Cao Yu-xin Zhang Ling Shao Chia-Wen Lin Rongrong Ji 16 51 0 15 Feb 2022
Adaptive Activation-based Structured Pruning Kaiqi Zhao Animesh Jain Ming Zhao 16 1 0 21 Jan 2022
Automatic Sparse Connectivity Learning for Neural Networks Zhimin Tang Linkai Luo Bike Xie Yiyu Zhu Rujie Zhao Lvqing Bi Chao Lu 24 40 0 13 Jan 2022
Recursive Least Squares for Training and Pruning Convolutional Neural Networks Tianzong Yu Chunyuan Zhang Yuan Wang Meng-tao Ma Qingwei Song 22 1 0 13 Jan 2022
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space Arnav Chavan Zhiqiang Shen Zhuang Liu Zechun Liu Kwang-Ting Cheng Eric P. Xing ViT 25 70 0 03 Jan 2022
Batch Normalization Tells You Which Filter is Important Junghun Oh Heewon Kim Sungyong Baik Chee Hong Kyoung Mu Lee CVBM 21 8 0 02 Dec 2021
Automatic Neural Network Pruning that Efficiently Preserves the Model Accuracy Thibault Castells Seul-Ki Yeom 3DV 16 3 0 18 Nov 2021