Data-Driven Sparse Structure Selection for Deep Neural Networks

5 July 2017

Papers citing "Data-Driven Sparse Structure Selection for Deep Neural Networks"

50 / 273 papers shown

Title
Optimal Brain Apoptosis Mingyuan Sun Zheng Fang Jiaxu Wang Junjie Jiang Delei Kong Chenming Hu Yuetong Fang Renjing Xu AAML 66 0 0 25 Feb 2025
RedTest: Towards Measuring Redundancy in Deep Neural Networks Effectively Yao Lu Peixin Zhang Jingyi Wang Lei Ma Xiaoniu Yang Qi Xuan 21 0 0 15 Nov 2024
Complexity-Aware Training of Deep Neural Networks for Optimal Structure Discovery Valentin Frank Ingmar Guenter Athanasios Sideris CVBM 18 0 0 14 Nov 2024
Ripple: Accelerating LLM Inference on Smartphones with Correlation-Aware Neuron Management Tuowei Wang Ruwen Fan Minxing Huang Zixu Hao Kun Li Ting Cao Youyou Lu Yaoxue Zhang Ju Ren 45 2 0 25 Oct 2024
Small Contributions, Small Networks: Efficient Neural Network Pruning Based on Relative Importance Mostafa Hussien Mahmoud Afifi K. Nguyen M. Cheriet 21 0 0 21 Oct 2024
DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models Shangqian Gao Chi-Heng Lin Ting Hua Tang Zheng Yilin Shen Hongxia Jin Yen-Chang Hsu 30 3 0 15 Oct 2024
SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Models Yuqi Li Yao Lu Zeyu Dong Chuanguang Yang Yihao Chen Jianping Gou 21 2 0 14 Oct 2024
S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning Weihao Lin Shengji Tang Chong Yu Peng Ye Tao Chen 16 0 0 09 Oct 2024
Optimal ablation for interpretability Maximilian Li Lucas Janson FAtt 44 2 0 16 Sep 2024
HESSO: Towards Automatic Efficient and User Friendly Any Neural Network Training and Pruning Tianyi Chen Xiaoyi Qu David Aponte Colby R. Banbury Jongwoo Ko Tianyu Ding Yong Ma Vladimir Lyapunov Ilya Zharkov Luming Liang 75 1 0 11 Sep 2024
STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning Jaeseong Lee seung-won hwang Aurick Qiao Daniel F Campos Z. Yao Yuxiong He 25 2 0 10 Sep 2024
PSE-Net: Channel Pruning for Convolutional Neural Networks with Parallel-subnets Estimator Shiguang Wang Tao Xie Haijun Liu Xingcheng Zhang Jian Cheng 29 2 0 29 Aug 2024
MPruner: Optimizing Neural Network Size with CKA-Based Mutual Information Pruning Seungbeom Hu ChanJun Park Andrew Ferraiuolo Sang-Ki Ko Jinwoo Kim Haein Song Jieung Kim 16 1 0 24 Aug 2024
A Greedy Hierarchical Approach to Whole-Network Filter-Pruning in CNNs Kiran Purohit Anurag Parvathgari Sourangshu Bhattacharya VLM 25 0 0 22 Aug 2024
MoDeGPT: Modular Decomposition for Large Language Model Compression Chi-Heng Lin Shangqian Gao James Seale Smith Abhishek Patel Shikhar Tuli Yilin Shen Hongxia Jin Yen-Chang Hsu 71 6 0 19 Aug 2024
An Effective Information Theoretic Framework for Channel Pruning Yihao Chen Zefang Wang 41 2 0 14 Aug 2024
Comb, Prune, Distill: Towards Unified Pruning for Vision Model Compression Jonas Schmitt Ruiping Liu Junwei Zheng Jiaming Zhang Rainer Stiefelhagen VLM 26 0 0 06 Aug 2024
A Generic Layer Pruning Method for Signal Modulation Recognition Deep Learning Models Yao Lu Yutao Zhu Yuqi Li Dongwei Xu Yun Lin Qi Xuan Xiaoniu Yang 23 5 0 12 Jun 2024
Concurrent Training and Layer Pruning of Deep Neural Networks Valentin Frank Ingmar Guenter Athanasios Sideris 3DPC 27 3 0 06 Jun 2024
Decay Pruning Method: Smooth Pruning With a Self-Rectifying Procedure Minghao Yang Linlin Gao Pengyuan Li Wenbo Li Yihong Dong Zhiying Cui 34 1 0 06 Jun 2024
Subspace Node Pruning Joshua Offergeld Marcel van Gerven Nasir Ahmad 36 0 0 26 May 2024
Pruning for Robust Concept Erasing in Diffusion Models Tianyun Yang Juan Cao Chang Xu 27 13 0 26 May 2024
Multi-level projection with exponential parallel speedup; Application to sparse auto-encoders neural networks Guillaume Perez Michel Barlaud 24 0 0 03 May 2024
Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch Xidong Wu Shangqian Gao Zeyu Zhang Zhenzhen Li Runxue Bao Yanfu Zhang Xiaoqian Wang Heng-Chiao Huang 25 7 0 21 Mar 2024
LNPT: Label-free Network Pruning and Training Jinying Xiao Ping Li Zhe Tang Jie Nie 22 2 0 19 Mar 2024
Enhanced Sparsification via Stimulative Training Shengji Tang Weihao Lin Hancheng Ye Peng Ye Chong Yu Baopu Li Tao Chen 32 2 0 11 Mar 2024
Revisiting Learning-based Video Motion Magnification for Real-time Processing Hyunwoo Ha Oh Hyun-Bin Kim Jun-Seong Byung-Ki Kwon Kim Sung-Bin Linh-Tam Tran Ji-Yun Kim Sung-Ho Bae Tae-Hyun Oh 24 1 0 04 Mar 2024
Structurally Prune Anything: Any Architecture, Any Framework, Any Time Xun Wang John Rachwan Stephan Günnemann Bertrand Charpentier 33 4 0 03 Mar 2024
REPrune: Channel Pruning via Kernel Representative Selection Mincheol Park Dongjin Kim Cheonjun Park Yuna Park Gyeong Eun Gong Won Woo Ro Suhyun Kim VLM 33 1 0 27 Feb 2024
SliceGPT: Compress Large Language Models by Deleting Rows and Columns Saleh Ashkboos Maximilian L. Croci Marcelo Gennari do Nascimento Torsten Hoefler James Hensman VLM 127 145 0 26 Jan 2024
Convolutional Neural Network Compression via Dynamic Parameter Rank Pruning Manish Sharma Jamison Heard Eli Saber Panos P. Markopoulos 20 1 0 15 Jan 2024
Block Pruning for Enhanced Efficiency in Convolutional Neural Networks Cheng-En Wu A. Davoodi Yu Hen Hu 24 3 0 28 Dec 2023
OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators Tianyi Chen Tianyu Ding Zhihui Zhu Zeyu Chen HsiangTao Wu Ilya Zharkov Luming Liang 16 3 0 15 Dec 2023
Class-Aware Pruning for Efficient Neural Networks Mengnan Jiang Jingcun Wang Amro Eldebiky Xunzhao Yin Cheng Zhuo Ing-Chao Lin Grace Li Zhang AAML 14 7 0 10 Dec 2023
Relationship between Model Compression and Adversarial Robustness: A Review of Current Evidence Svetlana Pavlitska Hannes Grolig J. Marius Zöllner AAML 14 3 0 27 Nov 2023
Filter Pruning For CNN With Enhanced Linear Representation Redundancy Bojue Wang Chun-Xia Ma Bin Liu Nianbo Liu Jinqi Zhu 22 1 0 10 Oct 2023
SUBP: Soft Uniform Block Pruning for 1xN Sparse CNNs Multithreading Acceleration Jingyang Xiang Siqi Li Jun Chen Shipeng Bai Yukai Ma Guang Dai Yong-Jin Liu 24 1 0 10 Oct 2023
A Differentiable Framework for End-to-End Learning of Hybrid Structured Compression Moonjung Eo Suhyun Kang Wonjong Rhee 19 1 0 21 Sep 2023
EPTQ: Enhanced Post-Training Quantization via Label-Free Hessian Ofir Gordon H. Habi Arnon Netzer MQ 30 0 0 20 Sep 2023
Influence Function Based Second-Order Channel Pruning-Evaluating True Loss Changes For Pruning Is Possible Without Retraining Hongrong Cheng Miao Zhang Javen Qinfeng Shi AAML 20 1 0 13 Aug 2023
Resource Constrained Model Compression via Minimax Optimization for Spiking Neural Networks Jue Chen Huan Yuan Jianchao Tan Bin Chen Chengru Song Di Zhang 25 3 0 09 Aug 2023
Differentiable Transportation Pruning Yun-qiang Li J. C. V. Gemert Torsten Hoefler Bert Moons E. Eleftheriou Bram-Ernst Verhoef OT 19 7 0 17 Jul 2023
Filter Pruning for Efficient CNNs via Knowledge-driven Differential Filter Sampler Shaohui Lin Wenxuan Huang Jiao Xie Baochang Zhang Yunhang Shen Zhou Yu Jungong Han David Doermann 20 2 0 01 Jul 2023
CFDP: Common Frequency Domain Pruning Samir Khaki Weihan Luo 3DV 33 5 0 07 Jun 2023
Transforming to Yoked Neural Networks to Improve ANN Structure Xinshun Liu Yizhi Fang Yichao Jiang 20 0 0 03 Jun 2023
3D Small Object Detection with Dynamic Spatial Pruning Xiuwei Xu Zhihao Sun Ziwei Wang Hongmin Liu Jie Zhou Jiwen Lu 3DPC 18 3 0 05 May 2023
Filter Pruning via Filters Similarity in Consecutive Layers Xiaorui Wang Jun Wang Xin Tang Peng Gao Rui Fang Guotong Xie 14 1 0 26 Apr 2023
Beta-Rank: A Robust Convolutional Filter Pruning Method For Imbalanced Medical Image Analysis Morteza Homayounfar M. Koohi-Moghadam Reza Rawassizadeh V. Vardhanabhuti MedIm 13 1 0 15 Apr 2023
PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensors Haley M. So Laurie Bose Piotr Dudek Gordon Wetzstein 15 4 0 11 Apr 2023
A Multi-objective Complex Network Pruning Framework Based on Divide-and-conquer and Global Performance Impairment Ranking Ronghua Shang Songling Zhu Yinan Wu Weitong Zhang Licheng Jiao Songhua Xu 8 0 0 28 Mar 2023