Structured Pruning of Deep Convolutional Neural Networks

29 December 2015

Papers citing "Structured Pruning of Deep Convolutional Neural Networks"

50 / 274 papers shown

Title
A Machine Learning-oriented Survey on Tiny Machine LearningIEEE Access (IEEE Access), 2023 Luigi Capogrosso Federico Cunico D. Cheng Franco Fummi Marco Cristani SyDa MU 326 77 0 21 Sep 2023
ADC/DAC-Free Analog Acceleration of Deep Neural Networks with Frequency Transformation Nastaran Darabi Maeesha Binte Hashem Hongyi Pan Ahmet Cetin Wilfred Gomes A. R. Trivedi 114 6 0 04 Sep 2023
A Survey on Model Compression for Large Language ModelsTransactions of the Association for Computational Linguistics (TACL), 2023 Xunyu Zhu Jian Li Yong Liu Can Ma Weiping Wang 318 347 0 15 Aug 2023
Unified Data-Free Compression: Pruning and Quantization without Fine-TuningIEEE International Conference on Computer Vision (ICCV), 2023 Shipeng Bai Jun Chen Xintian Shen Yixuan Qian Yong Liu MQ 222 21 0 14 Aug 2023
Understanding Activation Patterns in Artificial Neural Networks by Exploring Stochastic Processes S. Lehmler Muhammad Saif-ur-Rehman Tobias Glasmachers Ioannis Iossifidis 148 0 0 01 Aug 2023
Model Compression Methods for YOLOv5: A Review Mohammad Jani Jamil Fayyad Younes Al Younes Homayoun Najjaran 189 26 0 21 Jul 2023
PATROL: Privacy-Oriented Pruning for Collaborative Inference Against Model Inversion AttacksIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023 Shiwei Ding Lan Zhang Miao Pan Xiaoyong Yuan AAML 193 10 0 20 Jul 2023
UPSCALE: Unconstrained Channel PruningInternational Conference on Machine Learning (ICML), 2023 Alvin Wan Hanxiang Hao K. Patnaik Yueyang Xu Omer Hadad David Guera Zhile Ren Qi Shan 158 4 0 17 Jul 2023
Leveraging Variational Autoencoders for Parameterized MMSE EstimationIEEE Transactions on Signal Processing (IEEE TSP), 2023 Michael Baur B. Fesl Wolfgang Utschick 145 17 0 11 Jul 2023
Rosko: Row Skipping Outer Products for Sparse Matrix Multiplication Kernels Vikas Natesh Andrew Sabot H. T. Kung Mark Ting 150 2 0 08 Jul 2023
Structured Network Pruning by Measuring Filter-wise Interactions Wenting Tang Xingxing Wei Yue Liu 158 0 0 03 Jul 2023
Homological Neural Networks: A Sparse Architecture for Multivariate Complexity Yuanrong Wang Antonio Briola T. Aste 172 8 0 27 Jun 2023
Adaptive Sharpness-Aware Pruning for Robust Sparse NetworksInternational Conference on Learning Representations (ICLR), 2023 Anna Bair Hongxu Yin Maying Shen Pavlo Molchanov J. Álvarez 248 17 0 25 Jun 2023
PDP: Parameter-free Differentiable Pruning is All You NeedNeural Information Processing Systems (NeurIPS), 2023 Minsik Cho Saurabh N. Adya Devang Naik VLM 187 15 0 18 May 2023
Seeing is Believing: Brain-Inspired Modular Training for Mechanistic Interpretability Ziming Liu Eric Gan Max Tegmark 228 50 0 04 May 2023
The Disharmony between BN and ReLU Causes Gradient Explosion, but is Offset by the Correlation between Activations Inyoung Paik Jaesik Choi 262 2 0 23 Apr 2023
PopSparse: Accelerated block sparse matrix multiplication on IPU Zhiyi Li Douglas Orr V. Ohan Godfrey Da Costa Tom Murray Adam Sanders D. Beker Dominic Masters 199 1 0 29 Mar 2023
Tetra-AML: Automatic Machine Learning via Tensor NetworksApplied Sciences (Appl. Sci.), 2023 A. Naumov Ar. Melnikov V. Abronin F. Oxanichenko K. Izmailov M. Pflitsch A. Melnikov M. Perelshtein 136 13 0 28 Mar 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 413 102 0 22 Feb 2023
Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge ModelsIEEE International Joint Conference on Neural Network (IJCNN), 2023 Yingchun Wang Jingcai Guo Jie Zhang Song Guo Weizhan Zhang Qinghua Zheng FedML 346 11 0 09 Feb 2023
A Comprehensive Survey of Dataset DistillationIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Shiye Lei Dacheng Tao DD 435 134 0 13 Jan 2023
GOHSP: A Unified Framework of Graph and Optimization-based Heterogeneous Structured Pruning for Vision TransformerAAAI Conference on Artificial Intelligence (AAAI), 2023 Miao Yin Burak Uzkent Yilin Shen Hongxia Jin Bo Yuan ViT 252 20 0 13 Jan 2023
Pruning Compact ConvNets for Efficient Inference Sayan Ghosh Karthik Prasad Xiaoliang Dai Peizhao Zhang Bichen Wu Graham Cormode Peter Vajda VLM 178 5 0 11 Jan 2023
Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion ScaleAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Hritik Bansal Karthik Gopalakrishnan Saket Dingliwal S. Bodapati Katrin Kirchhoff Dan Roth LRM 228 63 0 18 Dec 2022
FSCNN: A Fast Sparse Convolution Neural Network Inference System Bo Ji Tianyi Chen 128 3 0 17 Dec 2022
Towards Practical Control of Singular Values of Convolutional LayersNeural Information Processing Systems (NeurIPS), 2022 Alexandra Senderovich Ekaterina Bulatova Anton Obukhov M. Rakhuba AAML 183 11 0 24 Nov 2022
Finding Skill Neurons in Pre-trained Transformer-based Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Xiaozhi Wang Kaiyue Wen Zhengyan Zhang Lei Hou Zhiyuan Liu Juanzi Li MILM MoE 173 59 0 14 Nov 2022
Pruning Very Deep Neural Network Channels for Efficient Inference Yihui He 178 2 0 14 Nov 2022
RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization Chengpeng Chen Zichao Guo Haien Zeng Pengfei Xiong Jian Dong 190 58 0 11 Nov 2022
Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Report Andrey D. Ignatov Radu Timofte Maurizio Denna Abdelbadie Younes Ganzorig Gankhuyag ... Jing Liu Garas Gendy Nabil Sabor J. Hou Guanghui He SupR MQ 178 37 0 07 Nov 2022
Adapting Neural Models with Sequential Monte Carlo DropoutConference on Robot Learning (CoRL), 2022 Pamela Carreno-Medrano Dana Kulic Michael G. Burke 209 7 0 27 Oct 2022
Fast and Low-Memory Deep Neural Networks Using Binary Matrix Factorization Alireza Bordbar M. Kahaei MQ 237 0 0 24 Oct 2022
Pruning by Active Attention Manipulation Z. Babaiee Lucas Liebenwein Ramin Hasani Daniela Rus Radu Grosu 143 1 0 20 Oct 2022
Data-Model-Circuit Tri-Design for Ultra-Light Video Intelligence on Edge DevicesAsia and South Pacific Design Automation Conference (ASP-DAC), 2022 Yimeng Zhang A. Kamath Qiucheng Wu Zhiwen Fan Wuyang Chen Zinan Lin Shiyu Chang Sijia Liu Cong Hao 212 6 0 16 Oct 2022
Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectors Mohammad Reza Taesiri Finlay Macklon Yihe Wang Hengshuo Shen Cor-Paul Bezemer ELM LLMAG MLLM 151 20 0 05 Oct 2022
CRISP: Curriculum based Sequential Neural Decoders for Polar Code FamilyInternational Conference on Machine Learning (ICML), 2022 Ashwin Hebbar Viraj Nadkarni Ashok Vardhan Makkuva S. Bhat Sewoong Oh Pramod Viswanath 266 11 0 01 Oct 2022
Sauron U-Net: Simple automated redundancy elimination in medical image segmentation via filter pruningNeurocomputing (Neurocomputing), 2022 Juan Miguel Valverde Artem Shatillo Jussi Tohka AAML 182 11 0 27 Sep 2022
Building an Efficiency Pipeline: Commutativity and Cumulativeness of Efficiency Operators for Transformers Ji Xin Raphael Tang Zhiying Jiang Yaoliang Yu Jimmy J. Lin 180 1 0 31 Jul 2022
CoNLoCNN: Exploiting Correlation and Non-Uniform Quantization for Energy-Efficient Low-precision Deep Convolutional Neural NetworksIEEE International Joint Conference on Neural Network (IJCNN), 2022 Muhammad Abdullah Hanif G. M. Sarda Alberto Marchisio Guido Masera Maurizio Martina Mohamed Bennai MQ 140 5 0 31 Jul 2022
DropNet: Reducing Neural Network Complexity via Iterative PruningInternational Conference on Machine Learning (ICML), 2020 Chong Min John Tan Mehul Motani 153 62 0 14 Jul 2022
A Structured Sparse Neural Network and Its Matrix Calculations Algorithm S. Sarayi M. Bahrami 106 0 0 02 Jul 2022
Not All Lotteries Are Made Equal Surya Kant Sahu Sai Mitheran Somya Suhans Mahapatra 74 1 0 16 Jun 2022
Energy-efficient Deployment of Deep Learning Applications on Cortex-M based Microcontrollers using Deep CompressionMethoden und Beschreibungssprachen zur Modellierung und Verifikation von Schaltungen und Systemen (MBMV), 2022 M. Deutel Philipp Woller Christopher Mutschler Jürgen Teich 210 4 0 20 May 2022
Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a SurveyArtificial Intelligence Review (Artif Intell Rev), 2022 Paul Wimmer Jens Mehnert Alexandru Paul Condurache DD 317 33 0 17 May 2022
A Comprehensive Survey on Model Quantization for Deep Neural Networks in Image ClassificationACM Transactions on Intelligent Systems and Technology (ACM TIST), 2022 Babak Rokh A. Azarpeyvand Alireza Khanteymoori MQ 385 169 0 14 May 2022
Revisiting Random Channel Pruning for Neural Network CompressionComputer Vision and Pattern Recognition (CVPR), 2022 Yawei Li Kamil Adamczewski Wen Li Shuhang Gu Radu Timofte Luc Van Gool 197 107 0 11 May 2022
Automatic Block-wise Pruning with Auxiliary Gating Structures for Deep Convolutional Neural Networks Zhaofeng Si H. Qi Xiaoyu Song CVBM 178 0 0 07 May 2022
Triangular Dropout: Variable Network Width without Retraining Edward W. Staley Jared Markowitz 149 3 0 02 May 2022
Multiply-and-Fire (MNF): An Event-driven Sparse Neural Network Accelerator Miao Yu Tingting Xiang Venkata Pavan Kumar Miriyala Trevor E. Carlson 176 1 0 20 Apr 2022
End-to-End Sensitivity-Based Filter Pruning Z. Babaiee Lucas Liebenwein Ramin Hasani Daniela Rus Radu Grosu AAML 118 2 0 15 Apr 2022