Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions

14 March 2023

Papers citing "Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions"

11 / 11 papers shown

Title
ICE-Pruning: An Iterative Cost-Efficient Pruning Pipeline for Deep Neural Networks Wenhao Hu Paul Henderson José Cano 22 0 0 12 May 2025
Reduced storage direct tensor ring decomposition for convolutional neural networks compression Mateusz Gabor R. Zdunek 16 0 0 17 May 2024
Separate, Dynamic and Differentiable (SMART) Pruner for Block/Output Channel Pruning on Computer Vision Tasks Guanhua Ding Zexi Ye Zhen Zhong Gang Li David Shao 34 0 0 29 Mar 2024
Self-Supervised Quantization-Aware Knowledge Distillation Kaiqi Zhao Ming Zhao MQ 23 2 0 17 Mar 2024
REPrune: Channel Pruning via Kernel Representative Selection Mincheol Park Dongjin Kim Cheonjun Park Yuna Park Gyeong Eun Gong Won Woo Ro Suhyun Kim VLM 22 1 0 27 Feb 2024
Mobiprox: Supporting Dynamic Approximate Computing on Mobiles Matevz Fabjancic O. Machidon Hashim Sharif Yifan Zhao Sasa Misailovic V. Pejović 11 2 0 16 Mar 2023
Developmental Plasticity-inspired Adaptive Pruning for Deep Spiking and Artificial Neural Networks Bing Han Feifei Zhao Yi Zeng Guobin Shen 18 6 0 23 Nov 2022
Variant Parallelism: Lightweight Deep Convolutional Models for Distributed Inference on IoT Devices Navidreza Asadi M. Goudarzi OODD VLM 16 1 0 15 Oct 2022
SCOP: Scientific Control for Reliable Neural Network Pruning Yehui Tang Yunhe Wang Yixing Xu Dacheng Tao Chunjing Xu Chao Xu Chang Xu AAML 37 165 0 21 Oct 2020
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression Yawei Li Shuhang Gu Christoph Mayer Luc Van Gool Radu Timofte 123 189 0 19 Mar 2020
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 222 382 0 05 Mar 2020