SNIP: Single-shot Network Pruning based on Connection Sensitivity

4 October 2018

Namhoon Lee

Thalaiyasingam Ajanthan

Philip Torr

VLM

ArXiv PDF HTML

Papers citing "SNIP: Single-shot Network Pruning based on Connection Sensitivity"

50 / 709 papers shown

Title
Neural Architecture Search for Dense Prediction Tasks in Computer Vision T. Elsken Arber Zela J. H. Metzen B. Staffler Thomas Brox Abhinav Valada Frank Hutter OOD 40 17 0 15 Feb 2022
Finding Dynamics Preserving Adversarial Winning Tickets Xupeng Shi Pengfei Zheng Adam Ding Yuan Gao Weizhong Zhang AAML 31 1 0 14 Feb 2022
Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets Tianlong Chen Xuxi Chen Xiaolong Ma Yanzhi Wang Zhangyang Wang 24 35 0 09 Feb 2022
Improving the Sample-Complexity of Deep Classification Networks with Invariant Integration M. Rath Alexandru Paul Condurache 25 8 0 08 Feb 2022
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models Chen Liang Haoming Jiang Simiao Zuo Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen T. Zhao 25 14 0 06 Feb 2022
The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training Shiwei Liu Tianlong Chen Xiaohan Chen Li Shen Decebal Constantin Mocanu Zhangyang Wang Mykola Pechenizkiy 19 106 0 05 Feb 2022
Selective Network Linearization for Efficient Private Inference Minsu Cho Ameya Joshi S. Garg Brandon Reagen Chinmay Hegde 19 43 0 04 Feb 2022
OptG: Optimizing Gradient-driven Criteria in Network Sparsity Yuxin Zhang Mingbao Lin Yonghong Tian Rongrong Ji Rongrong Ji 46 5 0 30 Jan 2022
On the Convergence of Heterogeneous Federated Learning with Arbitrary Adaptive Online Model Pruning Hanhan Zhou Tian-Shing Lan Guru Venkataramani Wenbo Ding FedML 32 6 0 27 Jan 2022
On The Energy Statistics of Feature Maps in Pruning of Neural Networks with Skip-Connections Mohammadreza Soltani Suya Wu Yuerong Li Jie Ding Vahid Tarokh 3DPC 39 0 0 26 Jan 2022
Iterative Activation-based Structured Pruning Kaiqi Zhao Animesh Jain Ming Zhao 42 0 0 22 Jan 2022
Adaptive Activation-based Structured Pruning Kaiqi Zhao Animesh Jain Ming Zhao 32 1 0 21 Jan 2022
Single-Shot Pruning for Offline Reinforcement Learning Samin Yeasar Arnob Riyasat Ohib Sergey Plis Doina Precup OffRL 25 22 0 31 Dec 2021
Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks Runpei Dong Zhanhong Tan Mengdi Wu Linfeng Zhang Kaisheng Ma MQ 41 11 0 30 Dec 2021
Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better Sameer Bibikar H. Vikalo Zhangyang Wang Xiaohan Chen FedML 35 96 0 18 Dec 2021
SNF: Filter Pruning via Searching the Proper Number of Filters Pengkun Liu Yaru Yue Yanjun Guo Xingxiang Tao Xiaoguang Zhou 3DPC 36 0 0 14 Dec 2021
On the Compression of Natural Language Models S. Damadi 30 0 0 13 Dec 2021
Inf-CP: A Reliable Channel Pruning based on Channel Influence Bilan Lai Haoran Xiang S. Furao 10 0 0 05 Dec 2021
Logic Shrinkage: Learned FPGA Netlist Sparsity for Efficient Neural Network Inference Erwei Wang James J. Davis G. Stavrou P. Cheung George A. Constantinides Mohamed S. Abdelfattah MQ 19 11 0 04 Dec 2021
Putting 3D Spatially Sparse Networks on a Diet Junha Lee Chris Choy Jaesik Park 3DV 41 3 0 02 Dec 2021
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models Tri Dao Beidi Chen Kaizhao Liang Jiaming Yang Zhao Song Atri Rudra Christopher Ré 33 75 0 30 Nov 2021
BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rule Miao Zhang Jilin Hu Steven W. Su Shirui Pan Xiaojun Chang B. Yang Gholamreza Haffari OOD 47 15 0 25 Nov 2021
Plant ñ' Seek: Can You Find the Winning Ticket? Jonas Fischer R. Burkholz 28 21 0 22 Nov 2021
On the Existence of Universal Lottery Tickets R. Burkholz Nilanjana Laha Rajarshi Mukherjee Alkis Gotovos UQCV 21 32 0 22 Nov 2021
Neuron-based Pruning of Deep Neural Networks with Better Generalization using Kronecker Factored Curvature Approximation Abdolghani Ebrahimi Diego Klabjan 20 4 0 16 Nov 2021
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI Jiangchao Yao Shengyu Zhang Yang Yao Feng Wang Jianxin Ma ... Kun Kuang Chao-Xiang Wu Fei Wu Jingren Zhou Hongxia Yang 28 91 0 11 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 86 83 0 08 Nov 2021
How I Learned to Stop Worrying and Love Retraining Max Zimmer Christoph Spiegel Sebastian Pokutta CLL 12 8 0 01 Nov 2021
You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownership Xuxi Chen Tianlong Chen Zhenyu Zhang Zhangyang Wang WIGM 32 22 0 30 Oct 2021
DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models Xuxi Chen Tianlong Chen Weizhu Chen Ahmed Hassan Awadallah Zhangyang Wang Yu Cheng MoE ALM 28 10 0 30 Oct 2021
RGP: Neural Network Pruning through Its Regular Graph Structure Zhuangzhi Chen Jingyang Xiang Yao Lu Qi Xuan Xiaoniu Yang 27 1 0 28 Oct 2021
An Operator Theoretic View on Pruning Deep Neural Networks William T. Redman M. Fonoberova Ryan Mohr Yannis G. Kevrekidis Igor Mezić 46 17 0 28 Oct 2021
Meta-Learning Sparse Implicit Neural Representations Jaehoon Lee Jihoon Tack Namhoon Lee Jinwoo Shin 29 44 0 27 Oct 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 30 89 0 26 Oct 2021
CHIP: CHannel Independence-based Pruning for Compact Neural Networks Yang Sui Miao Yin Yi Xie Huy Phan S. Zonouz Bo Yuan VLM 40 129 0 26 Oct 2021
Applications and Techniques for Fast Machine Learning in Science A. Deiana Nhan Tran Joshua C. Agar Michaela Blott G. D. Guglielmo ... Ashish Sharma S. Summers Pietro Vischia J. Vlimant Olivia Weng 14 71 0 25 Oct 2021
Reconstructing Pruned Filters using Cheap Spatial Transformations Roy Miles K. Mikolajczyk 31 0 0 25 Oct 2021
Exploring Gradient Flow Based Saliency for DNN Model Compression Xinyu Liu Baopu Li Zhen Chen Yixuan Yuan FAtt 17 9 0 24 Oct 2021
When to Prune? A Policy towards Early Structural Pruning Maying Shen Pavlo Molchanov Hongxu Yin J. Álvarez VLM 28 53 0 22 Oct 2021
Probabilistic fine-tuning of pruning masks and PAC-Bayes self-bounded learning Soufiane Hayou Bo He Gintare Karolina Dziugaite 37 2 0 22 Oct 2021
Lottery Tickets with Nonzero Biases Jonas Fischer Advait Gadhikar R. Burkholz 27 6 0 21 Oct 2021
HALP: Hardware-Aware Latency Pruning Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez VLM 46 13 0 20 Oct 2021
ProxyBO: Accelerating Neural Architecture Search via Bayesian Optimization with Zero-cost Proxies Yu Shen Yang Li Jian Zheng Wentao Zhang Peng Yao Jixiang Li Sen Yang Ji Liu Cui Bin AI4CE 47 30 0 20 Oct 2021
SOSP: Efficiently Capturing Global Correlations by Second-Order Structured Pruning Manuel Nonnenmacher Thomas Pfeil Ingo Steinwart David Reeb 21 25 0 19 Oct 2021
S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks Shiyu Liu Chong Min John Tan Mehul Motani CLL 29 4 0 17 Oct 2021
GradSign: Model Performance Inference with Theoretical Insights Zhihao Zhang Zhihao Jia 33 22 0 16 Oct 2021
Omni-sparsity DNN: Fast Sparsity Optimization for On-Device Streaming E2E ASR via Supernet Haichuan Yang Yuan Shangguan Dilin Wang Meng Li P. Chuang Xiaohui Zhang Ganesh Venkatesh Ozlem Kalinli Vikas Chandra 37 14 0 15 Oct 2021
Differentiable Network Pruning for Microcontrollers Edgar Liberis Nicholas D. Lane 24 18 0 15 Oct 2021
A Field Guide to Scientific XAI: Transparent and Interpretable Deep Learning for Bioinformatics Research Thomas P. Quinn Sunil R. Gupta Svetha Venkatesh Vuong Le OOD 19 2 0 13 Oct 2021
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models J. Tan C. Chan Joon Huang Chuah VLM 54 16 0 07 Oct 2021