SNIP: Single-shot Network Pruning based on Connection Sensitivity

4 October 2018

Namhoon Lee

Thalaiyasingam Ajanthan

Philip Torr

VLM

ArXiv PDF HTML

Papers citing "SNIP: Single-shot Network Pruning based on Connection Sensitivity"

50 / 709 papers shown

Title
Sparse Multitask Learning for Efficient Neural Representation of Motor Imagery and Execution Hye-Bin Shin Kang Yin Seong-Whan Lee 15 0 0 10 Dec 2023
Deeper Understanding of Black-box Predictions via Generalized Influence Functions Hyeonsu Lyu Jonggyu Jang Sehyun Ryu H. Yang TDI AI4CE 27 5 0 09 Dec 2023
Continual learning for surface defect segmentation by subnetwork creation and selection Aleksandr Dekhovich Miguel A. Bessa CLL 34 3 0 08 Dec 2023
Towards Sobolev Pruning Neil Kichler Sher Afghan U. Naumann 23 0 0 06 Dec 2023
An End-to-End Network Pruning Pipeline with Sparsity Enforcement Evan Dogariu 19 0 0 04 Dec 2023
Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective Can Jin Tianjin Huang Yihua Zhang Mykola Pechenizkiy Sijia Liu Shiwei Liu Tianlong Chen VLM 36 26 0 03 Dec 2023
Towards Higher Ranks via Adversarial Weight Pruning Yuchuan Tian Hanting Chen Tianyu Guo Chao Xu Yunhe Wang 35 2 0 29 Nov 2023
Efficient Stitchable Task Adaptation Haoyu He Zizheng Pan Jing Liu Jianfei Cai Bohan Zhuang 34 3 0 29 Nov 2023
Critical Influence of Overparameterization on Sharpness-aware Minimization Sungbin Shin Dongyeop Lee Maksym Andriushchenko Namhoon Lee AAML 50 1 0 29 Nov 2023
LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS Zhiwen Fan Kevin Wang Kairun Wen Zehao Zhu Dejia Xu Zhangyang Wang 3DGS 39 186 0 28 Nov 2023
TVT: Training-Free Vision Transformer Search on Tiny Datasets Zimian Wei H. Pan Lujun Li Peijie Dong Zhiliang Tian Xin-Yi Niu Dongsheng Li ViT 47 7 0 24 Nov 2023
SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape Hua Zheng Kuang-Hung Liu Igor Fedorov Xin Zhang Wen-Yen Chen Wei Wen 48 1 0 22 Nov 2023
Neural Network Pruning by Gradient Descent Zhang Zhang Ruyi Tao Jiang Zhang 24 4 0 21 Nov 2023
Mitigating Backdoors within Deep Neural Networks in Data-limited Configuration Soroush Hashemifar Saeed Parsa Morteza Zakeri-Nasrabadi AAML 36 0 0 13 Nov 2023
Importance Estimation with Random Gradient for Neural Network Pruning Suman Sapkota Binod Bhattarai 55 1 0 31 Oct 2023
PriPrune: Quantifying and Preserving Privacy in Pruned Federated Learning Tianyue Chu Mengwei Yang Nikolaos Laoutaris A. Markopoulou 42 4 0 30 Oct 2023
Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks Gouki Minegishi Yusuke Iwasawa Yutaka Matsuo 21 0 0 30 Oct 2023
Linear Mode Connectivity in Sparse Neural Networks Luke McDermott Daniel Cummings 28 1 0 28 Oct 2023
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time Zichang Liu Jue Wang Tri Dao Dinesh Manocha Binhang Yuan ... Anshumali Shrivastava Ce Zhang Yuandong Tian Christopher Ré Beidi Chen BDL 35 194 0 26 Oct 2023
Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization Zhuo Huang Muyang Li Li Shen Jun-chen Yu Chen Gong Bo Han Tongliang Liu OOD 51 8 0 25 Oct 2023
One is More: Diverse Perspectives within a Single Network for Efficient DRL Yiqin Tan Ling Pan Longbo Huang OffRL 40 0 0 21 Oct 2023
Breaking through Deterministic Barriers: Randomized Pruning Mask Generation and Selection Jianwei Li Weizhi Gao Qi Lei Dongkuan Xu 32 2 0 19 Oct 2023
In defense of parameter sharing for model-compression Aditya Desai Anshumali Shrivastava 14 4 0 17 Oct 2023
Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective Ming Zhong Chenxin An Weizhu Chen Jiawei Han Pengcheng He 31 9 0 17 Oct 2023
USDC: Unified Static and Dynamic Compression for Visual Transformer Huan Yuan Chao Liao Jianchao Tan Peng Yao Jiyuan Jia Bin Chen Chengru Song Di Zhang ViT 25 0 0 17 Oct 2023
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs Yuxin Zhang Lirui Zhao Mingbao Lin Yunyun Sun Yiwu Yao Xingjia Han Jared Tanner Shiwei Liu Rongrong Ji SyDa 45 40 0 13 Oct 2023
Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reduction Hanhan Zhou Tian-Shing Lan Guru Venkataramani Wenbo Ding 37 28 0 12 Oct 2023
LEMON: Lossless model expansion Yite Wang Jiahao Su Hanlin Lu Cong Xie Tianyi Liu Jianbo Yuan Yanghua Peng Ruoyu Sun Hongxia Yang 17 12 0 12 Oct 2023
Going Beyond Neural Network Feature Similarity: The Network Feature Complexity and Its Interpretation Using Category Theory Yiting Chen Zhanpeng Zhou Junchi Yan 20 9 0 10 Oct 2023
SUBP: Soft Uniform Block Pruning for 1xN Sparse CNNs Multithreading Acceleration Jingyang Xiang Siqi Li Jun Chen Shipeng Bai Yukai Ma Guang Dai Yong-Jin Liu 26 1 0 10 Oct 2023
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity Lu Yin You Wu Zhenyu Zhang Cheng-Yu Hsieh Yaqing Wang ... Mykola Pechenizkiy Yi Liang Michael Bendersky Zhangyang Wang Shiwei Liu 36 79 0 08 Oct 2023
Entropic Score metric: Decoupling Topology and Size in Training-free NAS Niccolò Cavagnero Luc Robbiano Francesca Pistilli Barbara Caputo Giuseppe Averta 28 3 0 06 Oct 2023
Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control Neehal Tumma Mathias Lechner Noel Loo Ramin Hasani Daniela Rus 38 0 0 05 Oct 2023
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training Aochuan Chen Yimeng Zhang Jinghan Jia James Diffenderfer Jiancheng Liu Konstantinos Parasyris Yihua Zhang Zheng-Wei Zhang B. Kailkhura Sijia Liu 37 43 0 03 Oct 2023
The Sparsity Roofline: Understanding the Hardware Limits of Sparse Neural Networks Cameron Shinn Collin McCarthy Saurav Muralidharan Muhammad Osama John Douglas Owens 16 2 0 30 Sep 2023
DeepPCR: Parallelizing Sequential Operations in Neural Networks Federico Danieli Miguel Sarabia Xavier Suau Yuan-Sen Ting Luca Zappella 21 1 0 28 Sep 2023
LAPP: Layer Adaptive Progressive Pruning for Compressing CNNs from Scratch P. Zhai K. Guo F. Liu Xiaofen Xing Xiangmin Xu 26 3 0 25 Sep 2023
Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation Kai Huang Hanyu Yin Heng Huang Wei Gao 33 11 0 22 Sep 2023
Cluster-based pruning techniques for audio data Boris Bergsma Marta Brzezinska O. Yazyev Milos Cernak 27 2 0 21 Sep 2023
Bold but Cautious: Unlocking the Potential of Personalized Federated Learning through Cautiously Aggressive Collaboration Xinghao Wu Xuefeng Liu Jianwei Niu Guogang Zhu Shaojie Tang FedML 27 17 0 20 Sep 2023
FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization Qianyu Long Christos Anagnostopoulos S. P. Parambath Daning Bi AI4CE FedML 23 2 0 13 Sep 2023
Sculpting Efficiency: Pruning Medical Imaging Models for On-Device Inference Sudarshan Sreeram Bernhard Kainz 26 0 0 10 Sep 2023
Compressing Vision Transformers for Low-Resource Visual Learning Eric Youn J. SaiMitheran Sanjana Prabhu Siyuan Chen ViT 35 2 0 05 Sep 2023
Adaptive Model Pruning and Personalization for Federated Learning over Wireless Networks Xiaonan Liu T. Ratnarajah M. Sellathurai Yonina C. Eldar 34 4 0 04 Sep 2023
Efficacy of Neural Prediction-Based Zero-Shot NAS Minh Le Nhan Nguyen N. H. Luong 24 0 0 31 Aug 2023
Efficient Joint Optimization of Layer-Adaptive Weight Pruning in Deep Neural Networks Kaixin Xu Zhe Wang Xue Geng Jie Lin Min-man Wu Xiaoli Li Weisi Lin 26 15 0 21 Aug 2023
AutoReP: Automatic ReLU Replacement for Fast Private Network Inference Hongwu Peng Shaoyi Huang Tong Zhou Yukui Luo Chenghong Wang ... Tony Geng Kaleel Mahmood Wujie Wen Xiaolin Xu Caiwen Ding OffRL 47 38 0 20 Aug 2023
Towards Attack-tolerant Federated Learning via Critical Parameter Analysis Sungwon Han Sungwon Park Fangzhao Wu Sundong Kim Bin Zhu Xing Xie Meeyoung Cha FedML 34 10 0 18 Aug 2023
How Does Pruning Impact Long-Tailed Multi-Label Medical Image Classifiers? G. Holste Ziyu Jiang Ajay Jaiswal Maria Hanna Shlomo Minkowitz ... Ying Ding Ronald M. Summers George Shih Yifan Peng Zhangyang Wang 31 1 0 17 Aug 2023
HyperSparse Neural Networks: Shifting Exploration to Exploitation through Adaptive Regularization Patrick Glandorf Timo Kaiser Bodo Rosenhahn 46 5 0 14 Aug 2023