Connectivity Matters: Neural Network Pruning Through the Lens of Effective Sparsity

5 July 2021

Papers citing "Connectivity Matters: Neural Network Pruning Through the Lens of Effective Sparsity"

13 / 13 papers shown

Title
Learning effective pruning at initialization from iterative pruning Shengkai Liu Yaofeng Cheng Fusheng Zha Wei Guo Lining Sun Zhenshan Bing Chenguang Yang 35 0 0 27 Aug 2024
Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities Stephen Zhang V. Papyan 33 0 0 04 Jul 2024
Understanding Sparse Neural Networks from their Topology via Multipartite Graph Representations Elia Cunegatti Matteo Farina Doina Bucur Giovanni Iacca 35 1 0 26 May 2023
On Model Compression for Neural Networks: Framework, Algorithm, and Convergence Guarantee Chenyang Li Jihoon Chung Mengnan Du Haimin Wang Xianlian Zhou Bohao Shen 33 1 0 13 Mar 2023
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks Shiyu Liu Rohan Ghosh John Tan Chong Min Mehul Motani 29 0 0 09 Dec 2022
Neural Network Panning: Screening the Optimal Sparse Network Before Training Xiatao Kang P. Li Jiayi Yao Chengxi Li VLM 18 1 0 27 Sep 2022
One-shot Network Pruning at Initialization with Discriminative Image Patches Yinan Yang Yu Wang Yi Ji Heng Qi Jien Kato VLM 26 4 0 13 Sep 2022
Trainability Preserving Neural Pruning Huan Wang Yun Fu AAML 19 17 0 25 Jul 2022
Structured Pruning is All You Need for Pruning CNNs at Initialization Yaohui Cai Weizhe Hua Hongzheng Chen G. E. Suh Christopher De Sa Zhiru Zhang CVBM 39 14 0 04 Mar 2022
Sparsity Winning Twice: Better Robust Generalization from More Efficient Training Tianlong Chen Zhenyu (Allen) Zhang Pengju Wang Santosh Balachandra Haoyu Ma Zehao Wang Zhangyang Wang OOD AAML 77 46 0 20 Feb 2022
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI Jiangchao Yao Shengyu Zhang Yang Yao Feng Wang Jianxin Ma ... Kun Kuang Chao-Xiang Wu Fei Wu Jingren Zhou Hongxia Yang 18 91 0 11 Nov 2021
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,817 0 17 Sep 2019
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 950 20,561 0 17 Apr 2017