Effective Sparsification of Neural Networks with Global Sparsity Constraint

3 May 2021

Xiao Zhou

Weizhong Zhang

Hang Xu

Tong Zhang

ArXiv PDF HTML

Papers citing "Effective Sparsification of Neural Networks with Global Sparsity Constraint"

43 / 43 papers shown

Title
Hadamard product in deep learning: Introduction, Advances and Challenges Grigorios G. Chrysos Yongtao Wu Razvan Pascanu Philip Torr V. Cevher AAML 98 0 0 17 Apr 2025
Advancing Weight and Channel Sparsification with Enhanced Saliency Xinglong Sun Maying Shen Hongxu Yin Lei Mao Pavlo Molchanov Jose M. Alvarez 46 1 0 05 Feb 2025
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries Chris Kolb T. Weber Bernd Bischl David Rügamer 109 0 0 04 Feb 2025
Multi-Objective Hyperparameter Selection via Hypothesis Testing on Reliability Graphs Amirmohammad Farzaneh Osvaldo Simeone 86 0 0 22 Jan 2025
Meta-Sparsity: Learning Optimal Sparse Structures in Multi-task Networks through Meta-learning Richa Upadhyay Ronald Phlypo Rajkumar Saini Marcus Liwicki 35 0 0 21 Jan 2025
Mask in the Mirror: Implicit Sparsification Tom Jacobs R. Burkholz 42 3 0 19 Aug 2024
Fast and Controllable Post-training Sparsity: Learning Optimal Sparsity Allocation with Global Constraint in Minutes Ruihao Gong Yang Yong Zining Wang Jinyang Guo Xiuying Wei Yuqing Ma Xianglong Liu 31 5 0 09 May 2024
Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World Bowen Lei Dongkuan Xu Ruqi Zhang Bani Mallick UQCV 33 0 0 29 Mar 2024
Exploring Diffusion Time-steps for Unsupervised Representation Learning Zhongqi Yue Jiankun Wang Qianru Sun Lei Ji E. Chang Hanwang Zhang DiffM 36 21 0 21 Jan 2024
How Does Perception Affect Safety: New Metrics and Strategy Xiaotong Zhang Jinger Chong Kamal Youcef-Toumi 11 3 0 12 Dec 2023
Towards Higher Ranks via Adversarial Weight Pruning Yuchuan Tian Hanting Chen Tianyu Guo Chao Xu Yunhe Wang 22 2 0 29 Nov 2023
Efficient Symbolic Policy Learning with Differentiable Symbolic Expression Jiaming Guo Rui Zhang Shaohui Peng Qi Yi Xingui Hu ... Zidong Du Xishan Zhang Ling Li Qi Guo Yunji Chen OffRL 17 5 0 02 Nov 2023
Feather: An Elegant Solution to Effective DNN Sparsification Athanasios Glentis Georgoulakis George Retsinas Petros Maragos 22 0 0 03 Oct 2023
Multi-Objective Optimization for Sparse Deep Multi-Task Learning S. S. Hotegni M. Berkemeier S. Peitz 15 6 0 23 Aug 2023
Efficient Joint Optimization of Layer-Adaptive Weight Pruning in Deep Neural Networks Kaixin Xu Zhe Wang Xue Geng Jie Lin Min-man Wu Xiaoli Li Weisi Lin 18 15 0 21 Aug 2023
Graph Relation Aware Continual Learning Q. Shen Weijieying Ren Wei Qin CLL BDL 18 2 0 16 Aug 2023
Magnitude Attention-based Dynamic Pruning Jihye Back Namhyuk Ahn Jang-Hyun Kim 25 2 0 08 Jun 2023
Constrained Probabilistic Mask Learning for Task-specific Undersampled MRI Reconstruction Tobias Weber Michael Ingrisch Bernd Bischl David Rügamer 27 2 0 25 May 2023
Effective Neural Network $L_0$ Regularization With BinMask Kai Jia Martin Rinard 21 3 0 21 Apr 2023
NTK-SAP: Improving neural network pruning by aligning training dynamics Yite Wang Dawei Li Ruoyu Sun 28 19 0 06 Apr 2023
Balanced Training for Sparse GANs Yite Wang Jing Wu N. Hovakimyan Ruoyu Sun 32 9 0 28 Feb 2023
A Unified Framework for Soft Threshold Pruning Yanqing Chen Zhengyu Ma Wei Fang Xiawu Zheng Zhaofei Yu Yonghong Tian 80 19 0 25 Feb 2023
Calibrating the Rigged Lottery: Making All Tickets Reliable Bowen Lei Ruqi Zhang Dongkuan Xu Bani Mallick UQCV 16 7 0 18 Feb 2023
Probabilistic Bilevel Coreset Selection Xiao Zhou Renjie Pi Weizhong Zhang Yong Lin Tong Zhang NoLa 20 27 0 24 Jan 2023
Model Agnostic Sample Reweighting for Out-of-Distribution Learning Xiao Zhou Yong Lin Renjie Pi Weizhong Zhang Renzhe Xu Peng Cui Tong Zhang OODD 28 60 0 24 Jan 2023
Balance is Essence: Accelerating Sparse Training via Adaptive Gradient Correction Bowen Lei Dongkuan Xu Ruqi Zhang Shuren He Bani Mallick 27 6 0 09 Jan 2023
Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training? A. Vanderschueren Christophe De Vleeschouwer MQ 17 9 0 02 Dec 2022
Deep Differentiable Logic Gate Networks Felix Petersen Christian Borgelt Hilde Kuehne Oliver Deussen AI4CE 22 23 0 15 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 39 68 0 08 Oct 2022
Controlled Sparsity via Constrained Optimization or: How I Learned to Stop Tuning Penalties and Love Constraints Jose Gallego-Posada Juan Ramirez Akram Erraqabi Yoshua Bengio Simon Lacoste-Julien 25 16 0 08 Aug 2022
Not All Models Are Equal: Predicting Model Transferability in a Self-challenging Fisher Space Wenqi Shao Xun Zhao Yixiao Ge Zhaoyang Zhang Lei Yang Xiaogang Wang Ying Shan Ping Luo 16 26 0 07 Jul 2022
Write and Paint: Generative Vision-Language Models are Unified Modal Learners Shizhe Diao Wangchunshu Zhou Xinsong Zhang Jiawei Wang MLLM AI4CE 14 16 0 15 Jun 2022
VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models Wangchunshu Zhou Yan Zeng Shizhe Diao Xinsong Zhang CoGe VLM 21 13 0 30 May 2022
Spartan: Differentiable Sparsity via Regularized Transportation Kai Sheng Tai Taipeng Tian Ser-Nam Lim 17 11 0 27 May 2022
Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey Paul Wimmer Jens Mehnert A. P. Condurache DD 34 20 0 17 May 2022
CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving Kaican Li Kai Chen Haoyu Wang Lanqing Hong Chao Ye ... Chunjing Xu Dit-Yan Yeung Xiaodan Liang Zhenguo Li Hang Xu 11 97 0 15 Mar 2022
Finding Dynamics Preserving Adversarial Winning Tickets Xupeng Shi Pengfei Zheng Adam Ding Yuan Gao Weizhong Zhang AAML 18 1 0 14 Feb 2022
Exploring Structural Sparsity in Neural Image Compression Shan Yin Chao Li Wen-Tao Tan Youneng Bao Yongsheng Liang Wei Liu 10 9 0 09 Feb 2022
Hidden-Fold Networks: Random Recurrent Residuals Using Sparse Supermasks Ángel López García-Arias Masanori Hashimoto Masato Motomura Jaehoon Yu 31 5 0 24 Nov 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification Xiao Zhou Weizhong Zhang Zonghao Chen Shizhe Diao Tong Zhang 26 46 0 10 Nov 2021
Connectivity Matters: Neural Network Pruning Through the Lens of Effective Sparsity Artem Vysogorets Julia Kempe 13 19 0 05 Jul 2021
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 222 382 0 05 Mar 2020
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 950 20,561 0 17 Apr 2017