Training Sparse Neural Networks

21 November 2016

Papers citing "Training Sparse Neural Networks"

35 / 35 papers shown

Title
SAND: One-Shot Feature Selection with Additive Noise Distortion P. Pad Hadi Hammoud Mohamad Dia Nadim Maamari L. A. Dunbar 28 0 0 06 May 2025
Advancing Weight and Channel Sparsification with Enhanced Saliency Xinglong Sun Maying Shen Hongxu Yin Lei Mao Pavlo Molchanov Jose M. Alvarez 54 1 0 05 Feb 2025
Efficient Sparse Training with Structured Dropout Andy Lo BDL 35 0 0 02 Nov 2024
Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models Philipp Mondorf Sondre Wold Barbara Plank 39 0 0 02 Oct 2024
DSFormer: Effective Compression of Text-Transformers by Dense-Sparse Weight Factorization Rahul Chand Yashoteja Prabhu Pratyush Kumar 20 3 0 20 Dec 2023
AutoReP: Automatic ReLU Replacement for Fast Private Network Inference Hongwu Peng Shaoyi Huang Tong Zhou Yukui Luo Chenghong Wang ... Tony Geng Kaleel Mahmood Wujie Wen Xiaolin Xu Caiwen Ding OffRL 47 38 0 20 Aug 2023
NTK-SAP: Improving neural network pruning by aligning training dynamics Yite Wang Dawei Li Ruoyu Sun 42 19 0 06 Apr 2023
Learning Sparsity of Representations with Discrete Latent Variables Zhao Xu Daniel Oñoro-Rubio G. Serra Mathias Niepert 13 0 0 03 Apr 2023
Balanced Training for Sparse GANs Yite Wang Jing Wu N. Hovakimyan Ruoyu Sun 48 9 0 28 Feb 2023
Spatial Mixture-of-Experts Nikoli Dryden Torsten Hoefler MoE 36 9 0 24 Nov 2022
Streaming, fast and accurate on-device Inverse Text Normalization for Automatic Speech Recognition Yashesh Gaur Nick Kibre Jian Xue Kangyuan Shu Yuhui Wang Issac Alphonso Jinyu Li Jiawei Liu 16 6 0 07 Nov 2022
Sequential Attention for Feature Selection T. Yasuda M. Bateni Lin Chen Matthew Fahrbach Gang Fu Vahab Mirrokni 39 11 0 29 Sep 2022
Sparse Vicious Attacks on Graph Neural Networks Giovanni Trappolini Valentino Maiorca Silvio Severino Emanuele Rodolà Fabrizio Silvestri Gabriele Tolomei AAML 30 8 0 20 Sep 2022
Accelerating Attention through Gradient-Based Learned Runtime Pruning Zheng Li Soroush Ghodrati Amir Yazdanbakhsh H. Esmaeilzadeh Mingu Kang 27 17 0 07 Apr 2022
Sparse Federated Learning with Hierarchical Personalized Models Xiaofeng Liu Qing Wang Yunfeng Shao Yinchuan Li FedML 47 11 0 25 Mar 2022
Pruning-aware Sparse Regularization for Network Pruning Nanfei Jiang Xu Zhao Chaoyang Zhao Yongqi An Ming Tang Jinqiao Wang 3DPC 24 12 0 18 Jan 2022
Enhanced Exploration in Neural Feature Selection for Deep Click-Through Rate Prediction Models via Ensemble of Gating Layers L. Guan Xia Xiao Ming-yue Chen Youlong Cheng 27 1 0 07 Dec 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification Xiao Zhou Weizhong Zhang Zonghao Chen Shizhe Diao Tong Zhang 37 46 0 10 Nov 2021
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models J. Tan C. Chan Joon Huang Chuah VLM 51 16 0 07 Oct 2021
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration Shiwei Liu Tianlong Chen Xiaohan Chen Zahra Atashgahi Lu Yin Huanyu Kou Li Shen Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu 40 111 0 19 Jun 2021
Effective Sparsification of Neural Networks with Global Sparsity Constraint Xiao Zhou Weizhong Zhang Hang Xu Tong Zhang 21 61 0 03 May 2021
Lottery Jackpots Exist in Pre-trained Models Yuxin Zhang Mingbao Lin Yan Wang Rongrong Ji Rongrong Ji 30 15 0 18 Apr 2021
Neural Network for Weighted Signal Temporal Logic Ruixuan Yan A. Julius AI4TS 24 10 0 08 Apr 2021
On the Robustness of Monte Carlo Dropout Trained with Noisy Labels Purvi Goel Li Chen NoLa 36 15 0 22 Mar 2021
DiffPrune: Neural Network Pruning with Deterministic Approximate Binary Gates and $L_0$ Regularization Yaniv Shulman 46 3 0 07 Dec 2020
Layer Pruning via Fusible Residual Convolutional Block for Deep Neural Networks Pengtao Xu Jian Cao Fanhua Shang Wenyu Sun Pu Li 3DPC 20 24 0 29 Nov 2020
Rethinking Weight Decay For Efficient Neural Network Pruning Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel T. Hannagan David Bertrand 26 25 0 20 Nov 2020
Dynamic Hard Pruning of Neural Networks at the Edge of the Internet Lorenzo Valerio F. M. Nardini A. Passarella R. Perego 25 12 0 17 Nov 2020
Principal Component Networks: Parameter Reduction Early in Training R. Waleffe Theodoros Rekatsinas 3DPC 11 9 0 23 Jun 2020
Learned Threshold Pruning K. Azarian Yash Bhalgat Jinwon Lee Tijmen Blankevoort MQ 28 38 0 28 Feb 2020
Discrimination-aware Network Pruning for Deep Model Compression Jing Liu Bohan Zhuang Zhuangwei Zhuang Yong Guo Junzhou Huang Jin-Hui Zhu Mingkui Tan CVBM 19 119 0 04 Jan 2020
Image Captioning with Sparse Recurrent Neural Network J. Tan Chee Seng Chan Joon Huang Chuah VLM 29 6 0 28 Aug 2019
Model Slicing for Supporting Complex Analytics with Elastic Inference Cost and Resource Constraints Shaofeng Cai Gang Chen Beng Chin Ooi Jinyang Gao 25 19 0 03 Apr 2019
Deep Expander Networks: Efficient Deep Networks from Graph Theory Ameya Prabhu G. Varma A. Namboodiri GNN 30 70 0 23 Nov 2017
On the stable recovery of deep structured linear networks under sparsity constraints F. Malgouyres 27 7 0 31 May 2017