Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2001.01969
Cited By
v1
v2
v3 (latest)
Sparse Weight Activation Training
Neural Information Processing Systems (NeurIPS), 2020
7 January 2020
Md Aamir Raihan
Tor M. Aamodt
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Sparse Weight Activation Training"
28 / 28 papers shown
TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networks
Proceedings on Privacy Enhancing Technologies (PoPETs), 2025
Mohammad Maheri
Hamed Haddadi
Alex Davidson
415
7
0
27 Apr 2025
Federated LoRA with Sparse Communication
Kevin Kuo
Arian Raje
Kousik Rajesh
Virginia Smith
558
25
0
07 Jun 2024
Dual sparse training framework: inducing activation map sparsity via Transformed
ℓ
1
\ell1
ℓ
1
regularization
Xiaolong Yu
Cong Tian
250
3
0
30 May 2024
Safety and Performance, Why Not Both? Bi-Objective Optimized Model Compression against Heterogeneous Attacks Toward AI Software Deployment
IEEE Transactions on Software Engineering (TSE), 2024
Jie Zhu
Leye Wang
Xiao Han
Anmin Liu
Tao Xie
AAML
257
6
0
02 Jan 2024
Federated learning compression designed for lightweight communications
International Conference on Electronics, Circuits, and Systems (ICECS), 2023
Lucas Grativol Ribeiro
Mathieu Léonardon
Guillaume Muller
Virginie Fresse
Matthieu Arzel
FedML
225
5
0
23 Oct 2023
Rethinking Graph Lottery Tickets: Graph Sparsity Matters
International Conference on Learning Representations (ICLR), 2023
Bo Hui
Jocelyn M Mora
Adrian Dalca
I. Aganj
345
28
0
03 May 2023
Training Large Language Models Efficiently with Sparsity and Dataflow
V. Srinivasan
Darshan Gandhi
Urmish Thakker
R. Prabhakar
MoE
327
7
0
11 Apr 2023
SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer
Computer Vision and Pattern Recognition (CVPR), 2023
Xuanyao Chen
Zhijian Liu
Haotian Tang
Li Yi
Hang Zhao
Song Han
ViT
387
84
0
30 Mar 2023
SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks
International Conference on Machine Learning (ICML), 2023
Mahdi Nikdan
Tommaso Pegolotti
Eugenia Iofinova
Eldar Kurtic
Dan Alistarh
244
14
0
09 Feb 2023
Where to Pay Attention in Sparse Training for Feature Selection?
Neural Information Processing Systems (NeurIPS), 2022
Ghada Sokar
Zahra Atashgahi
Mykola Pechenizkiy
Decebal Constantin Mocanu
341
24
0
26 Nov 2022
VeriCompress: A Tool to Streamline the Synthesis of Verified Robust Compressed Neural Networks from Scratch
AAAI Conference on Artificial Intelligence (AAAI), 2022
Sawinder Kaur
Yi Xiao
Asif Salekin
473
0
0
17 Nov 2022
Exploiting the Partly Scratch-off Lottery Ticket for Quantization-Aware Training
Mingliang Xu
Gongrui Nan
Yuxin Zhang
Jiayi Ji
Rongrong Ji
MQ
338
3
0
12 Nov 2022
Diving into Unified Data-Model Sparsity for Class-Imbalanced Graph Representation Learning
Chunhui Zhang
Chao Huang
Yijun Tian
Qianlong Wen
Z. Ouyang
Youhuan Li
Yanfang Ye
Chuxu Zhang
170
8
0
01 Oct 2022
Safety and Performance, Why not Both? Bi-Objective Optimized Model Compression toward AI Software Deployment
International Conference on Automated Software Engineering (ASE), 2022
Jie Zhu
Leye Wang
Xiao Han
282
15
0
11 Aug 2022
ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity
International Conference on Learning Representations (ICLR), 2022
Xinchi Qiu
Javier Fernandez-Marques
Pedro Gusmão
Yan Gao
Titouan Parcollet
Nicholas D. Lane
FedML
238
87
0
04 Aug 2022
Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees
Neural Information Processing Systems (NeurIPS), 2022
Jue Wang
Binhang Yuan
Luka Rimanic
Yongjun He
Tri Dao
Beidi Chen
Christopher Ré
Ce Zhang
AI4CE
518
33
0
02 Jun 2022
Minimum Variance Unbiased N:M Sparsity for the Neural Gradients
International Conference on Learning Representations (ICLR), 2022
Brian Chmiel
Itay Hubara
Ron Banner
Daniel Soudry
290
11
0
21 Mar 2022
Sparsity Winning Twice: Better Robust Generalization from More Efficient Training
International Conference on Learning Representations (ICLR), 2022
Tianlong Chen
Zhenyu Zhang
Pengju Wang
Santosh Balachandra
Haoyu Ma
Zehao Wang
Zinan Lin
OOD
AAML
386
54
0
20 Feb 2022
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models
Tri Dao
Beidi Chen
Kaizhao Liang
Jiaming Yang
Zhao Song
Atri Rudra
Christopher Ré
485
94
0
30 Nov 2021
SMOF: Squeezing More Out of Filters Yields Hardware-Friendly CNN Pruning
CAAI International Conference on Artificial Intelligence (CAAI-ICAI), 2021
Yanli Liu
Bochen Guan
Qinwen Xu
Weiyi Li
Shuxue Quan
224
2
0
21 Oct 2021
Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse Networks
Ghada Sokar
Decebal Constantin Mocanu
Mykola Pechenizkiy
CLL
412
9
0
11 Oct 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity
International Conference on Learning Representations (ICLR), 2021
Shiwei Liu
Tianlong Chen
Zahra Atashgahi
Xiaohan Chen
Ghada Sokar
Elena Mocanu
Mykola Pechenizkiy
Zinan Lin
Decebal Constantin Mocanu
OOD
454
62
0
28 Jun 2021
Chasing Sparsity in Vision Transformers: An End-to-End Exploration
Neural Information Processing Systems (NeurIPS), 2021
Tianlong Chen
Yu Cheng
Zhe Gan
Lu Yuan
Lei Zhang
Zinan Lin
ViT
378
268
0
08 Jun 2021
Dynamic Sparse Training for Deep Reinforcement Learning
International Joint Conference on Artificial Intelligence (IJCAI), 2021
Ghada Sokar
Elena Mocanu
Decebal Constantin Mocanu
Mykola Pechenizkiy
Peter Stone
376
74
0
08 Jun 2021
Search Spaces for Neural Model Training
Darko Stosic
Dusan Stosic
190
5
0
27 May 2021
Truly Sparse Neural Networks at Scale
Selima Curci
Decebal Constantin Mocanu
Mykola Pechenizkiy
443
24
0
02 Feb 2021
Neural gradients are near-lognormal: improved quantized and sparse training
Brian Chmiel
Liad Ben-Uri
Moran Shkolnik
Elad Hoffer
Ron Banner
Daniel Soudry
MQ
319
5
0
15 Jun 2020
A Brain-inspired Algorithm for Training Highly Sparse Neural Networks
Zahra Atashgahi
Joost Pieterse
Shiwei Liu
Decebal Constantin Mocanu
Raymond N. J. Veldhuis
Mykola Pechenizkiy
418
20
0
17 Mar 2019
1
Page 1 of 1
