ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2302.02596
  4. Cited By
Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook
  for Sparse Neural Network Researchers
v1v2v3 (latest)

Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook for Sparse Neural Network Researchers

6 February 2023
Shiwei Liu
Zinan Lin
ArXiv (abs)PDFHTMLHuggingFace (1 upvotes)Github

Papers citing "Ten Lessons We Have Learned in the New "Sparseland": A Short Handbook for Sparse Neural Network Researchers"

15 / 15 papers shown
Batch Matrix-form Equations and Implementation of Multilayer Perceptrons
Batch Matrix-form Equations and Implementation of Multilayer Perceptrons
Wieger Wesselink
Bram Grooten
Huub van de Wetering
Q. Xiao
Decebal Constantin Mocanu
108
0
0
14 Nov 2025
E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentation
E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image SegmentationNeural Information Processing Systems (NeurIPS), 2023
Boqian Wu
Q. Xiao
Shiwei Liu
Lu Yin
Mykola Pechenizkiy
Decebal Constantin Mocanu
M. V. Keulen
Elena Mocanu
MedIm
507
19
0
20 Feb 2025
Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity
Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity
Alessandro Pierro
Steven Abreu
Jonathan Timcheck
Philipp Stratmann
Andreas Wild
S. Shrestha
414
6
0
03 Feb 2025
Navigating Extremes: Dynamic Sparsity in Large Output Spaces
Navigating Extremes: Dynamic Sparsity in Large Output SpacesNeural Information Processing Systems (NeurIPS), 2024
Nasib Ullah
Erik Schultheis
Mike Lasby
Yani Andrew Ioannou
Rohit Babbar
514
3
0
05 Nov 2024
Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption Robustness
Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption RobustnessInternational Conference on Learning Representations (ICLR), 2024
Boqian Wu
Q. Xiao
Shunxin Wang
N. Strisciuglio
Mykola Pechenizkiy
M. V. Keulen
Decebal Constantin Mocanu
Elena Mocanu
OOD3DH
549
7
0
03 Oct 2024
Importance Estimation with Random Gradient for Neural Network Pruning
Importance Estimation with Random Gradient for Neural Network Pruning
Suman Sapkota
Binod Bhattarai
273
2
0
31 Oct 2023
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High SparsityInternational Conference on Machine Learning (ICML), 2023
Lu Yin
You Wu
Zhenyu Zhang
Cheng-Yu Hsieh
Yaqing Wang
...
Mykola Pechenizkiy
Yi Liang
Michael Bendersky
Zinan Lin
Shiwei Liu
684
170
0
08 Oct 2023
A Theoretical Explanation of Activation Sparsity through Flat Minima and
  Adversarial Robustness
A Theoretical Explanation of Activation Sparsity through Flat Minima and Adversarial Robustness
Ze Peng
Lei Qi
Yinghuan Shi
Yang Gao
405
7
0
06 Sep 2023
Continual Learning with Dynamic Sparse Training: Exploring Algorithms
  for Effective Model Updates
Continual Learning with Dynamic Sparse Training: Exploring Algorithms for Effective Model Updates
Murat Onur Yildirim
Elif Ceren Gok Yildirim
Ghada Sokar
Decebal Constantin Mocanu
Joaquin Vanschoren
CLL
370
15
0
28 Aug 2023
Vision Transformers for Mobile Applications: A Short Survey
Vision Transformers for Mobile Applications: A Short Survey
Nahid Alam
Steven Kolawole
S. Sethi
Nishant Bansali
Karina Nguyen
ViT
209
4
0
30 May 2023
Adaptive Sparsity Level during Training for Efficient Time Series
  Forecasting with Transformers
Adaptive Sparsity Level during Training for Efficient Time Series Forecasting with Transformers
Zahra Atashgahi
Mykola Pechenizkiy
Raymond N. J. Veldhuis
Decebal Constantin Mocanu
AI4TSAI4CE
343
2
0
28 May 2023
Visual Tuning
Visual TuningACM Computing Surveys (ACM Comput. Surv.), 2023
Bruce X. B. Yu
Jianlong Chang
Haixin Wang
Lin Liu
Shijie Wang
...
Lingxi Xie
Haojie Li
Zhouchen Lin
Qi Tian
Chang Wen Chen
VLM
534
64
0
10 May 2023
Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!
Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!International Conference on Learning Representations (ICLR), 2023
Shiwei Liu
Tianlong Chen
Zhenyu Zhang
Xuxi Chen
Tianjin Huang
Ajay Jaiswal
Zinan Lin
285
31
0
03 Mar 2023
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation
  Invariant Transformation
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant TransformationSymposium on Operating Systems Principles (SOSP), 2023
Ningxin Zheng
Huiqiang Jiang
Quan Zhang
Zhenhua Han
Yuqing Yang
...
Fan Yang
Chengruidong Zhang
Lili Qiu
Mao Yang
Lidong Zhou
258
39
0
26 Jan 2023
Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing
  Performance
Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing PerformanceInternational Journal of Computer Vision (IJCV), 2022
Shiwei Liu
Yuesong Tian
Tianlong Chen
Li Shen
346
14
0
05 Mar 2022
1
Page 1 of 1