Are Straight-Through gradients and Soft-Thresholding all you need for
Sparse Training?

Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training?

2 December 2022

A. Vanderschueren

Christophe De Vleeschouwer

Papers citing "Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training?"

4 / 4 papers shown

Title
AdapMTL: Adaptive Pruning Framework for Multitask Learning Model Mingcan Xiang Steven Jiaxun Tang Qizheng Yang Hui Guan Tongping Liu VLM 34 0 0 07 Aug 2024
SequentialAttention++ for Block Sparsification: Differentiable Pruning Meets Combinatorial Optimization T. Yasuda Kyriakos Axiotis Gang Fu M. Bateni Vahab Mirrokni 41 0 0 27 Feb 2024
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 224 382 0 05 Mar 2020
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 950 20,561 0 17 Apr 2017