Structured Sparsity Inducing Adaptive Optimizers for Deep Learning

v1v2 (latest)

Structured Sparsity Inducing Adaptive Optimizers for Deep Learning

7 February 2021

ArXiv (abs)PDF HTML

Papers citing "Structured Sparsity Inducing Adaptive Optimizers for Deep Learning"

8 / 8 papers shown

Title
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries Chris Kolb T. Weber Bernd Bischl David Rügamer 367 1 0 04 Feb 2025
Meta-Sparsity: Learning Optimal Sparse Structures in Multi-task Networks through Meta-learning Richa Upadhyay Ronald Phlypo Rajkumar Saini Marcus Liwicki 114 0 0 21 Jan 2025
HESSO: Towards Automatic Efficient and User Friendly Any Neural Network Training and Pruning Tianyi Chen Xiaoyi Qu David Aponte Colby R. Banbury Jongwoo Ko Tianyu Ding Yong Ma Vladimir Lyapunov Ilya Zharkov Luming Liang 169 2 0 11 Sep 2024
The Contextual Lasso: Sparse Linear Models via Deep Neural Networks Ryan Thompson Amir Dezfouli Robert Kohn 95 6 0 02 Feb 2023
Unsupervised Detection of Contextualized Embedding Bias with Application to Ideology Valentin Hofmann J. Pierrehumbert Hinrich Schütze 107 0 0 14 Dec 2022
Training Structured Neural Networks Through Manifold Identification and Variance Reduction Zih-Syuan Huang Ching-pei Lee AAML 93 9 0 05 Dec 2021
Only Train Once: A One-Shot Neural Network Training And Pruning Framework Tianyi Chen Bo Ji Tianyu Ding Biyi Fang Guanyi Wang Zhihui Zhu Luming Liang Yixin Shi Sheng Yi Xiao Tu 127 105 0 15 Jul 2021
Modeling Ideological Salience and Framing in Polarized Online Groups with Graph Neural Networks and Structured Sparsity Valentin Hofmann Xiaowen Dong J. Pierrehumbert Hinrich Schütze 48 15 0 18 Apr 2021