ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2102.03869
  4. Cited By
Structured Sparsity Inducing Adaptive Optimizers for Deep Learning
v1v2 (latest)

Structured Sparsity Inducing Adaptive Optimizers for Deep Learning

7 February 2021
T. Deleu
Yoshua Bengio
    ODL
ArXiv (abs)PDFHTML

Papers citing "Structured Sparsity Inducing Adaptive Optimizers for Deep Learning"

16 / 16 papers shown
Differentiable Sparsity via $D$-Gating: Simple and Versatile Structured Penalization
Differentiable Sparsity via DDD-Gating: Simple and Versatile Structured Penalization
Chris Kolb
Laetitia Frost
J. Herbinger
David Rügamer
467
0
0
28 Sep 2025
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial SymmetriesInternational Conference on Learning Representations (ICLR), 2025
Chris Kolb
T. Weber
B. Bischl
David Rügamer
1.0K
10
0
04 Feb 2025
Meta-Sparsity: Learning Optimal Sparse Structures in Multi-task Networks through Meta-learning
Meta-Sparsity: Learning Optimal Sparse Structures in Multi-task Networks through Meta-learning
Richa Upadhyay
Ronald Phlypo
Rajkumar Saini
Marcus Liwicki
349
0
0
21 Jan 2025
HESSO: Towards Automatic Efficient and User Friendly Any Neural Network Training and Pruning
HESSO: Towards Automatic Efficient and User Friendly Any Neural Network Training and Pruning
Tianyi Chen
Xiaoyi Qu
David Aponte
Colby R. Banbury
Jongwoo Ko
Tianyu Ding
Yong Ma
Vladimir Lyapunov
Ilya Zharkov
Luming Liang
568
3
0
11 Sep 2024
Giving each task what it needs -- leveraging structured sparsity for
  tailored multi-task learning
Giving each task what it needs -- leveraging structured sparsity for tailored multi-task learning
Richa Upadhyay
Ronald Phlypo
Rajkumar Saini
Marcus Liwicki
MoE
351
1
0
05 Jun 2024
Hard-Thresholding Meets Evolution Strategies in Reinforcement Learning
Hard-Thresholding Meets Evolution Strategies in Reinforcement LearningInternational Joint Conference on Artificial Intelligence (IJCAI), 2024
Chengqian Gao
William de Vazelhes
Hualin Zhang
Bin Gu
Zhiqiang Xu
244
0
0
02 May 2024
Regularized Adaptive Momentum Dual Averaging with an Efficient Inexact
  Subproblem Solver for Training Structured Neural Network
Regularized Adaptive Momentum Dual Averaging with an Efficient Inexact Subproblem Solver for Training Structured Neural Network
Zih-Syuan Huang
Ching-pei Lee
183
0
0
21 Mar 2024
OTOv3: Automatic Architecture-Agnostic Neural Network Training and
  Compression from Structured Pruning to Erasing Operators
OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators
Tianyi Chen
Tianyu Ding
Zhihui Zhu
Zeyu Chen
HsiangTao Wu
Ilya Zharkov
Luming Liang
261
7
0
15 Dec 2023
Less is More -- Towards parsimonious multi-task models using structured
  sparsity
Less is More -- Towards parsimonious multi-task models using structured sparsity
Richa Upadhyay
Ronald Phlypo
Rajkumar Saini
Marcus Liwicki
MoE
277
3
0
23 Aug 2023
Automated Search-Space Generation Neural Architecture Search
Automated Search-Space Generation Neural Architecture Search
Tianyi Chen
Luming Liang
Tian Ding
Ilya Zharkov
AI4CE
314
1
0
25 May 2023
OTOV2: Automatic, Generic, User-Friendly
OTOV2: Automatic, Generic, User-FriendlyInternational Conference on Learning Representations (ICLR), 2023
Tianyi Chen
Luming Liang
Tian Ding
Zhihui Zhu
Ilya Zharkov
VLMMQ
305
51
0
13 Mar 2023
The Contextual Lasso: Sparse Linear Models via Deep Neural Networks
The Contextual Lasso: Sparse Linear Models via Deep Neural NetworksNeural Information Processing Systems (NeurIPS), 2023
Ryan Thompson
Amir Dezfouli
Robert Kohn
496
7
0
02 Feb 2023
Unsupervised Detection of Contextualized Embedding Bias with Application
  to Ideology
Unsupervised Detection of Contextualized Embedding Bias with Application to IdeologyInternational Conference on Machine Learning (ICML), 2022
Valentin Hofmann
J. Pierrehumbert
Hinrich Schütze
347
1
0
14 Dec 2022
Training Structured Neural Networks Through Manifold Identification and
  Variance Reduction
Training Structured Neural Networks Through Manifold Identification and Variance ReductionInternational Conference on Learning Representations (ICLR), 2021
Zih-Syuan Huang
Ching-pei Lee
AAML
291
10
0
05 Dec 2021
Only Train Once: A One-Shot Neural Network Training And Pruning
  Framework
Only Train Once: A One-Shot Neural Network Training And Pruning FrameworkNeural Information Processing Systems (NeurIPS), 2021
Tianyi Chen
Bo Ji
Tianyu Ding
Biyi Fang
Guanyi Wang
Zhihui Zhu
Luming Liang
Yixin Shi
Sheng Yi
Xiao Tu
289
132
0
15 Jul 2021
Modeling Ideological Salience and Framing in Polarized Online Groups
  with Graph Neural Networks and Structured Sparsity
Modeling Ideological Salience and Framing in Polarized Online Groups with Graph Neural Networks and Structured Sparsity
Valentin Hofmann
Xiaowen Dong
J. Pierrehumbert
Hinrich Schütze
364
18
0
18 Apr 2021
1
Page 1 of 1