v1v2 (latest)

Implicit Sparse Regularization: The Impact of Depth and Early Stopping

12 August 2021

Papers citing "Implicit Sparse Regularization: The Impact of Depth and Early Stopping"

21 / 21 papers shown

Title
Sign-In to the Lottery: Reparameterizing Sparse Training From Scratch Advait Gadhikar Tom Jacobs Chao Zhou R. Burkholz 74 0 0 17 Apr 2025
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries Chris Kolb T. Weber Bernd Bischl David Rügamer 367 1 0 04 Feb 2025
Tuning-Free Online Robust Principal Component Analysis through Implicit Regularization Lakshmi Jayalal Gokularam Muthukrishnan Sheetal Kalyani 26 0 0 11 Sep 2024
Improving Adaptivity via Over-Parameterization in Sequence Models Yicheng Li Qian Lin 76 1 0 02 Sep 2024
Mask in the Mirror: Implicit Sparsification Tom Jacobs R. Burkholz 191 4 0 19 Aug 2024
Towards understanding epoch-wise double descent in two-layer linear neural networks Amanda Olmin Fredrik Lindsten MLT 91 4 0 13 Jul 2024
FTMixer: Frequency and Time Domain Representations Fusion for Time Series Modeling Zhengnan Li Yunxiao Qin Xilong Cheng Yuting Tan AI4TS 98 3 0 24 May 2024
Implicit Regularization of Gradient Flow on One-Layer Softmax Attention Heejune Sheen Siyu Chen Tianhao Wang Harrison H. Zhou MLT 87 13 0 13 Mar 2024
Implicit Regularization in Over-Parameterized Support Vector Machine Yang Sui Xin He Yang Bai 38 0 0 26 Oct 2023
Representation Learning Dynamics of Self-Supervised Models Pascal Esser Satyaki Mukherjee Debarghya Ghoshdastidar SSL 80 3 0 05 Sep 2023
Implicit regularization in AI meets generalized hardness of approximation in optimization -- Sharp results for diagonal linear networks J. S. Wind Vegard Antun A. Hansen 64 4 0 13 Jul 2023
Robust Sparse Mean Estimation via Incremental Learning Jianhao Ma Ruidi Chen Yinghui He Salar Fattahi Wei Hu 67 0 0 24 May 2023
Robust Implicit Regularization via Weight Normalization H. Chou Holger Rauhut Rachel A. Ward 88 7 0 09 May 2023
Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression Mo Zhou Rong Ge 121 2 0 01 Feb 2023
Implicit Regularization for Group Sparsity Jiangyuan Li THANH VAN NGUYEN Chinmay Hegde Raymond K. W. Wong 94 9 0 29 Jan 2023
Balance is Essence: Accelerating Sparse Training via Adaptive Gradient Correction Bowen Lei Dongkuan Xu Ruqi Zhang Shuren He Bani Mallick 117 6 0 09 Jan 2023
Incremental Learning in Diagonal Linear Networks Raphael Berthier CLL AI4CE 93 17 0 31 Aug 2022
Blessing of Nonconvexity in Deep Linear Models: Depth Flattens the Optimization Landscape Around the True Solution Jianhao Ma Salar Fattahi 75 5 0 15 Jul 2022
Robust Training under Label Noise by Over-parameterization Sheng Liu Zhihui Zhu Qing Qu Chong You NoLa OOD 77 109 0 28 Feb 2022
Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression Jing Xu Jiaye Teng Yang Yuan Andrew Chi-Chih Yao 86 2 0 12 Feb 2022
More is Less: Inducing Sparsity via Overparameterization H. Chou J. Maly Holger Rauhut 136 25 0 21 Dec 2021