Penalising the biases in norm regularisation enforces sparsity

2 March 2023

Papers citing "Penalising the biases in norm regularisation enforces sparsity"

11 / 11 papers shown

Title
The Effects of Multi-Task Learning on ReLU Neural Network Functions Julia B. Nakhleh Joseph Shenouda Robert D. Nowak 25 1 0 29 Oct 2024
Simplicity bias and optimization threshold in two-layer ReLU networks Etienne Boursier Nicolas Flammarion 24 2 0 03 Oct 2024
Depth Separation in Norm-Bounded Infinite-Width Neural Networks Suzanna Parkinson Greg Ongie Rebecca Willett Ohad Shamir Nathan Srebro MDE 35 2 0 13 Feb 2024
How do Minimum-Norm Shallow Denoisers Look in Function Space? Chen Zeno Greg Ongie Yaniv Blumenfeld Nir Weinberger Daniel Soudry 11 8 0 12 Nov 2023
Minimum norm interpolation by perceptra: Explicit regularization and implicit bias Jiyoung Park Ian Pelakh Stephan Wojtowytsch 32 2 0 10 Nov 2023
Noisy Interpolation Learning with Shallow Univariate ReLU Networks Nirmit Joshi Gal Vardi Nathan Srebro 16 8 0 28 Jul 2023
Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs D. Chistikov Matthias Englert R. Lazic MLT 30 12 0 10 Jun 2023
From Tempered to Benign Overfitting in ReLU Neural Networks Guy Kornowski Gilad Yehudai Ohad Shamir 18 12 0 24 May 2023
ReLU Neural Networks with Linear Layers are Biased Towards Single- and Multi-Index Models Suzanna Parkinson Greg Ongie Rebecca Willett 57 6 0 24 May 2023
PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks Liu Yang Jifan Zhang Joseph Shenouda Dimitris Papailiopoulos Kangwook Lee Robert D. Nowak 36 1 0 06 Oct 2022
On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias Itay Safran Gal Vardi Jason D. Lee MLT 41 23 0 18 May 2022