206

Closed-form r\ell_r norm scaling with data for overparameterized linear regression and diagonal linear networks under p\ell_p bias

Main:9 Pages
20 Figures
Bibliography:4 Pages
Appendix:28 Pages
Abstract

For overparameterized linear regression with isotropic Gaussian design and minimum-p\ell_p interpolator p(1,2]p\in(1,2], we give a unified, high-probability characterization for the scaling of the family of parameter norms $ \\{ \lVert \widehat{w_p} \rVert_r \\}_{r \in [1,p]} $ with sample size.

View on arXiv
Comments on this paper