Towards Resolving the Implicit Bias of Gradient Descent for Matrix
Factorization: Greedy Low-Rank Learning

v1v2 (latest)

Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning

17 December 2020

ArXiv (abs)PDF HTML

Papers citing "Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning"

5 / 105 papers shown

Title
Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm Meena Jagadeesan Ilya P. Razenshteyn Suriya Gunasekar 99 21 0 24 Feb 2021
Implicit Regularization in Tensor Factorization Noam Razin Asaf Maman Nadav Cohen 75 49 0 19 Feb 2021
On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent Shahar Azulay E. Moroshko Mor Shpigel Nacson Blake E. Woodworth Nathan Srebro Amir Globerson Daniel Soudry AI4CE 89 74 0 19 Feb 2021
Implicit Regularization in ReLU Networks with the Square Loss Gal Vardi Ohad Shamir 80 51 0 09 Dec 2020
Understanding Implicit Regularization in Over-Parameterized Single Index Model Jianqing Fan Zhuoran Yang Mengxin Yu 81 18 0 16 Jul 2020