Can Implicit Bias Explain Generalization? Stochastic Convex Optimization
as a Case Study

Can Implicit Bias Explain Generalization? Stochastic Convex Optimization as a Case Study

13 March 2020

Papers citing "Can Implicit Bias Explain Generalization? Stochastic Convex Optimization as a Case Study"

18 / 18 papers shown

Title
Implicit Regularization in Deep Matrix Factorization Sanjeev Arora Nadav Cohen Wei Hu Yuping Luo AI4CE 64 500 0 31 May 2019
Uniform convergence may be unable to explain generalization in deep learning Vaishnavh Nagarajan J. Zico Kolter MoMe AI4CE 46 314 0 13 Feb 2019
A Continuous-Time View of Early Stopping for Least Squares Alnur Ali J. Zico Kolter Robert Tibshirani 40 96 0 23 Oct 2018
Implicit Bias of Gradient Descent on Linear Convolutional Networks Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro MDE 54 408 0 01 Jun 2018
Convergence of Gradient Descent on Separable Data Mor Shpigel Nacson Jason D. Lee Suriya Gunasekar Pedro H. P. Savarese Nathan Srebro Daniel Soudry 60 167 0 05 Mar 2018
Characterizing Implicit Bias in Terms of Optimization Geometry Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro AI4CE 62 404 0 22 Feb 2018
The Implicit Bias of Gradient Descent on Separable Data Daniel Soudry Elad Hoffer Mor Shpigel Nacson Suriya Gunasekar Nathan Srebro 74 908 0 27 Oct 2017
Implicit Regularization in Deep Learning Behnam Neyshabur 35 145 0 06 Sep 2017
Early stopping for kernel boosting algorithms: A general analysis with localized complexities Yuting Wei Fanny Yang Martin J. Wainwright 31 77 0 05 Jul 2017
Implicit Regularization in Matrix Factorization Suriya Gunasekar Blake E. Woodworth Srinadh Bhojanapalli Behnam Neyshabur Nathan Srebro 65 490 0 25 May 2017
Geometry of Optimization and Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Ruslan Salakhutdinov Nathan Srebro AI4CE 47 132 0 08 May 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 269 4,620 0 10 Nov 2016
Generalization of ERM in Stochastic Convex Optimization: The Dimension Strikes Back Vitaly Feldman 28 68 0 15 Aug 2016
Generalization Properties and Implicit Regularization for Multiple Passes SGM Junhong Lin Raffaello Camoriano Lorenzo Rosasco 51 70 0 26 May 2016
Train faster, generalize better: Stability of stochastic gradient descent Moritz Hardt Benjamin Recht Y. Singer 96 1,234 0 03 Sep 2015
In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Nathan Srebro AI4CE 78 655 0 20 Dec 2014
Early stopping and non-parametric regression: An optimal data-dependent stopping rule Garvesh Raskutti Martin J. Wainwright Bin Yu 59 299 0 15 Jun 2013
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 134 573 0 08 Dec 2012