SGD Implicitly Regularizes Generalization Error

10 April 2021

Papers citing "SGD Implicitly Regularizes Generalization Error"

11 / 11 papers shown

Title
Overfitting has a limitation: a model-independent generalization error bound based on Rényi entropy Atsushi Suzuki 20 0 0 30 May 2025
How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD Pierfrancesco Beneventano Andrea Pinto Tomaso A. Poggio MLT 56 1 0 17 Jun 2024
Implicit meta-learning may lead language models to trust more reliable sources Dmitrii Krasheninnikov Egor Krasheninnikov Bruno Mlodozeniec Tegan Maharaj David M. Krueger 74 4 0 23 Oct 2023
Transgressing the boundaries: towards a rigorous understanding of deep learning and its (non-)robustness C. Hartmann Lorenz Richter AAML 57 2 0 05 Jul 2023
Noise Injection as a Probe of Deep Learning Dynamics Noam Levi I. Bloch M. Freytsis T. Volansky 72 2 0 24 Oct 2022
Rethinking Sharpness-Aware Minimization as Variational Inference Szilvia Ujváry Zsigmond Telek A. Kerekes Anna Mészáros Ferenc Huszár 63 8 0 19 Oct 2022
Stochastic Training is Not Necessary for Generalization Jonas Geiping Micah Goldblum Phillip E. Pope Michael Moeller Tom Goldstein 173 76 0 29 Sep 2021
Generalization by design: Shortcuts to Generalization in Deep Learning P. Táborský Lars Kai Hansen OOD AI4CE 20 0 0 05 Jul 2021
On the benefits of representation regularization in invariance based domain generalization Changjian Shui Boyu Wang Christian Gagné OOD 60 25 0 30 May 2021
On the Origin of Implicit Regularization in Stochastic Gradient Descent Samuel L. Smith Benoit Dherin David Barrett Soham De MLT 62 204 0 28 Jan 2021
Implicit Gradient Regularization David Barrett Benoit Dherin 101 152 0 23 Sep 2020