Correlated Noise in Epoch-Based Stochastic Gradient Descent: Implications for Weight Variances

8 June 2023

Papers citing "Correlated Noise in Epoch-Based Stochastic Gradient Descent: Implications for Weight Variances"

4 / 4 papers shown

Title
Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation Markus Gross A. Raulf Christoph Räth 40 0 0 23 Nov 2023
Stochastic Thermodynamics of Learning Parametric Probabilistic Models S. Parsi 42 0 0 04 Oct 2023
Stochastic Training is Not Necessary for Generalization Jonas Geiping Micah Goldblum Phillip E. Pope Michael Moeller Tom Goldstein 89 72 0 29 Sep 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 284 2,890 0 15 Sep 2016