Revisiting the Noise Model of Stochastic Gradient Descent

5 March 2023

Papers citing "Revisiting the Noise Model of Stochastic Gradient Descent"

5 / 5 papers shown

Title
Almost Bayesian: The Fractal Dynamics of Stochastic Gradient Descent Max Hennick Stijn De Baerdemacker 41 0 0 28 Mar 2025
From Gradient Clipping to Normalization for Heavy Tailed SGD Florian Hübler Ilyas Fatkhullin Niao He 40 5 0 17 Oct 2024
Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees Aleksandar Armacki Shuhua Yu Pranay Sharma Gauri Joshi Dragana Bajović D. Jakovetić S. Kar 55 2 0 17 Oct 2024
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework Siyuan Yu Wei Chen H. V. Poor 24 0 0 17 Jun 2024
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,888 0 15 Sep 2016