Exact Mean Square Linear Stability Analysis for SGD

13 June 2023

Papers citing "Exact Mean Square Linear Stability Analysis for SGD"

3 / 3 papers shown

Title
High dimensional analysis reveals conservative sharpening and a stochastic edge of stability Atish Agarwala Jeffrey Pennington 38 3 0 30 Apr 2024
Type-II Saddles and Probabilistic Stability of Stochastic Gradient Descent Liu Ziyin Botao Li Tomer Galanti Masakuni Ueda 32 7 0 23 Mar 2023
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,878 0 15 Sep 2016