High dimensional analysis reveals conservative sharpening and a stochastic edge of stability

30 April 2024

Papers citing "High dimensional analysis reveals conservative sharpening and a stochastic edge of stability"

3 / 3 papers shown

Title
Stepping on the Edge: Curvature Aware Learning Rate Tuners Vincent Roulet Atish Agarwala Jean-Bastien Grill Grzegorz Swirszcz Mathieu Blondel Fabian Pedregosa 26 1 0 08 Jul 2024
Does SGD really happen in tiny subspaces? Minhak Song Kwangjun Ahn Chulhee Yun 53 4 1 25 May 2024
Neglected Hessian component explains mysteries in Sharpness regularization Yann N. Dauphin Atish Agarwala Hossein Mobahi FAtt 23 7 0 19 Jan 2024