Papers citing 'Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond'

Title
Gradient Descent with Large Step Sizes: Chaos and Fractal Convergence Region Shuang Liang Guido Montúfar 203 0 0 29 Sep 2025
Variational Learning Finds Flatter Solutions at the Edge of Stability Avrajit Ghosh Bai Cong Rio Yokota S. Ravishankar Rongrong Wang Molei Tao Mohammad Emtiyaz Khan Thomas Möllenhoff MLT 306 1 0 15 Jun 2025
Understanding Sharpness Dynamics in NN Training with a Minimalist Example: The Effects of Dataset Difficulty, Depth, Stochasticity, and More Geonhui Yoo Minhak Song Chulhee Yun FAtt 171 1 0 07 Jun 2025
Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes Ruiqi Zhang Jingfeng Wu Licong Lin Peter L. Bartlett 328 4 0 05 Apr 2025
A Minimalist Example of Edge-of-Stability and Progressive Sharpening Liming Liu Zixuan Zhang S. Du T. Zhao 287 1 0 04 Mar 2025
Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos Dayal Singh Kalra Tianyu He M. Barkeshli 387 11 0 17 Feb 2025
Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization Yuhang Cai Jingfeng Wu Song Mei Michael Lindsey Peter L. Bartlett 333 12 0 12 Jun 2024
Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes Dan Qiao Kaiqi Zhang Esha Singh Daniel Soudry Yu-Xiang Wang NoLa 277 7 0 10 Jun 2024
Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes Si Yi Meng Antonio Orvieto Daniel Yiming Cao Christopher De Sa 247 7 0 07 Jun 2024
Does SGD really happen in tiny subspaces? Minhak Song Kwangjun Ahn Chulhee Yun 470 15 1 25 May 2024
Gradient Descent with Polyak's Momentum Finds Flatter Minima via Large Catapults Prin Phunyaphibarn Junghyun Lee Bohan Wang Huishuai Zhang Chulhee Yun 284 1 0 25 Nov 2023
Good regularity creates large learning rate implicit biases: edge of stability, balancing, and catapult Yuqing Wang Zhenghao Xu Tuo Zhao Molei Tao 314 16 0 26 Oct 2023
From Stability to Chaos: Analyzing Gradient Descent Dynamics in Quadratic Regression Xuxing Chen Krishnakumar Balasubramanian Promit Ghosal Bhavya Agrawalla 229 10 0 02 Oct 2023
Trajectory Alignment: Understanding the Edge of Stability Phenomenon via Bifurcation TheoryNeural Information Processing Systems (NeurIPS), 2023 Minhak Song Chulhee Yun 322 14 1 09 Jul 2023
Implicit Bias of Gradient Descent for Logistic Regression at the Edge of StabilityNeural Information Processing Systems (NeurIPS), 2023 Jingfeng Wu Vladimir Braverman Jason D. Lee 241 28 0 19 May 2023