Provable Adaptivity of Adam under Non-uniform Smoothness

21 August 2022

Papers citing "Provable Adaptivity of Adam under Non-uniform Smoothness"

7 / 7 papers shown

Title
An Attention-Based Algorithm for Gravity Adaptation Zone Calibration Chen Yu 29 0 0 06 Oct 2024
Convergence Guarantees for RMSProp and Adam in Generalized-smooth Non-convex Optimization with Affine Noise Variance Qi Zhang Yi Zhou Shaofeng Zou 47 4 0 01 Apr 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 40 7 0 17 Jan 2024
Convex and Non-convex Optimization Under Generalized Smoothness Haochuan Li Jian Qian Yi Tian Alexander Rakhlin Ali Jadbabaie 21 35 0 02 Jun 2023
Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods Junchi Yang Xiang Li Ilyas Fatkhullin Niao He 49 15 0 21 May 2023
Convergence of Adam Under Relaxed Assumptions Haochuan Li Alexander Rakhlin Ali Jadbabaie 39 57 0 27 Apr 2023
Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration Congliang Chen Li Shen Fangyu Zou Wei Liu 48 29 0 14 Jan 2021