Random Scaling and Momentum for Non-smooth Non-convex Optimization

16 May 2024

Papers citing "Random Scaling and Momentum for Non-smooth Non-convex Optimization"

5 / 5 papers shown

Title
General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization Kwangjun Ahn Gagik Magakyan Ashok Cutkosky 53 0 0 11 Nov 2024
Empirical Tests of Optimization Assumptions in Deep Learning Hoang Tran Qinzi Zhang Ashok Cutkosky 23 1 0 01 Jul 2024
Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise Kwangjun Ahn Zhiyu Zhang Yunbum Kook Yan Dai 37 11 0 02 Feb 2024
On the Complexity of Finding Small Subgradients in Nonsmooth Optimization Guy Kornowski Ohad Shamir 32 9 0 21 Sep 2022
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization Tianyi Lin Zeyu Zheng Michael I. Jordan 49 50 0 12 Sep 2022