v1v2v3 (latest)

On the Last Iterate Convergence of Momentum Methods

International Conference on Algorithmic Learning Theory (ALT), 2021

13 February 2021

Papers citing "On the Last Iterate Convergence of Momentum Methods"

7 / 7 papers shown

A stochastic first-order method with multi-extrapolated momentum for highly smooth unconstrained optimization

Chuan He

451

19 Dec 2024

On the Performance Analysis of Momentum Method: A Frequency Domain PerspectiveInternational Conference on Learning Representations (ICLR), 2024

523

29 Nov 2024

Non-Convex Stochastic Composite Optimization with Polyak Momentum

Yuan Gao

Anton Rodomanov

Sebastian U. Stich

281

05 Mar 2024

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise

218

22 Dec 2023

The Marginal Value of Momentum for Small Learning Rate SGDInternational Conference on Learning Representations (ICLR), 2023

Tianhao Wang

229

27 Jul 2023

Acceleration of stochastic gradient descent with momentum by averaging: finite-sample rates and asymptotic normality

188

28 May 2023

Momentum Provably Improves Error Feedback!Neural Information Processing Systems (NeurIPS), 2023

Ilyas Fatkhullin

Alexander Tyurin

Peter Richtárik

297

24 May 2023