158
v1v2 (latest)

Convergence Analysis of the PAGE Stochastic Algorithm for Weakly Convex Finite-Sum Optimization

Main:10 Pages
Bibliography:3 Pages
Abstract

PAGE, a stochastic algorithm introduced by Li et al. [2021], was designed to find stationary points of averages of smooth nonconvex functions. In this work, we study PAGE in the broad framework of τ\tau-weakly convex functions, which provides a continuous interpolation between the general nonconvex LL-smooth case (τ=L\tau = L) and the convex case (τ=0\tau = 0). We establish new convergence rates for PAGE, showing that its complexity improves as τ\tau decreases.

View on arXiv
Comments on this paper