Provable Acceleration of Heavy Ball beyond Quadratics for a Class of
Polyak-Łojasiewicz Functions when the Non-Convexity is Averaged-Out

Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Łojasiewicz Functions when the Non-Convexity is Averaged-Out

22 June 2022

Papers citing "Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Łojasiewicz Functions when the Non-Convexity is Averaged-Out"

13 / 13 papers shown

Title
Polyak's Heavy Ball Method Achieves Accelerated Local Rate of Convergence under Polyak-Lojasiewicz Inequality Sebastian Kassing Simon Weissmann 21 1 0 22 Oct 2024
Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance Dimitris Oikonomou Nicolas Loizou 53 4 0 06 Jun 2024
(Accelerated) Noise-adaptive Stochastic Heavy-Ball Momentum Anh Dang Reza Babanezhad Sharan Vaswani 22 0 0 12 Jan 2024
Invex Programs: First Order Algorithms and Their Convergence Adarsh Barik S. Sra Jean Honorio 21 2 0 10 Jul 2023
Accelerated Optimization Landscape of Linear-Quadratic Regulator Le Feng Yuan‐Hua Ni 16 0 0 07 Jul 2023
Continuized Acceleration for Quasar Convex Functions in Non-Convex Optimization Jun-Kun Wang Andre Wibisono 23 9 0 15 Feb 2023
When is Momentum Extragradient Optimal? A Polynomial-Based Analysis J. Kim Gauthier Gidel Anastasios Kyrillidis Fabian Pedregosa 27 1 0 09 Nov 2022
Towards Understanding GD with Hard and Conjugate Pseudo-labels for Test-Time Adaptation Jun-Kun Wang Andre Wibisono 29 7 0 18 Oct 2022
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities Brian Bartoldson B. Kailkhura Davis W. Blalock 29 47 0 13 Oct 2022
Accelerating Hamiltonian Monte Carlo via Chebyshev Integration Time Jun-Kun Wang Andre Wibisono 27 9 0 05 Jul 2022
$Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the $O(ε^{-7/4})$ Complexity$ Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the $O(ε^{-7/4})$ Complexity Huan Li Zhouchen Lin 40 21 0 27 Jan 2022
No-Regret Dynamics in the Fenchel Game: A Unified Framework for Algorithmic Convex Optimization Jun-Kun Wang Jacob D. Abernethy Kfir Y. Levy 11 21 0 22 Nov 2021
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark W. Schmidt 133 1,198 0 16 Aug 2016