Efficiently escaping saddle points on manifolds

10 June 2019

Papers citing "Efficiently escaping saddle points on manifolds"

34 / 34 papers shown

Title
Langevin Multiplicative Weights Update with Applications in Polynomial Portfolio Management Yi-Hu Feng Tianlin Li Tian Xie 67 0 0 26 Feb 2025
SSE-SAM: Balancing Head and Tail Classes Gradually through Stage-Wise SAM Xingyu Lyu Qianqian Xu Zhiyong Yang Shaojie Lyu Qingming Huang 92 0 0 18 Dec 2024
Avoiding strict saddle points of nonconvex regularized problems Luwei Bai Yaohua Hu Hao Wang Xiaoqi Yang 13 0 0 17 Jan 2024
Riemannian stochastic optimization methods avoid strict saddle points Ya-Ping Hsieh Mohammad Reza Karimi Andreas Krause P. Mertikopoulos 43 5 0 04 Nov 2023
Curvature-Independent Last-Iterate Convergence for Games on Riemannian Manifolds Yong Cai Michael I. Jordan Tianyi Lin Argyris Oikonomou Emmanouil-Vasileios Vlatakis-Gkaragkounis 40 4 0 29 Jun 2023
Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties David Martínez-Rubio Christophe Roux Christopher Criscitiello Sebastian Pokutta 29 6 0 25 May 2023
Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penalties David Martínez-Rubio Sebastian Pokutta 32 9 0 26 Nov 2022
Nonconvex Matrix Factorization is Geodesically Convex: Global Landscape Analysis for Fixed-rank Matrix Optimization From a Riemannian Perspective Yuetian Luo Nicolas García Trillos 24 6 0 29 Sep 2022
Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold Can Yaras Peng Wang Zhihui Zhu Laura Balzano Qing Qu 30 42 0 19 Sep 2022
Riemannian stochastic approximation algorithms Mohammad Reza Karimi Ya-Ping Hsieh P. Mertikopoulos Andreas Krause 29 2 0 14 Jun 2022
First-Order Algorithms for Min-Max Optimization in Geodesic Metric Spaces Michael I. Jordan Tianyi Lin Emmanouil-Vasileios Vlatakis-Gkaragkounis 34 19 0 04 Jun 2022
Accelerated Multiplicative Weights Update Avoids Saddle Points almost always Yi-Hu Feng Ioannis Panageas Tianlin Li 16 2 0 25 Apr 2022
Efficiently Escaping Saddle Points in Bilevel Optimization Minhui Huang Xuxing Chen Kaiyi Ji Shiqian Ma Lifeng Lai 34 21 0 08 Feb 2022
On Geometric Connections of Embedded and Quotient Geometries in Riemannian Fixed-rank Matrix Optimization Yuetian Luo Xudong Li Xinmiao Zhang 27 6 0 23 Oct 2021
Constants of Motion: The Antidote to Chaos in Optimization and Game Dynamics Georgios Piliouras Xiao Wang 41 0 0 08 Sep 2021
Nonconvex Factorization and Manifold Formulations are Almost Equivalent in Low-rank Matrix Optimization Yuetian Luo Xudong Li Anru R. Zhang 33 9 0 03 Aug 2021
Asymptotic Escape of Spurious Critical Points on the Low-rank Matrix Manifold T. Hou Zhenzhen Li Ziyun Zhang 11 2 0 20 Jul 2021
Escaping strict saddle points of the Moreau envelope in nonsmooth optimization Damek Davis Mateo Díaz Dmitriy Drusvyatskiy 23 14 0 17 Jun 2021
Lecture notes on non-convex algorithms for low-rank matrix recovery Irène Waldspurger 24 1 0 21 May 2021
Double-descent curves in neural networks: a new perspective using Gaussian processes Ouns El Harzli Bernardo Cuenca Grau Guillermo Valle Pérez A. Louis 25 6 0 14 Feb 2021
Escaping Saddle Points for Nonsmooth Weakly Convex Functions via Perturbed Proximal Algorithms Minhui Huang 24 6 0 04 Feb 2021
No-go Theorem for Acceleration in the Hyperbolic Plane Linus Hamilton Ankur Moitra 24 21 0 14 Jan 2021
Fast Global Convergence for Low-rank Matrix Recovery via Riemannian Gradient Descent with Random Initialization T. Hou Zhenzhen Li Ziyun Zhang 34 18 0 31 Dec 2020
Global Riemannian Acceleration in Hyperbolic and Spherical Spaces David Martínez-Rubio 50 19 0 07 Dec 2020
Escape saddle points faster on manifolds via perturbed Riemannian stochastic recursive gradient Andi Han Junbin Gao 27 5 0 23 Oct 2020
Curvature-Dependant Global Convergence Rates for Optimization on Manifolds of Bounded Geometry Mario Lezcano-Casado 24 12 0 06 Aug 2020
From Symmetry to Geometry: Tractable Nonconvex Problems Yuqian Zhang Qing Qu John N. Wright 36 43 0 14 Jul 2020
Projection Robust Wasserstein Distance and Riemannian Optimization Tianyi Lin Chenyou Fan Nhat Ho Marco Cuturi Michael I. Jordan 25 68 0 12 Jun 2020
Convergence Analysis of Riemannian Stochastic Approximation Schemes Alain Durmus P. Jiménez Eric Moulines Salem Said Hoi-To Wai 19 10 0 27 May 2020
Asynchronous and Parallel Distributed Pose Graph Optimization Yulun Tian Alec Koppel Amrit Singh Bedi Jonathan P. How 47 37 0 06 Mar 2020
Finding the Sparsest Vectors in a Subspace: Theory, Algorithms, and Applications Qing Qu Zhihui Zhu Xiao Li M. Tsakiris John N. Wright René Vidal 19 20 0 20 Jan 2020
Proximal methods avoid active strict saddles of weakly convex functions Damek Davis Dmitriy Drusvyatskiy 15 3 0 16 Dec 2019
Analysis of the Optimization Landscapes for Overcomplete Representation Learning Qing Qu Yuexiang Zhai Xiao Li Yuqian Zhang Zhihui Zhu 24 9 0 05 Dec 2019
Escaping from saddle points on Riemannian manifolds Yue Sun Nicolas Flammarion Maryam Fazel 31 71 0 18 Jun 2019