Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certification

7 June 2022

Papers citing "Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certification"

11 / 11 papers shown

Title
A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models Mengyang Sun Yihao Wang Tao Feng Dan Zhang Yifan Zhu J. Tang MoE 29 0 0 20 Feb 2025
$k$ -SVD with Gradient Descent Emily Gan Yassir Jedra Devavrat Shah 53 0 0 01 Feb 2025
Guarantees of a Preconditioned Subgradient Algorithm for Overparameterized Asymmetric Low-rank Matrix Recovery Paris Giampouras HanQin Cai René Vidal 24 3 0 22 Oct 2024
Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks Zhenghao Xu Yuqing Wang T. Zhao Rachel Ward Molei Tao 19 0 0 12 Oct 2024
Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models Fangzhao Zhang Mert Pilanci AI4CE 49 14 0 04 Feb 2024
Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent Zhiyu Liu Zhi-Long Han Yandong Tang Xi-Le Zhao Yao Wang 27 1 0 22 Jan 2024
How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization Nuoya Xiong Lijun Ding Simon S. Du 17 11 0 03 Oct 2023
Can Learning Be Explained By Local Optimality In Robust Low-rank Matrix Recovery? Jianhao Ma S. Fattahi 12 1 0 21 Feb 2023
Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron Weihang Xu S. Du 19 16 0 20 Feb 2023
The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing Xingyu Xu Yandi Shen Yuejie Chi Cong Ma 24 34 0 02 Feb 2023
Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterization Richard Y. Zhang 20 24 0 05 Jul 2022