Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization

13 April 2025

Papers citing "Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization"

17 / 17 papers shown

Title
BLAST: Block-Level Adaptive Structured Matrices for Efficient Deep Neural Network Inference Changwoo Lee Soo Min Kwon Qing Qu Hun-Seok Kim 25 0 0 28 Oct 2024
On the Crucial Role of Initialization for Matrix Factorization Bingcong Li Liang Zhang Aryan Mokhtari Niao He 26 1 0 24 Oct 2024
Toward Global Convergence of Gradient EM for Over-Parameterized Gaussian Mixture Models Weihang Xu Maryam Fazel Simon S. Du 23 0 0 29 Jun 2024
Computational and Statistical Guarantees for Tensor-on-Tensor Regression with Tensor Train Decomposition Zhen Qin Zhihui Zhu 57 4 0 10 Jun 2024
Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent Zhiyu Liu Zhi-Long Han Yandong Tang Xi-Le Zhao Yao Wang 27 1 0 22 Jan 2024
Guaranteed Nonconvex Factorization Approach for Tensor Train Recovery Zhen Qin M. Wakin Zhihui Zhu 35 5 0 05 Jan 2024
How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization Nuoya Xiong Lijun Ding Simon S. Du 17 11 0 03 Oct 2023
Fast and Accurate Estimation of Low-Rank Matrices from Noisy Measurements via Preconditioned Non-Convex Gradient Descent Jialun Zhang Hong-Ming Chiu Richard Y. Zhang 12 5 0 26 May 2023
The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing Xingyu Xu Yandi Shen Yuejie Chi Cong Ma 24 34 0 02 Feb 2023
Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition Jianhao Ma Li-Zhen Guo S. Fattahi 19 4 0 01 Oct 2022
A Validation Approach to Over-parameterized Matrix and Image Recovery Lijun Ding Zhen Qin Liwei Jiang Jinxin Zhou Zhihui Zhu 17 13 0 21 Sep 2022
Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completion G. Zhang Hong-Ming Chiu Richard Y. Zhang 13 10 0 24 Aug 2022
Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterization Richard Y. Zhang 20 24 0 05 Jul 2022
Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplay Yuetian Luo Anru R. Zhang 13 19 0 17 Jun 2022
Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certification G. Zhang S. Fattahi Richard Y. Zhang 34 23 0 07 Jun 2022
Algorithmic Regularization in Model-free Overparametrized Asymmetric Matrix Factorization Liwei Jiang Yudong Chen Lijun Ding 15 26 0 06 Mar 2022
On the computational and statistical complexity of over-parameterized matrix sensing Jiacheng Zhuo Jeongyeol Kwon Nhat Ho C. Caramanis 9 28 0 27 Jan 2021