Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2504.09708
Cited By
Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization
Neural Information Processing Systems (NeurIPS), 2025
13 April 2025
G. Zhang
Salar Fattahi
Richard Y. Zhang
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization"
50 / 51 papers shown
Convergence Dynamics of Over-Parameterized Score Matching for a Single Gaussian
Yiran Zhang
Weihang Xu
Mo Zhou
Maryam Fazel
S. S. Du
DiffM
228
0
0
27 Nov 2025
On the Benefits of Weight Normalization for Overparameterized Matrix Sensing
Yudong Wei
Liang Zhang
Bingcong Li
Niao He
137
1
0
01 Oct 2025
Faster Than SVD, Smarter Than SGD: The OPLoRA Alternating Update
Abdulla Jasem Almansoori
Maria Ivanova
Andrey Veprikov
Aleksandr Beznosikov
Samuel Horvath
Martin Takáč
122
1
0
24 Sep 2025
PoLAR: Polar-Decomposed Low-Rank Adapter Representation
Kai Lion
Liang Zhang
Bingcong Li
Niao He
290
6
0
03 Jun 2025
RGNMR: A Gauss-Newton method for robust matrix completion with theoretical guarantees
Eilon Vaknin Laufer
Boaz Nadler
344
1
0
19 May 2025
AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections
Xin Yu
Yujia Wang
Jinghui Chen
Lingzhou Xue
359
4
0
18 May 2025
BLAST: Block-Level Adaptive Structured Matrices for Efficient Deep Neural Network Inference
Neural Information Processing Systems (NeurIPS), 2024
Changwoo Lee
Soo Min Kwon
Qing Qu
Hun-Seok Kim
294
2
0
28 Oct 2024
On the Crucial Role of Initialization for Matrix Factorization
International Conference on Learning Representations (ICLR), 2024
Bingcong Li
Liang Zhang
Aryan Mokhtari
Niao He
425
11
0
24 Oct 2024
Toward Global Convergence of Gradient EM for Over-Parameterized Gaussian Mixture Models
Weihang Xu
Maryam Fazel
S. Du
429
8
0
29 Jun 2024
Computational and Statistical Guarantees for Tensor-on-Tensor Regression with Tensor Train Decomposition
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
Zhen Qin
Zhihui Zhu
568
7
0
10 Jun 2024
Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent
IEEE Transactions on Signal Processing (IEEE TSP), 2024
Zhiyu Liu
Zhi Han
Yandong Tang
Xi-Le Zhao
Yao Wang
438
10
0
22 Jan 2024
Guaranteed Nonconvex Factorization Approach for Tensor Train Recovery
Zhen Qin
M. Wakin
Zhihui Zhu
424
15
0
05 Jan 2024
How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization
International Conference on Learning Representations (ICLR), 2023
Nuoya Xiong
Lijun Ding
Simon S. Du
494
21
0
03 Oct 2023
Fast and Accurate Estimation of Low-Rank Matrices from Noisy Measurements via Preconditioned Non-Convex Gradient Descent
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Jialun Zhang
Hong-Ming Chiu
Richard Y. Zhang
381
8
0
26 May 2023
The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing
International Conference on Machine Learning (ICML), 2023
Xingyu Xu
Yandi Shen
Yuejie Chi
Cong Ma
540
46
0
02 Feb 2023
Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition
International Conference on Learning Representations (ICLR), 2022
Jianhao Ma
Li-Zhen Guo
Salar Fattahi
379
4
0
01 Oct 2022
A Validation Approach to Over-parameterized Matrix and Image Recovery
Lijun Ding
Zhen Qin
Liwei Jiang
Jinxin Zhou
Zhihui Zhu
436
15
0
21 Sep 2022
Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completion
Neural Information Processing Systems (NeurIPS), 2022
G. Zhang
Hong-Ming Chiu
Richard Y. Zhang
339
12
0
24 Aug 2022
Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterization
Mathematical programming (Math. Program.), 2022
Richard Y. Zhang
399
28
0
05 Jul 2022
Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplay
Annals of Statistics (Ann. Stat.), 2022
Yuetian Luo
Anru R. Zhang
331
24
0
17 Jun 2022
Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certification
Journal of machine learning research (JMLR), 2022
G. Zhang
Salar Fattahi
Richard Y. Zhang
553
29
0
07 Jun 2022
Algorithmic Regularization in Model-free Overparametrized Asymmetric Matrix Factorization
SIAM Journal on Mathematics of Data Science (SIMODS), 2022
Liwei Jiang
Yudong Chen
Lijun Ding
223
32
0
06 Mar 2022
Sharp Global Guarantees for Nonconvex Low-rank Recovery in the Noisy Overparameterized Regime
SIAM Journal on Optimization (SIAM J. Optim.), 2021
Richard Y. Zhang
373
25
0
21 Apr 2021
On the computational and statistical complexity of over-parameterized matrix sensing
Journal of machine learning research (JMLR), 2021
Jiacheng Zhuo
Jeongyeol Kwon
Nhat Ho
Constantine Caramanis
291
34
0
27 Jan 2021
Low-Rank Matrix Recovery with Scaled Subgradient Methods: Fast and Robust Convergence Without the Condition Number
Tian Tong
Cong Ma
Yuejie Chi
309
60
0
26 Oct 2020
Accelerating Ill-Conditioned Low-Rank Matrix Estimation via Scaled Gradient Descent
Tian Tong
Cong Ma
Yuejie Chi
551
139
0
18 May 2020
Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery
Richard Y. Zhang
Somayeh Sojoudi
Javad Lavaei
355
55
0
07 Jan 2019
How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery?
Richard Y. Zhang
C. Josz
Somayeh Sojoudi
Javad Lavaei
187
44
0
25 May 2018
No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis
Rong Ge
Chi Jin
Yi Zheng
398
459
0
03 Apr 2017
How to Escape Saddle Points Efficiently
Chi Jin
Rong Ge
Praneeth Netrapalli
Sham Kakade
Sai Li
ODL
477
907
0
02 Mar 2017
Structured signal recovery from quadratic measurements: Breaking sample complexity barriers via nonconvex optimization
IEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2017
Mahdi Soltanolkotabi
214
109
0
20 Feb 2017
Fast Algorithms for Robust PCA via Gradient Descent
Xinyang Yi
Dohyung Park
Yudong Chen
Constantine Caramanis
303
277
0
25 May 2016
Matrix Completion has No Spurious Local Minimum
Rong Ge
Jason D. Lee
Tengyu Ma
422
619
0
24 May 2016
Global Optimality of Local Search for Low Rank Matrix Recovery
Srinadh Bhojanapalli
Behnam Neyshabur
Nathan Srebro
ODL
307
405
0
23 May 2016
A Geometric Analysis of Phase Retrieval
Ju Sun
Qing Qu
John N. Wright
295
556
0
22 Feb 2016
Complete Dictionary Recovery over the Sphere I: Overview and the Geometric Picture
Ju Sun
Qing Qu
John N. Wright
360
171
0
11 Nov 2015
Dropping Convexity for Faster Semi-definite Optimization
Srinadh Bhojanapalli
Anastasios Kyrillidis
Sujay Sanghavi
374
178
0
14 Sep 2015
Fast low-rank estimation by projected gradient descent: General statistical and algorithmic guarantees
Yudong Chen
Martin J. Wainwright
635
329
0
10 Sep 2015
A Convergent Gradient Descent Algorithm for Rank Minimization and Semidefinite Programming from Random Linear Measurements
Qinqing Zheng
John D. Lafferty
368
190
0
19 Jun 2015
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition
Rong Ge
Furong Huang
Chi Jin
Yang Yuan
484
1,118
0
06 Mar 2015
An Introduction to Matrix Concentration Inequalities
J. Tropp
760
1,247
0
07 Jan 2015
Guaranteed Matrix Completion via Non-convex Factorization
IEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2014
Tian Ding
Jianfeng Yao
470
475
0
28 Nov 2014
Non-convex Robust PCA
Praneeth Netrapalli
U. Niranjan
Sujay Sanghavi
Anima Anandkumar
Prateek Jain
303
295
0
28 Oct 2014
Fast matrix completion without the condition number
Annual Conference Computational Learning Theory (COLT), 2014
Moritz Hardt
Mary Wootters
240
111
0
15 Jul 2014
Phase Retrieval via Wirtinger Flow: Theory and Algorithms
IEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2014
Emmanuel Candes
Xiaodong Li
Mahdi Soltanolkotabi
454
1,352
0
03 Jul 2014
Low-rank Matrix Completion using Alternating Minimization
Prateek Jain
Praneeth Netrapalli
Sujay Sanghavi
580
1,106
0
03 Dec 2012
Estimation of (near) low-rank matrices with noise and high-dimensional scaling
International Conference on Machine Learning (ICML), 2009
S. Negahban
Martin J. Wainwright
496
592
0
27 Dec 2009
Guaranteed Rank Minimization via Singular Value Projection
Raghu Meka
Prateek Jain
Inderjit S. Dhillon
495
571
0
30 Sep 2009
Rank-Sparsity Incoherence for Matrix Decomposition
SIAM Journal on Optimization (SIOPT), 2009
V. Chandrasekaran
Sujay Sanghavi
P. Parrilo
A. Willsky
CML
612
1,131
0
11 Jun 2009
Matrix Completion from a Few Entries
Raghunandan H. Keshavan
Andrea Montanari
Sewoong Oh
1.2K
1,276
0
20 Jan 2009
1
2
Next
Page 1 of 2
