Algorithmic Regularization in Model-free Overparametrized Asymmetric Matrix Factorization

6 March 2022

Papers citing "Algorithmic Regularization in Model-free Overparametrized Asymmetric Matrix Factorization"

22 / 22 papers shown

Title
On the Crucial Role of Initialization for Matrix Factorization Bingcong Li Liang Zhang Aryan Mokhtari Niao He 26 1 0 24 Oct 2024
Robust Low-rank Tensor Train Recovery Zhen Qin Zhihui Zhu 35 1 0 19 Oct 2024
Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks Zhenghao Xu Yuqing Wang T. Zhao Rachel Ward Molei Tao 19 0 0 12 Oct 2024
In-depth Analysis of Low-rank Matrix Factorisation in a Federated Setting Constantin Philippenko Kevin Scaman Laurent Massoulié FedML 29 1 0 13 Sep 2024
Federated Representation Learning in the Under-Parameterized Regime Renpu Liu Cong Shen Jing Yang 19 4 0 07 Jun 2024
Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion Zhiwei Bai Jiajie Zhao Yaoyu Zhang AI4CE 23 0 0 22 May 2024
The Implicit Bias of Heterogeneity towards Invariance: A Study of Multi-Environment Matrix Sensing Yang Xu Yihong Gu Cong Fang 33 0 0 03 Mar 2024
Guaranteed Nonconvex Factorization Approach for Tensor Train Recovery Zhen Qin M. Wakin Zhihui Zhu 35 5 0 05 Jan 2024
Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics Soo Min Kwon Zekai Zhang Dogyoon Song Laura Balzano Qing Qu 33 2 0 08 Nov 2023
How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization Nuoya Xiong Lijun Ding Simon S. Du 17 11 0 03 Oct 2023
Asymmetric matrix sensing by gradient descent with small random initialization J. S. Wind 25 1 0 04 Sep 2023
Gradient descent in matrix factorization: Understanding large initialization Hengchao Chen Xin Chen Mohamad Elmasri Qiang Sun AI4CE 16 1 0 30 May 2023
Fast and Accurate Estimation of Low-Rank Matrices from Noisy Measurements via Preconditioned Non-Convex Gradient Descent Jialun Zhang Hong-Ming Chiu Richard Y. Zhang 12 5 0 26 May 2023
Convergence of Alternating Gradient Descent for Matrix Factorization R. Ward T. Kolda 22 6 0 11 May 2023
Saddle-to-Saddle Dynamics in Diagonal Linear Networks Scott Pesme Nicolas Flammarion 17 35 0 02 Apr 2023
Active Self-Supervised Learning: A Few Low-Cost Relationships Are All You Need Vivien A. Cabannes Léon Bottou Yann LeCun Randall Balestriero 37 13 0 27 Mar 2023
The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing Xingyu Xu Yandi Shen Yuejie Chi Cong Ma 24 34 0 02 Feb 2023
Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing Jikai Jin Zhiyuan Li Kaifeng Lyu S. Du Jason D. Lee MLT 31 34 0 27 Jan 2023
A Validation Approach to Over-parameterized Matrix and Image Recovery Lijun Ding Zhen Qin Liwei Jiang Jinxin Zhou Zhihui Zhu 19 13 0 21 Sep 2022
Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplay Yuetian Luo Anru R. Zhang 16 19 0 17 Jun 2022
Randomly Initialized Alternating Least Squares: Fast Convergence for Matrix Sensing Kiryung Lee Dominik Stöger 15 11 0 25 Apr 2022
Rank Overspecified Robust Matrix Recovery: Subgradient Method and Exact Recovery Lijun Ding Liwei Jiang Yudong Chen Qing Qu Zhihui Zhu 18 28 0 23 Sep 2021