Beyond Lazy Training for Over-parameterized Tensor Decomposition

Beyond Lazy Training for Over-parameterized Tensor Decomposition

22 October 2020

ArXiv (abs)PDF HTML

Papers citing "Beyond Lazy Training for Over-parameterized Tensor Decomposition"

13 / 13 papers shown

Title
Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression Runtian Zhai Bing Liu Andrej Risteski Zico Kolter Pradeep Ravikumar SSL 117 10 0 01 Jun 2023
Depth Separation with Multilayer Mean-Field Networks Y. Ren Mo Zhou Rong Ge OOD 61 3 0 03 Apr 2023
What Makes Data Suitable for a Locally Connected Neural Network? A Necessary and Sufficient Condition Based on Quantum Entanglement Yotam Alexander Nimrod De La Vega Noam Razin Nadav Cohen 57 4 0 20 Mar 2023
Implicit Regularization for Group Sparsity Jiangyuan Li THANH VAN NGUYEN Chinmay Hegde Raymond K. W. Wong 94 9 0 29 Jan 2023
Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition Jianhao Ma Li-Zhen Guo Salar Fattahi 73 4 0 01 Oct 2022
Neural Networks can Learn Representations with Gradient Descent Alexandru Damian Jason D. Lee Mahdi Soltanolkotabi SSL MLT 98 123 0 30 Jun 2022
Going Beyond Linear RL: Sample Efficient Neural Function Approximation Baihe Huang Kaixuan Huang Sham Kakade Jason D. Lee Qi Lei Runzhe Wang Jiaqi Yang 99 8 0 14 Jul 2021
Optimal Gradient-based Algorithms for Non-concave Bandit Optimization Baihe Huang Kaixuan Huang Sham Kakade Jason D. Lee Qi Lei Runzhe Wang Jiaqi Yang 417 17 0 09 Jul 2021
Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction Dominik Stöger Mahdi Soltanolkotabi ODL 80 78 0 28 Jun 2021
Understanding Deflation Process in Over-parametrized Tensor Decomposition Rong Ge Y. Ren Xiang Wang Mo Zhou 66 19 0 11 Jun 2021
Nonlinear Matrix Approximation with Radial Basis Function Components E. Rebrova Yu Tang 42 0 0 03 Jun 2021
Implicit Regularization in Tensor Factorization Noam Razin Asaf Maman Nadav Cohen 75 49 0 19 Feb 2021
Dissecting Hessian: Understanding Common Structure of Hessian in Neural Networks Yikai Wu Xingyu Zhu Chenwei Wu Annie Wang Rong Ge 114 45 0 08 Oct 2020