The Dynamics of Gradient Descent for Overparametrized Neural Networks

The Dynamics of Gradient Descent for Overparametrized Neural Networks

13 May 2021

Siddhartha Satpathi

ArXiv (abs)PDF HTML

Papers citing "The Dynamics of Gradient Descent for Overparametrized Neural Networks"

11 / 11 papers shown

Title
ATLAS: Learning to Optimally Memorize the Context at Test Time Ali Behrouz Zeman Li Praneeth Kacham Majid Daliri Yuan Deng Peilin Zhong Meisam Razaviyayn Vahab Mirrokni 76 2 0 29 May 2025
Convergence Guarantees for the DeepWalk Embedding on Block Models Christopher Harker Aditya Bhaskara 56 0 0 26 Oct 2024
Can We Theoretically Quantify the Impacts of Local Updates on the Generalization Performance of Federated Learning? Peizhong Ju Haibo Yang Jia Liu Yingbin Liang Ness B. Shroff FedML 78 0 0 05 Sep 2024
Performance of NPG in Countable State-Space Average-Cost RL Yashaswini Murthy Isaac Grosof S. T. Maguluri R. Srikant OffRL 78 1 0 30 May 2024
Generalization Performance of Transfer Learning: Overparameterized and Underparameterized Regimes Peizhong Ju Sen Lin M. Squillante Yitao Liang Ness B. Shroff 47 2 0 08 Jun 2023
Theoretical Characterization of the Generalization Performance of Overfitted Meta-Learning Peizhong Ju Yitao Liang Ness B. Shroff MLT AI4CE 62 3 0 09 Apr 2023
Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies Hannah Pinson Joeri Lenaerts V. Ginis 53 3 0 03 Mar 2023
Implicit Stochastic Gradient Descent for Training Physics-informed Neural Networks Ye Li Songcan Chen Shengyi Huang PINN 51 3 0 03 Mar 2023
Theory on Forgetting and Generalization of Continual Learning Sen Lin Peizhong Ju Yitao Liang Ness B. Shroff CLL 88 47 0 12 Feb 2023
Reinforcement Learning with Unbiased Policy Evaluation and Linear Function Approximation Anna Winnicki R. Srikant OffRL 52 6 0 13 Oct 2022
On the Generalization Power of Overfitted Two-Layer Neural Tangent Kernel Models Peizhong Ju Xiaojun Lin Ness B. Shroff MLT 71 10 0 09 Mar 2021