A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network

4 February 2021

Papers citing "A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network"

5 / 5 papers shown

Title
Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron Weihang Xu S. Du 6 16 0 20 Feb 2023
Global Convergence of SGD On Two Layer Neural Nets Pulkit Gopalani Anirbit Mukherjee 13 5 0 20 Oct 2022
On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias Itay Safran Gal Vardi Jason D. Lee MLT 26 23 0 18 May 2022
The Convex Geometry of Backpropagation: Neural Network Gradient Flows Converge to Extreme Points of the Dual Convex Program Yifei Wang Mert Pilanci MLT MDE 26 11 0 13 Oct 2021
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark W. Schmidt 114 1,190 0 16 Aug 2016