ResearchTrend.AI
Universal scaling laws in the gradient descent training of neural networks

Universal scaling laws in the gradient descent training of neural networks

Maksim Velikanov
Dmitry Yarotsky
ArXivPDFHTML

Papers citing "Universal scaling laws in the gradient descent training of neural networks"

4 / 4 papers shown
Title
Approximation results for Gradient Descent trained Shallow Neural Networks in $1d$
Approximation results for Gradient Descent trained Shallow Neural Networks in 1d1d
R. Gentile
G. Welper
ODL
41
6
0
17 Sep 2022
The large learning rate phase of deep learning: the catapult mechanism
The large learning rate phase of deep learning: the catapult mechanism
Aitor Lewkowycz
Yasaman Bahri
Ethan Dyer
Jascha Narain Sohl-Dickstein
Guy Gur-Ari
ODL
159
234
0
04 Mar 2020
Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach
Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach
Grant M. Rotskoff
Eric Vanden-Eijnden
59
118
0
02 May 2018
The Loss Surfaces of Multilayer Networks
The Loss Surfaces of Multilayer Networks
A. Choromańska
Mikael Henaff
Michaël Mathieu
Gerard Ben Arous
Yann LeCun
ODL
177
1,185
0
30 Nov 2014