On the diffusion approximation of nonconvex stochastic gradient descent

v1v2 (latest)

On the diffusion approximation of nonconvex stochastic gradient descent

22 May 2017

ArXiv (abs)PDF HTML

Papers citing "On the diffusion approximation of nonconvex stochastic gradient descent"

6 / 6 papers shown

Title
Study on the Large Batch Size Training of Neural Networks Based on the Second Order Gradient Fengli Gao Huicai Zhong ODL 30 10 0 16 Dec 2020
Fluctuation-dissipation relations for stochastic gradient descent Sho Yaida 113 75 0 28 Sep 2018
A Walk with SGD Chen Xing Devansh Arpit Christos Tsirigotis Yoshua Bengio 96 119 0 24 Feb 2018
Three Factors Influencing Minima in SGD Stanislaw Jastrzebski Zachary Kenton Devansh Arpit Nicolas Ballas Asja Fischer Yoshua Bengio Amos Storkey 85 463 0 13 Nov 2017
Stochastic gradient descent performs variational inference, converges to limit cycles for deep networks Pratik Chaudhari Stefano Soatto MLT 95 304 0 30 Oct 2017
Generalization Bounds of SGLD for Non-convex Learning: Two Theoretical Viewpoints Wenlong Mou Liwei Wang Xiyu Zhai Kai Zheng MLT 64 159 0 19 Jul 2017