Uniform-in-Time Weak Error Analysis for Stochastic Gradient Descent
Algorithms via Diffusion Approximation

v1v2 (latest)

Uniform-in-Time Weak Error Analysis for Stochastic Gradient Descent Algorithms via Diffusion Approximation

2 February 2019

ArXiv (abs)PDF HTML

Papers citing "Uniform-in-Time Weak Error Analysis for Stochastic Gradient Descent Algorithms via Diffusion Approximation"

16 / 16 papers shown

Title
Self-normalized Cramér-type Moderate Deviation of Stochastic Gradient Langevin Dynamics Hongsheng Dai Xiequan Fan Jianya Lu 32 1 0 29 Oct 2024
A General Continuous-Time Formulation of Stochastic ADMM and Its Variants Chris Junchi Li 69 0 0 22 Apr 2024
Stochastic Modified Flows for Riemannian Stochastic Gradient Descent Benjamin Gess Sebastian Kassing Nimit Rana 78 0 0 02 Feb 2024
Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting Aleksei Ustimenko Aleksandr Beznosikov 82 1 0 09 Oct 2023
Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent Benjamin Gess Sebastian Kassing Vitalii Konarovskyi DiffM 72 6 0 14 Feb 2023
Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis Taiki Miyagawa 90 10 0 28 Oct 2022
A sharp uniform-in-time error estimate for Stochastic Gradient Langevin Dynamics Lei Li Yuliang Wang 95 11 0 19 Jul 2022
On uniform-in-time diffusion approximation for stochastic gradient descent Lei Li Yuliang Wang 98 4 0 11 Jul 2022
Analysis of Kinetic Models for Label Switching and Stochastic Gradient Descent Martin Burger Alex Rossi 50 1 0 01 Jul 2022
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics D. Kunin Javier Sagastuy-Breña Surya Ganguli Daniel L. K. Yamins Hidenori Tanaka 167 80 0 08 Dec 2020
Implicit Gradient Regularization David Barrett Benoit Dherin 101 152 0 23 Sep 2020
Convergence rates and approximation results for SGD and its continuous-time counterpart Xavier Fontaine Valentin De Bortoli Alain Durmus 24 7 0 08 Apr 2020
The Implicit Regularization of Stochastic Gradient Flow for Least Squares Alnur Ali Yan Sun Robert Tibshirani 103 77 0 17 Mar 2020
Shadowing Properties of Optimization Algorithms Antonio Orvieto Aurelien Lucchi 84 18 0 12 Nov 2019
On the Noisy Gradient Descent that Generalizes as SGD Jingfeng Wu Wenqing Hu Haoyi Xiong Jun Huan Vladimir Braverman Zhanxing Zhu MLT 73 10 0 18 Jun 2019
Continuous-time Models for Stochastic Optimization Algorithms Antonio Orvieto Aurelien Lucchi 119 32 0 05 Oct 2018