On the Hyperparameters in Stochastic Gradient Descent with Momentum

v1v2 (latest)

On the Hyperparameters in Stochastic Gradient Descent with Momentum

9 August 2021

ArXiv (abs)PDF HTML

Papers citing "On the Hyperparameters in Stochastic Gradient Descent with Momentum"

6 / 6 papers shown

Title
Quantum Optimization via Gradient-Based Hamiltonian Descent Jiaqi Leng Bin Shi 48 0 0 20 May 2025
Drug classification based on X-ray spectroscopy combined with machine learning Yangfu Li Peng Wang Bangdong Han 112 0 0 04 May 2025
Quantum Langevin Dynamics for Optimization Zherui Chen Yuchen Lu Hao Wang Yizhou Liu Tongyang Li AI4CE 144 11 0 27 Nov 2023
On Underdamped Nesterov's Acceleration Shu Chen Bin Shi Ya-xiang Yuan 89 5 0 28 Apr 2023
Revisiting the acceleration phenomenon via high-resolution differential equations Shu Chen Bin Shi Ya-xiang Yuan 64 8 0 12 Dec 2022
Gradient Norm Minimization of Nesterov Acceleration: $o(1/k^3)$ Shu Chen Bin Shi Ya-xiang Yuan 68 15 0 19 Sep 2022