Quasi-hyperbolic momentum and Adam for deep learning

16 October 2018

Papers citing "Quasi-hyperbolic momentum and Adam for deep learning"

4 / 4 papers shown

Title
On the Performance Analysis of Momentum Method: A Frequency Domain Perspective Xianliang Li Jun Luo Zhiwei Zheng Hanxiao Wang Li Luo Lingkun Wen Linlong Wu Sheng Xu 62 0 0 29 Nov 2024
Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance Dimitris Oikonomou Nicolas Loizou 20 4 0 06 Jun 2024
Flexible numerical optimization with ensmallen Ryan R. Curtin Marcus Edel Rahul Prabhu S. Basak Zhihao Lou Conrad Sanderson 8 1 0 09 Mar 2020
On the adequacy of untuned warmup for adaptive optimization Jerry Ma Denis Yarats 27 70 0 09 Oct 2019