ResearchTrend.AI
On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization
v1v2v3v4 (latest)

On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization

Dongruo Zhou
Yiqi Tang
Yuan Cao
Ziyan Yang
Quanquan Gu
ArXiv (abs)PDFHTML

Papers citing "On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization"

7 / 107 papers shown
Title
Recursive Estimation for Sparse Gaussian Process Regression
Recursive Estimation for Sparse Gaussian Process Regression
Manuel Schürch
Dario Azzimonti
A. Benavoli
Marco Zaffalon
73
37
0
28 May 2019
An Optimistic Acceleration of AMSGrad for Nonconvex Optimization
An Optimistic Acceleration of AMSGrad for Nonconvex Optimization
Jun-Kun Wang
Xiaoyun Li
Belhal Karimi
Ping Li
ODL
84
1
0
04 Mar 2019
Rapidly Adapting Moment Estimation
Rapidly Adapting Moment Estimation
Guoqiang Zhang
Kenta Niwa
W. Kleijn
ODL
60
0
0
24 Feb 2019
Global Convergence of Adaptive Gradient Methods for An Over-parameterized Neural Network
Global Convergence of Adaptive Gradient Methods for An Over-parameterized Neural Network
Xiaoxia Wu
S. Du
Rachel A. Ward
148
66
0
19 Feb 2019
Escaping Saddle Points with Adaptive Gradient Methods
Escaping Saddle Points with Adaptive Gradient Methods
Matthew Staib
Sashank J. Reddi
Satyen Kale
Sanjiv Kumar
S. Sra
ODL
143
77
0
26 Jan 2019
DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization
DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization
Parvin Nazari
Davoud Ataee Tarzanagh
George Michailidis
ODL
221
80
0
25 Jan 2019
Theoretical Analysis of Auto Rate-Tuning by Batch Normalization
Theoretical Analysis of Auto Rate-Tuning by Batch Normalization
Sanjeev Arora
Zhiyuan Li
Kaifeng Lyu
150
133
0
10 Dec 2018