ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.11514
  4. Cited By
Rethinking Adam: A Twofold Exponential Moving Average Approach
v1v2v3 (latest)

Rethinking Adam: A Twofold Exponential Moving Average Approach

22 June 2021
Yizhou Wang
Yue Kang
Can Qin
Huan Wang
Yi Xu
Yulun Zhang
Y. Fu
    ODL
ArXiv (abs)PDFHTML

Papers citing "Rethinking Adam: A Twofold Exponential Moving Average Approach"

3 / 3 papers shown
Title
AdaPlus: Integrating Nesterov Momentum and Precise Stepsize Adjustment
  on AdamW Basis
AdaPlus: Integrating Nesterov Momentum and Precise Stepsize Adjustment on AdamW Basis
Lei Guan
ODL
118
4
0
05 Sep 2023
XGrad: Boosting Gradient-Based Optimizers With Weight Prediction
XGrad: Boosting Gradient-Based Optimizers With Weight Prediction
Lei Guan
Dongsheng Li
Yanqi Shi
Jian Meng
ODL
96
2
0
26 May 2023
Robustness to Unbounded Smoothness of Generalized SignSGD
Robustness to Unbounded Smoothness of Generalized SignSGD
M. Crawshaw
Mingrui Liu
Francesco Orabona
Wei Zhang
Zhenxun Zhuang
AAML
110
74
0
23 Aug 2022
1