ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2004.09740
  4. Cited By
AdaX: Adaptive Gradient Descent with Exponential Long Term Memory
v1v2 (latest)

AdaX: Adaptive Gradient Descent with Exponential Long Term Memory

21 April 2020
Wenjie Li
Zhaoyang Zhang
Xinjiang Wang
Ping Luo
    ODL
ArXiv (abs)PDFHTML

Papers citing "AdaX: Adaptive Gradient Descent with Exponential Long Term Memory"

11 / 11 papers shown
AdamNX: An Adam improvement algorithm based on a novel exponential decay mechanism for the second-order moment estimate
AdamNX: An Adam improvement algorithm based on a novel exponential decay mechanism for the second-order moment estimate
Meng Zhu
Quan Xiao
Weidong Min
318
0
0
17 Nov 2025
ODC-SA Net: Orthogonal Direction Enhancement and Scale Aware Network for
  Polyp Segmentation
ODC-SA Net: Orthogonal Direction Enhancement and Scale Aware Network for Polyp SegmentationChinese Conference on Pattern Recognition and Computer Vision (CPRCV), 2024
Chenhao Xu
Yudian Zhang
Kaiye Xu
Haijiang Zhu
173
0
0
10 May 2024
Bidirectional Looking with A Novel Double Exponential Moving Average to
  Adaptive and Non-adaptive Momentum Optimizers
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum OptimizersInternational Conference on Machine Learning (ICML), 2023
Yineng Chen
Z. Li
Lefei Zhang
Bo Du
Hai Zhao
216
8
0
02 Jul 2023
Camouflaged Object Detection via Context-aware Cross-level Fusion
Camouflaged Object Detection via Context-aware Cross-level Fusion
Geng Chen
Si Liu
Yu-Jia Sun
Ge-Peng Ji
Yafeng Wu
Tao Zhou
291
211
0
27 Jul 2022
a novel attention-based network for fast salient object detection
a novel attention-based network for fast salient object detection
Bin Zhang
Yang Wu
Xiaojing Zhang
Ming Ma
3DPC
159
1
0
20 Dec 2021
Momentum Centering and Asynchronous Update for Adaptive Gradient Methods
Momentum Centering and Asynchronous Update for Adaptive Gradient MethodsNeural Information Processing Systems (NeurIPS), 2021
Juntang Zhuang
Yifan Ding
Tommy M. Tang
Nicha Dvornek
S. Tatikonda
James S. Duncan
ODL
298
7
0
11 Oct 2021
AdaL: Adaptive Gradient Transformation Contributes to Convergences and
  Generalizations
AdaL: Adaptive Gradient Transformation Contributes to Convergences and Generalizations
Hongwei Zhang
Weidong Zou
Hongbo Zhao
Qi Ming
Tijin Yan
Yuanqing Xia
Weipeng Cao
ODL
124
0
0
04 Jul 2021
Context-aware Cross-level Fusion Network for Camouflaged Object
  Detection
Context-aware Cross-level Fusion Network for Camouflaged Object DetectionInternational Joint Conference on Artificial Intelligence (IJCAI), 2021
Yujia Sun
Geng Chen
Tao Zhou
Yi Zhang
Nian Liu
300
309
0
26 May 2021
Variance Reduction on General Adaptive Stochastic Mirror Descent
Variance Reduction on General Adaptive Stochastic Mirror DescentMachine-mediated learning (ML), 2020
Wenjie Li
Zhanyu Wang
Yichen Zhang
Guang Cheng
396
5
0
26 Dec 2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed
  Gradients
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
Juntang Zhuang
Tommy M. Tang
Yifan Ding
S. Tatikonda
Nicha Dvornek
X. Papademetris
James S. Duncan
ODL
865
634
0
15 Oct 2020
Descending through a Crowded Valley - Benchmarking Deep Learning
  Optimizers
Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers
Robin M. Schmidt
Frank Schneider
Philipp Hennig
ODL
919
195
0
03 Jul 2020
1
Page 1 of 1