AdaX: Adaptive Gradient Descent with Exponential Long Term Memory

v1v2 (latest)

AdaX: Adaptive Gradient Descent with Exponential Long Term Memory

21 April 2020

Ping Luo

ArXiv (abs)PDF HTML

Papers citing "AdaX: Adaptive Gradient Descent with Exponential Long Term Memory"

10 / 10 papers shown

Title
ODC-SA Net: Orthogonal Direction Enhancement and Scale Aware Network for Polyp Segmentation Chenhao Xu Yudian Zhang Kaiye Xu Haijiang Zhu 90 0 0 10 May 2024
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers Yineng Chen Z. Li Lefei Zhang Bo Du Hai Zhao 99 5 0 02 Jul 2023
Camouflaged Object Detection via Context-aware Cross-level Fusion Geng Chen Si Liu Yu-Jia Sun Ge-Peng Ji Yafeng Wu Tao Zhou 113 153 0 27 Jul 2022
a novel attention-based network for fast salient object detection Bin Zhang Yang Wu Xiaojing Zhang Ming Ma 3DPC 44 1 0 20 Dec 2021
Momentum Centering and Asynchronous Update for Adaptive Gradient Methods Juntang Zhuang Yifan Ding Tommy M. Tang Nicha Dvornek S. Tatikonda James S. Duncan ODL 97 4 0 11 Oct 2021
AdaL: Adaptive Gradient Transformation Contributes to Convergences and Generalizations Hongwei Zhang Weidong Zou Hongbo Zhao Qi Ming Tijin Yan Yuanqing Xia Weipeng Cao ODL 60 0 0 04 Jul 2021
Context-aware Cross-level Fusion Network for Camouflaged Object Detection Yujia Sun Geng Chen Tao Zhou Yi Zhang Nian Liu 111 256 0 26 May 2021
Variance Reduction on General Adaptive Stochastic Mirror Descent Wenjie Li Zhanyu Wang Yichen Zhang Guang Cheng 122 4 0 26 Dec 2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients Juntang Zhuang Tommy M. Tang Yifan Ding S. Tatikonda Nicha Dvornek X. Papademetris James S. Duncan ODL 524 551 0 15 Oct 2020
Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers Robin M. Schmidt Frank Schneider Philipp Hennig ODL 341 175 0 03 Jul 2020