Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration

14 January 2021

Li Shen

Wei Liu

Papers citing "Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration"

4 / 4 papers shown

Title
Efficient Federated Learning via Local Adaptive Amended Optimizer with Linear Speedup Yan Sun Li Shen Hao Sun Liang Ding Dacheng Tao FedML 16 16 0 30 Jul 2023
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach Peng Mi Li Shen Tianhe Ren Yiyi Zhou Xiaoshuai Sun Rongrong Ji Dacheng Tao AAML 10 69 0 11 Oct 2022
Efficient-Adam: Communication-Efficient Distributed Adam Congliang Chen Li Shen Wei Liu Z. Luo 21 19 0 28 May 2022
A Simple Convergence Proof of Adam and Adagrad Alexandre Défossez Léon Bottou Francis R. Bach Nicolas Usunier 56 143 0 05 Mar 2020