Efficient-Adam: Communication-Efficient Distributed Adam

Efficient-Adam: Communication-Efficient Distributed Adam

28 May 2022

Li Shen

Wei Liu

Papers citing "Efficient-Adam: Communication-Efficient Distributed Adam"

9 / 9 papers shown

Title
Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis Zhijie Chen Qiaobo Li A. Banerjee FedML 24 0 0 11 Nov 2024
AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks Hao Sun Li Shen Qihuang Zhong Liang Ding Shi-Yong Chen Jingwei Sun Jing Li Guangzhong Sun Dacheng Tao 41 31 0 01 Mar 2023
FedSpeed: Larger Local Interval, Less Communication Round, and Higher Generalization Accuracy Yan Sun Li Shen Tiansheng Huang Liang Ding Dacheng Tao FedML 29 50 0 21 Feb 2023
FedDA: Faster Framework of Local Adaptive Gradient Methods via Restarted Dual Averaging Junyi Li Feihu Huang Heng-Chiao Huang FedML 14 1 0 13 Feb 2023
Communication-Efficient Adam-Type Algorithms for Distributed Data Mining Wenhan Xian Feihu Huang Heng-Chiao Huang FedML 17 0 0 14 Oct 2022
DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training Rong Dai Li Shen Fengxiang He Xinmei Tian Dacheng Tao FedML 11 102 0 01 Jun 2022
Compressed Communication for Distributed Training: Adaptive Methods and System Yuchen Zhong Cong Xie Shuai Zheng Haibin Lin 35 8 0 17 May 2021
Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration Congliang Chen Li Shen Fangyu Zou Wei Liu 30 19 0 14 Jan 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018