Gap Aware Mitigation of Gradient Staleness

v1v2v3 (latest)

Gap Aware Mitigation of Gradient Staleness

24 September 2019

ArXiv (abs)PDF HTML

Papers citing "Gap Aware Mitigation of Gradient Staleness"

5 / 5 papers shown

Title
Ferret: An Efficient Online Continual Learning Framework under Varying Memory Constraints Yuhao Zhou Yuxin Tian Jindi Lv Mingjia Shi Yuanxi Li Qing Ye Shuhao Zhang Jiancheng Lv CLL 103 0 0 15 Mar 2025
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework Siyuan Yu Wei Chen H. V. Poor 96 0 0 17 Jun 2024
Reducing Impacts of System Heterogeneity in Federated Learning using Weight Update Magnitudes Irene Wang 73 1 0 30 Aug 2022
GBA: A Tuning-free Approach to Switch between Synchronous and Asynchronous Training for Recommendation Model Wenbo Su Yuanxing Zhang Yufeng Cai Kaixu Ren Pengjie Wang ... Jing Chen Hongbo Deng Jian Xu Lin Qu Bo Zheng 57 5 0 23 May 2022
Taming Momentum in a Distributed Asynchronous Environment Ido Hakimi Saar Barkai Moshe Gabel Assaf Schuster 93 23 0 26 Jul 2019