DSGD-CECA: Decentralized SGD with Communication-Optimal Exact Consensus Algorithm

1 June 2023

Papers citing "DSGD-CECA: Decentralized SGD with Communication-Optimal Exact Consensus Algorithm"

6 / 6 papers shown

Title
Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time Runze You Shi Pu 44 0 0 20 Mar 2025
Scalable Decentralized Learning with Teleportation Yuki Takezawa Sebastian U. Stich 72 1 0 25 Jan 2025
Gradient Coding in Decentralized Learning for Evading Stragglers Chengxi Li Mikael Skoglund 42 1 0 06 Feb 2024
Communication-Efficient Federated Optimization over Semi-Decentralized Networks He Wang Yuejie Chi FedML 44 2 0 30 Nov 2023
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning Bicheng Ying Kun Yuan Hanbin Hu Yiming Chen W. Yin FedML 44 27 0 08 Nov 2021
DecentLaM: Decentralized Momentum SGD for Large-batch Deep Training Kun Yuan Yiming Chen Xinmeng Huang Yingya Zhang Pan Pan Yinghui Xu W. Yin MoE 60 61 0 24 Apr 2021