The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication

19 May 2024

Papers citing "The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication"

8 / 8 papers shown

Title
Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis Ruichen Luo Sebastian U Stich Samuel Horváth Martin Takáč 33 0 0 08 Jan 2025
Task Arithmetic Through The Lens Of One-Shot Federated Learning Zhixu Tao I. Mason Sanjeev R. Kulkarni Xavier Boix MoMe FedML 77 3 0 27 Nov 2024
The Effectiveness of Local Updates for Decentralized Learning under Data Heterogeneity Tongle Wu Ying Sun 20 0 0 23 Mar 2024
Federated Online and Bandit Convex Optimization Kumar Kshitij Patel Lingxiao Wang Aadirupa Saha Nathan Srebro FedML 31 8 0 29 Nov 2023
On-Demand Sampling: Learning Optimally from Multiple Distributions Nika Haghtalab Michael I. Jordan Eric Zhao FedML 37 34 0 22 Oct 2022
A Stochastic Newton Algorithm for Distributed Convex Optimization Brian Bullins Kumar Kshitij Patel Ohad Shamir Nathan Srebro Blake E. Woodworth 16 15 0 07 Oct 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 167 410 0 14 Jul 2021
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 156 684 0 07 Dec 2010