ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2002.09539
  4. Cited By
Overlap Local-SGD: An Algorithmic Approach to Hide Communication Delays
  in Distributed SGD

Overlap Local-SGD: An Algorithmic Approach to Hide Communication Delays in Distributed SGD

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020
21 February 2020
Jianyu Wang
Hao Liang
Gauri Joshi
ArXiv (abs)PDFHTML

Papers citing "Overlap Local-SGD: An Algorithmic Approach to Hide Communication Delays in Distributed SGD"

11 / 11 papers shown
Adaptive Consensus Gradients Aggregation for Scaled Distributed Training
Adaptive Consensus Gradients Aggregation for Scaled Distributed Training
Yoni Choukroun
Shlomi Azoulay
P. Kisilev
310
0
0
06 Nov 2024
CO2: Efficient Distributed Training with Full Communication-Computation
  Overlap
CO2: Efficient Distributed Training with Full Communication-Computation Overlap
Weigao Sun
Zhen Qin
Weixuan Sun
Shidi Li
Dong Li
Xuyang Shen
Yu Qiao
Yiran Zhong
OffRL
317
15
0
29 Jan 2024
Straggler-Resilient Decentralized Learning via Adaptive Asynchronous
  Updates
Straggler-Resilient Decentralized Learning via Adaptive Asynchronous UpdatesACM Interational Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), 2023
Efstathia Soufleri
Gang Yan
Maroun Touma
Jian Li
273
7
0
11 Jun 2023
EfficientNet for Brain-Lesion classification
EfficientNet for Brain-Lesion classification
Quoc-Huy Trinh
Trong-Hieu Nguyen-Mau
Radmir Zosimov
Minh Le Nguyen
MedIm
81
1
0
09 Aug 2022
Scaling the Wild: Decentralizing Hogwild!-style Shared-memory SGD
Scaling the Wild: Decentralizing Hogwild!-style Shared-memory SGD
Bapi Chatterjee
Vyacheslav Kungurtsev
Dan Alistarh
FedML
165
2
0
13 Mar 2022
Adaptive Quantization of Model Updates for Communication-Efficient
  Federated Learning
Adaptive Quantization of Model Updates for Communication-Efficient Federated LearningIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2021
Divyansh Jhunjhunwala
Advait Gadhikar
Gauri Joshi
Yonina C. Eldar
FedMLMQ
248
130
0
08 Feb 2021
Accordion: Adaptive Gradient Communication via Critical Learning Regime
  Identification
Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification
Saurabh Agarwal
Hongyi Wang
Kangwook Lee
Shivaram Venkataraman
Dimitris Papailiopoulos
205
29
0
29 Oct 2020
Towards Tight Communication Lower Bounds for Distributed Optimisation
Towards Tight Communication Lower Bounds for Distributed OptimisationNeural Information Processing Systems (NeurIPS), 2020
Dan Alistarh
Janne H. Korhonen
FedML
202
10
0
16 Oct 2020
Improving Semi-supervised Federated Learning by Reducing the Gradient
  Diversity of Models
Improving Semi-supervised Federated Learning by Reducing the Gradient Diversity of Models
Zhengming Zhang
Yaoqing Yang
Z. Yao
Yujun Yan
Joseph E. Gonzalez
Michael W. Mahoney
FedML
346
39
0
26 Aug 2020
Tackling the Objective Inconsistency Problem in Heterogeneous Federated
  Optimization
Tackling the Objective Inconsistency Problem in Heterogeneous Federated OptimizationNeural Information Processing Systems (NeurIPS), 2020
Jianyu Wang
Qinghua Liu
Hao Liang
Gauri Joshi
H. Vincent Poor
MoMeFedML
758
1,820
0
15 Jul 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local
  Updates
A Unified Theory of Decentralized SGD with Changing Topology and Local UpdatesInternational Conference on Machine Learning (ICML), 2020
Anastasia Koloskova
Nicolas Loizou
Sadra Boreiri
Martin Jaggi
Sebastian U. Stich
FedML
650
610
0
23 Mar 2020
1
Page 1 of 1