Sharper Convergence Guarantees for Asynchronous SGD for Distributed and
Federated Learning

Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning

16 June 2022

Anastasia Koloskova

Sebastian U. Stich

Papers citing "Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning"

17 / 17 papers shown

Title
Convergence Analysis of Asynchronous Federated Learning with Gradient Compression for Non-Convex Optimization Diying Yang Yingwei Hou Danyang Xiao Weigang Wu FedML 34 0 0 28 Apr 2025
Orthogonal Calibration for Asynchronous Federated Learning Jiayun Zhang Shuheng Li Haiyu Huang Xiaofan Yu Rajesh K. Gupta Jingbo Shang FedML 58 0 0 21 Feb 2025
Faster Stochastic Optimization with Arbitrary Delays via Asynchronous Mini-Batching Amit Attia Ofir Gaash Tomer Koren 35 0 0 14 Aug 2024
Ordered Momentum for Asynchronous SGD Chang-Wei Shi Yi-Rui Yang Wu-Jun Li ODL 52 0 0 27 Jul 2024
Understanding Server-Assisted Federated Learning in the Presence of Incomplete Client Participation Haibo Yang Pei-Yuan Qiu Prashant Khanduri Minghong Fang Jia Liu FedML 21 1 0 04 May 2024
Asynchronous Federated Reinforcement Learning with Policy Gradient Updates: Algorithm Design and Convergence Analysis Guangchen Lan Dong-Jun Han Abolfazl Hashemi Vaneet Aggarwal Christopher G. Brinton 122 15 0 09 Apr 2024
EchoPFL: Asynchronous Personalized Federated Learning on Mobile Devices with On-Demand Staleness Control Xiaocheng Li Si-ren Liu Zimu Zhou Bin Guo Yuan Xu Zhiwen Yu 22 0 0 29 Jan 2024
Convergence Analysis of Decentralized ASGD Mauro Dalle Lucca Tosi Martin Theobald 21 2 0 07 Sep 2023
Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation Tomàs Ortega Hamid Jafarkhani FedML 19 6 0 01 Aug 2023
Federated Gradient Matching Pursuit Halyun Jeong Deanna Needell Jing Qin FedML 33 1 0 20 Feb 2023
Efficient and Light-Weight Federated Learning via Asynchronous Distributed Dropout Chen Dun Mirian Hipolito Garcia C. Jermaine Dimitrios Dimitriadis Anastasios Kyrillidis 47 20 0 28 Oct 2022
PersA-FL: Personalized Asynchronous Federated Learning Taha Toghani Soomin Lee César A. Uribe FedML 24 6 0 03 Oct 2022
Unbounded Gradients in Federated Learning with Buffered Asynchronous Aggregation Taha Toghani César A. Uribe FedML 35 14 0 03 Oct 2022
Delay-adaptive step-sizes for asynchronous learning Xuyang Wu Sindri Magnússon Hamid Reza Feyzmahdavian M. Johansson 23 14 0 17 Feb 2022
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,764 0 24 Feb 2021
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,815 0 17 Sep 2019
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 164 683 0 07 Dec 2010