Sharper Convergence Guarantees for Asynchronous SGD for Distributed and
Federated Learning

Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning

Neural Information Processing Systems (NeurIPS), 2022

16 June 2022

Anastasia Koloskova

Sebastian U. Stich

ArXiv (abs)PDF HTML

Papers citing "Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning"

13 / 63 papers shown

Title
FAVANO: Federated AVeraging with Asynchronous NOdesIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 Louis Leconte Van Minh Nguyen Eric Moulines FedML 269 3 0 25 May 2023
Post Quantum Secure Blockchain-based Federated Learning for Mobile Edge Computing Rongxin Xu Mengyue Deng Qiujun Lan Gang Li 144 8 0 26 Feb 2023
Federated Gradient Matching PursuitIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2023 Halyun Jeong Deanna Needell Jing Qin FedML 160 2 0 20 Feb 2023
Delayed Stochastic Algorithms for Distributed Weakly Convex Optimization W. Gao Qinhao Deng 268 0 0 30 Jan 2023
Efficient and Light-Weight Federated Learning via Asynchronous Distributed DropoutInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022 Chen Dun Mirian Hipolito Garcia C. Jermaine Dimitrios Dimitriadis Anastasios Kyrillidis 204 28 0 28 Oct 2022
SWIFT: Rapid Decentralized Federated Learning via Wait-Free Model CommunicationInternational Conference on Learning Representations (ICLR), 2022 Marco Bornstein Tahseen Rabbani Evana Wang Amrit Singh Bedi Furong Huang FedML 211 25 0 25 Oct 2022
PersA-FL: Personalized Asynchronous Federated LearningOptimization Methods and Software (OMS), 2022 Taha Toghani Soomin Lee César A. Uribe FedML 285 8 0 03 Oct 2022
Unbounded Gradients in Federated Learning with Buffered Asynchronous AggregationAllerton Conference on Communication, Control, and Computing (Allerton), 2022 Taha Toghani César A. Uribe FedML 191 17 0 03 Oct 2022
EF21-P and Friends: Improved Theoretical Communication Complexity for Distributed Optimization with Bidirectional CompressionInternational Conference on Machine Learning (ICML), 2022 Kaja Gruntkowska Alexander Tyurin Peter Richtárik 350 32 0 30 Sep 2022
Communication-Efficient Federated Learning With Data and Client HeterogeneityInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022 Hossein Zakerinia Shayan Talaei Giorgi Nadiradze Dan Alistarh FedML 411 12 0 20 Jun 2022
Asynchronous SGD Beats Minibatch SGD Under Arbitrary DelaysNeural Information Processing Systems (NeurIPS), 2022 Konstantin Mishchenko Francis R. Bach Mathieu Even Blake E. Woodworth 236 69 0 15 Jun 2022
Asynchronous Iterations in Optimization: New Sequence Results and Sharper Algorithmic GuaranteesJournal of machine learning research (JMLR), 2021 Hamid Reza Feyzmahdavian M. Johansson 197 27 0 09 Sep 2021
Asynchronous speedup in decentralized optimizationIEEE Transactions on Automatic Control (IEEE TAC), 2021 Mathieu Even Aymeric Dieuleveut Laurent Massoulie 186 5 0 07 Jun 2021