Advances in Asynchronous Parallel and Distributed Optimization

Advances in Asynchronous Parallel and Distributed Optimization

24 June 2020

By Mahmoud Assran

Hamid Reza Feyzmahdavian

Michael G. Rabbat

Papers citing "Advances in Asynchronous Parallel and Distributed Optimization"

16 / 16 papers shown

Title
Nesterov Method for Asynchronous Pipeline Parallel Optimization Thalaiyasingam Ajanthan Sameera Ramasinghe Yan Zuo Gil Avraham Alexander Long 24 0 0 02 May 2025
Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates Cabrel Teguemne Fokam Khaleelulla Khan Nazeer Lukas König David Kappel Anand Subramoney 28 0 0 08 Oct 2024
Escaping From Saddle Points Using Asynchronous Coordinate Gradient Descent Marco Bornstein Jin-Peng Liu Jingling Li Furong Huang 15 0 0 17 Nov 2022
Asynchronous Gradient Play in Zero-Sum Multi-agent Games Ruicheng Ao Shicong Cen Yuejie Chi 40 5 0 16 Nov 2022
Impact of Redundancy on Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 26 2 0 16 Nov 2022
Clustered Federated Learning based on Nonconvex Pairwise Fusion Xue Yu Ziyi Liu Wu Wang Yifan Sun FedML 32 7 0 08 Nov 2022
PersA-FL: Personalized Asynchronous Federated Learning Taha Toghani Soomin Lee César A. Uribe FedML 34 6 0 03 Oct 2022
Unbounded Gradients in Federated Learning with Buffered Asynchronous Aggregation Taha Toghani César A. Uribe FedML 35 14 0 03 Oct 2022
ResIST: Layer-Wise Decomposition of ResNets for Distributed Training Chen Dun Cameron R. Wolfe C. Jermaine Anastasios Kyrillidis 16 21 0 02 Jul 2021
Federated Learning with Buffered Asynchronous Aggregation John Nguyen Kshitiz Malik Hongyuan Zhan Ashkan Yousefpour Michael G. Rabbat Mani Malek Dzmitry Huba FedML 30 288 0 11 Jun 2021
Asynchronous Distributed Optimization with Redundancy in Cost Functions Shuo Liu Nirupam Gupta Nitin H. Vaidya 10 3 0 07 Jun 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 29 31 0 04 Mar 2021
Buffered Asynchronous SGD for Byzantine Learning Yi-Rui Yang Wu-Jun Li FedML 22 5 0 02 Mar 2020
Surpassing Gradient Descent Provably: A Cyclic Incremental Method with Linear Convergence Rate Aryan Mokhtari Mert Gurbuzbalaban Alejandro Ribeiro 22 36 0 01 Nov 2016
Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning Julien Mairal 76 317 0 18 Feb 2014
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 171 683 0 07 Dec 2010