More Iterations per Second, Same Quality -- Why Asynchronous Algorithms may Drastically Outperform Traditional Ones

17 August 2017

Papers citing "More Iterations per Second, Same Quality -- Why Asynchronous Algorithms may Drastically Outperform Traditional Ones"

10 / 10 papers shown

Title
Impact of Redundancy on Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 103 2 0 16 Nov 2022
Accelerating Parallel Stochastic Gradient Descent via Non-blocking Mini-batches Haoze He Parijat Dube 68 3 0 02 Nov 2022
Towards Efficient and Stable K-Asynchronous Federated Learning with Unbounded Stale Gradients on Non-IID Data Zihao Zhou Yanan Li Xuebin Ren Shusen Yang 76 31 0 02 Mar 2022
Utilizing Redundancy in Cost Functions for Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 61 0 0 21 Oct 2021
Asynchronous Iterations in Optimization: New Sequence Results and Sharper Algorithmic Guarantees Hamid Reza Feyzmahdavian M. Johansson 81 21 0 09 Sep 2021
Asynchronous Federated Learning with Differential Privacy for Edge Intelligence Yanan Li Shusen Yang Xuebin Ren Cong Zhao FedML 78 35 0 17 Dec 2019
AsyncQVI: Asynchronous-Parallel Q-Value Iteration for Discounted Markov Decision Processes with Near-Optimal Sample Complexity Yibo Zeng Fei Feng W. Yin 56 3 0 03 Dec 2018
A Distributed Flexible Delay-tolerant Proximal Gradient Algorithm Konstantin Mishchenko F. Iutzeler J. Malick 83 22 0 25 Jun 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 82 198 0 03 Mar 2018
DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization Lin Xiao Adams Wei Yu Qihang Lin Weizhu Chen 77 59 0 13 Oct 2017