A Unified Theory of Decentralized SGD with Changing Topology and Local Updates

23 March 2020

Papers citing "A Unified Theory of Decentralized SGD with Changing Topology and Local Updates"

10 / 60 papers shown

Title
Privacy Amplification by Decentralization Edwige Cyffers A. Bellet FedML 40 39 0 09 Dec 2020
On Communication Compression for Distributed Optimization on Heterogeneous Data Sebastian U. Stich 32 22 0 04 Sep 2020
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization Jianyu Wang Qinghua Liu Hao Liang Gauri Joshi H. Vincent Poor MoMe FedML 14 1,293 0 15 Jul 2020
Stochastic Hamiltonian Gradient Methods for Smooth Games Nicolas Loizou Hugo Berard Alexia Jolicoeur-Martineau Pascal Vincent Simon Lacoste-Julien Ioannis Mitliagkas 20 51 0 08 Jul 2020
SGD for Structured Nonconvex Functions: Learning Rates, Minibatching and Interpolation Robert Mansel Gower Othmane Sebbouh Nicolas Loizou 8 74 0 18 Jun 2020
Optimal Complexity in Decentralized Training Yucheng Lu Christopher De Sa 10 71 0 15 Jun 2020
Minibatch vs Local SGD for Heterogeneous Distributed Learning Blake E. Woodworth Kumar Kshitij Patel Nathan Srebro FedML 13 198 0 08 Jun 2020
New Convergence Aspects of Stochastic Gradient Algorithms Lam M. Nguyen Phuong Ha Nguyen Peter Richtárik K. Scheinberg Martin Takáč Marten van Dijk 18 65 0 10 Nov 2018
A simpler approach to obtaining an O(1/t) convergence rate for the projected stochastic subgradient method Simon Lacoste-Julien Mark W. Schmidt Francis R. Bach 111 259 0 10 Dec 2012
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 164 683 0 07 Dec 2010