Communication-efficient distributed SGD with Sketching

v1v2v3 (latest)

Communication-efficient distributed SGD with Sketching

12 March 2019

Vladimir Braverman

ArXiv (abs)PDF HTML

Papers citing "Communication-efficient distributed SGD with Sketching"

7 / 57 papers shown

Title
Federated Learning with Compression: Unified Analysis and Sharp Guarantees Farzin Haddadpour Mohammad Mahdi Kamani Aryan Mokhtari M. Mahdavi FedML 104 281 0 02 Jul 2020
Is Network the Bottleneck of Distributed Training? Zhen Zhang Chaokun Chang Yanghua Peng Yida Wang R. Arora Xin Jin 89 71 0 17 Jun 2020
Fast generalized Nash equilibrium seeking under partial-decision information M. Bianchi Giuseppe Belgioioso Sergio Grammatico 61 69 0 20 Mar 2020
Trends and Advancements in Deep Neural Network Communication Felix Sattler Thomas Wiegand Wojciech Samek GNN 67 9 0 06 Mar 2020
Communication-Efficient and Byzantine-Robust Distributed Learning with Error Feedback Avishek Ghosh R. Maity S. Kadhe A. Mazumdar Kannan Ramchandran FedML 54 27 0 21 Nov 2019
Layer-wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees Shaoshuai Shi Zhenheng Tang Qiang-qiang Wang Kaiyong Zhao Xiaowen Chu 65 22 0 20 Nov 2019
Distributed Learning of Deep Neural Networks using Independent Subnet Training John Shelton Hyatt Cameron R. Wolfe Michael Lee Yuxin Tang Anastasios Kyrillidis Christopher M. Jermaine OOD 92 39 0 04 Oct 2019