ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1705.09056
  4. Cited By
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case
  Study for Decentralized Parallel Stochastic Gradient Descent
v1v2v3v4v5 (latest)

Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent

25 May 2017
Xiangru Lian
Ce Zhang
Huan Zhang
Cho-Jui Hsieh
Wei Zhang
Ji Liu
ArXiv (abs)PDFHTML

Papers citing "Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent"

27 / 627 papers shown
LEASGD: an Efficient and Privacy-Preserving Decentralized Algorithm for
  Distributed Learning
LEASGD: an Efficient and Privacy-Preserving Decentralized Algorithm for Distributed Learning
Hsin-Pai Cheng
P. Yu
Haojing Hu
Feng Yan
Shiyu Li
Hai Helen Li
Yiran Chen
FedML
177
26
0
27 Nov 2018
Stochastic Gradient Push for Distributed Deep Learning
Stochastic Gradient Push for Distributed Deep Learning
Mahmoud Assran
Nicolas Loizou
Nicolas Ballas
Michael G. Rabbat
297
382
0
27 Nov 2018
Pipe-SGD: A Decentralized Pipelined SGD Framework for Distributed Deep
  Net Training
Pipe-SGD: A Decentralized Pipelined SGD Framework for Distributed Deep Net TrainingNeural Information Processing Systems (NeurIPS), 2018
Youjie Li
Hang Qiu
Songze Li
A. Avestimehr
Nam Sung Kim
Alex Schwing
FedML
322
108
0
08 Nov 2018
Adaptive Communication Strategies to Achieve the Best Error-Runtime
  Trade-off in Local-Update SGD
Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGD
Jianyu Wang
Gauri Joshi
FedML
206
245
0
19 Oct 2018
Distributed Learning over Unreliable Networks
Distributed Learning over Unreliable Networks
Chen Yu
Hanlin Tang
Cédric Renggli
S. Kassing
Ankit Singla
Dan Alistarh
Ce Zhang
Ji Liu
OOD
267
66
0
17 Oct 2018
Accelerated Decentralized Optimization with Local Updates for Smooth and
  Strongly Convex Objectives
Accelerated Decentralized Optimization with Local Updates for Smooth and Strongly Convex Objectives
Aymeric Dieuleveut
Francis R. Bach
Laurent Massoulié
239
46
0
05 Oct 2018
Graph-Dependent Implicit Regularisation for Distributed Stochastic
  Subgradient Descent
Graph-Dependent Implicit Regularisation for Distributed Stochastic Subgradient Descent
Dominic Richards
Patrick Rebeschini
192
20
0
18 Sep 2018
Cooperative SGD: A unified Framework for the Design and Analysis of
  Communication-Efficient SGD Algorithms
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms
Jianyu Wang
Gauri Joshi
395
357
0
22 Aug 2018
COLA: Decentralized Linear Learning
COLA: Decentralized Linear Learning
Lie He
An Bian
Martin Jaggi
260
131
0
13 Aug 2018
Parallel Restarted SGD with Faster Convergence and Less Communication:
  Demystifying Why Model Averaging Works for Deep Learning
Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep LearningAAAI Conference on Artificial Intelligence (AAAI), 2018
Hao Yu
Sen Yang
Shenghuo Zhu
MoMeFedML
484
663
0
17 Jul 2018
A Simple Stochastic Variance Reduced Algorithm with Fast Convergence
  Rates
A Simple Stochastic Variance Reduced Algorithm with Fast Convergence RatesInternational Conference on Machine Learning (ICML), 2018
Kaiwen Zhou
Fanhua Shang
James Cheng
186
80
0
28 Jun 2018
Pushing the boundaries of parallel Deep Learning -- A practical approach
Pushing the boundaries of parallel Deep Learning -- A practical approach
Paolo Viviani
M. Drocco
Marco Aldinucci
OOD
108
1
0
25 Jun 2018
Defending Against Saddle Point Attack in Byzantine-Robust Distributed
  Learning
Defending Against Saddle Point Attack in Byzantine-Robust Distributed Learning
Dong Yin
Yudong Chen
Kannan Ramchandran
Peter L. Bartlett
FedML
437
104
0
14 Jun 2018
On Consensus-Optimality Trade-offs in Collaborative Deep Learning
On Consensus-Optimality Trade-offs in Collaborative Deep Learning
Zhanhong Jiang
Aditya Balu
Chinmay Hegde
Soumik Sarkar
FedML
109
9
0
30 May 2018
Distributed Stochastic Gradient Tracking Methods
Distributed Stochastic Gradient Tracking Methods
Shi Pu
A. Nedić
461
345
0
25 May 2018
Adaptive Federated Learning in Resource Constrained Edge Computing
  Systems
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Maroun Touma
Tiffany Tuor
Theodoros Salonidis
K. Leung
C. Makaya
T. He
Kevin S. Chan
658
1,939
0
14 Apr 2018
Distributed Non-Convex First-Order Optimization and Information
  Processing: Lower Complexity Bounds and Rate Optimal Algorithms
Distributed Non-Convex First-Order Optimization and Information Processing: Lower Complexity Bounds and Rate Optimal Algorithms
Haoran Sun
Mingyi Hong
324
52
0
08 Apr 2018
A Distributed Stochastic Gradient Tracking Method
A Distributed Stochastic Gradient Tracking Method
Shi Pu
A. Nedić
266
63
0
21 Mar 2018
D$^2$: Decentralized Training over Decentralized Data
D2^22: Decentralized Training over Decentralized Data
Hanlin Tang
Xiangru Lian
Ming Yan
Ce Zhang
Ji Liu
248
374
0
19 Mar 2018
Communication Compression for Decentralized Training
Communication Compression for Decentralized Training
Hanlin Tang
Shaoduo Gan
Ce Zhang
Tong Zhang
Ji Liu
353
294
0
17 Mar 2018
VR-SGD: A Simple Stochastic Variance Reduction Method for Machine
  Learning
VR-SGD: A Simple Stochastic Variance Reduction Method for Machine LearningIEEE Transactions on Knowledge and Data Engineering (TKDE), 2018
Fanhua Shang
Kaiwen Zhou
Hongying Liu
James Cheng
Ivor W. Tsang
Lijun Zhang
Dacheng Tao
L. Jiao
207
72
0
26 Feb 2018
Demystifying Parallel and Distributed Deep Learning: An In-Depth
  Concurrency Analysis
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency AnalysisACM Computing Surveys (CSUR), 2018
Tal Ben-Nun
Torsten Hoefler
GNN
315
770
0
26 Feb 2018
Feature-Distributed SVRG for High-Dimensional Linear Classification
Feature-Distributed SVRG for High-Dimensional Linear Classification
Gong-Duo Zhang
Shen-Yi Zhao
Hao Gao
Wu-Jun Li
116
18
0
10 Feb 2018
Performance Modeling and Evaluation of Distributed Deep Learning
  Frameworks on GPUs
Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs
Shaoshuai Shi
Qiang-qiang Wang
Xiaowen Chu
268
117
0
16 Nov 2017
Asynchronous Decentralized Parallel Stochastic Gradient Descent
Asynchronous Decentralized Parallel Stochastic Gradient Descent
Xiangru Lian
Wei Zhang
Ce Zhang
Ji Liu
ODL
343
537
0
18 Oct 2017
The duality structure gradient descent algorithm: analysis and
  applications to neural networks
The duality structure gradient descent algorithm: analysis and applications to neural networks
Thomas Flynn
172
6
0
01 Aug 2017
On Nonconvex Decentralized Gradient Descent
On Nonconvex Decentralized Gradient DescentIEEE Transactions on Signal Processing (IEEE TSP), 2016
Jinshan Zeng
W. Yin
318
209
0
20 Aug 2016
Previous
123...111213