ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1705.09056
  4. Cited By
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case
  Study for Decentralized Parallel Stochastic Gradient Descent
v1v2v3v4v5 (latest)

Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent

25 May 2017
Xiangru Lian
Ce Zhang
Huan Zhang
Cho-Jui Hsieh
Wei Zhang
Ji Liu
ArXiv (abs)PDFHTML

Papers citing "Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent"

50 / 627 papers shown
DePRL: Achieving Linear Convergence Speedup in Personalized
  Decentralized Learning with Shared Representations
DePRL: Achieving Linear Convergence Speedup in Personalized Decentralized Learning with Shared Representations
Efstathia Soufleri
Gang Yan
Maroun Touma
Jian Li
302
9
0
17 Dec 2023
Topology-Dependent Privacy Bound For Decentralized Federated Learning
Topology-Dependent Privacy Bound For Decentralized Federated LearningIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Qiongxiu Li
Wenrui Yu
Changlong Ji
Richard Heusdens
199
3
0
13 Dec 2023
Coordination-free Decentralised Federated Learning on Complex Networks:
  Overcoming Heterogeneity
Coordination-free Decentralised Federated Learning on Complex Networks: Overcoming Heterogeneity
Lorenzo Valerio
Chiara Boldrini
A. Passarella
János Kertész
Márton Karsai
Gerardo Iniguez
FedML
239
6
0
07 Dec 2023
A Single-Loop Algorithm for Decentralized Bilevel Optimization
A Single-Loop Algorithm for Decentralized Bilevel OptimizationMathematics of Operations Research (MOR), 2023
Youran Dong
Shiqian Ma
Junfeng Yang
Chao Yin
386
9
0
15 Nov 2023
Compressed and Sparse Models for Non-Convex Decentralized Learning
Compressed and Sparse Models for Non-Convex Decentralized Learning
Andrew Campbell
Hang Liu
Leah Woldemariam
Anna Scaglione
205
0
0
09 Nov 2023
EControl: Fast Distributed Optimization with Compression and Error
  Control
EControl: Fast Distributed Optimization with Compression and Error ControlInternational Conference on Learning Representations (ICLR), 2023
Yuan Gao
Rustem Islamov
Sebastian U. Stich
259
17
0
06 Nov 2023
Asynchronous SGD on Graphs: a Unified Framework for Asynchronous
  Decentralized and Federated Optimization
Asynchronous SGD on Graphs: a Unified Framework for Asynchronous Decentralized and Federated OptimizationInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Mathieu Even
Anastasia Koloskova
Laurent Massoulié
FedML
341
17
0
01 Nov 2023
Stability and Generalization of the Decentralized Stochastic Gradient
  Descent Ascent Algorithm
Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent AlgorithmNeural Information Processing Systems (NeurIPS), 2023
Miaoxi Zhu
Li Shen
Bo Du
Dacheng Tao
219
9
0
31 Oct 2023
Peer-to-Peer Deep Learning for Beyond-5G IoT
Peer-to-Peer Deep Learning for Beyond-5G IoTAsilomar Conference on Signals, Systems and Computers (ACSSC), 2023
Srinivasa Pranav
José M. F. Moura
235
4
0
29 Oct 2023
Decentralized Learning over Wireless Networks with Broadcast-Based
  Subgraph Sampling
Decentralized Learning over Wireless Networks with Broadcast-Based Subgraph Sampling
Daniel Pérez Herrera
Zheng Chen
Erik G. Larsson
261
2
0
24 Oct 2023
Locally Differentially Private Gradient Tracking for Distributed Online
  Learning over Directed Graphs
Locally Differentially Private Gradient Tracking for Distributed Online Learning over Directed GraphsIEEE Transactions on Automatic Control (TAC), 2023
Ziqin Chen
Yongqiang Wang
FedML
224
6
0
24 Oct 2023
Cross-feature Contrastive Loss for Decentralized Deep Learning on
  Heterogeneous Data
Cross-feature Contrastive Loss for Decentralized Deep Learning on Heterogeneous DataIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023
Sai Aparna Aketi
Kaushik Roy
FedML
319
2
0
24 Oct 2023
Federated Multi-Level Optimization over Decentralized Networks
Federated Multi-Level Optimization over Decentralized Networks
Shuoguang Yang
Xuezhou Zhang
Mengdi Wang
AI4CE
197
0
0
10 Oct 2023
Asymmetrically Decentralized Federated Learning
Asymmetrically Decentralized Federated LearningIEEE transactions on computers (IEEE Trans. Comput.), 2023
Qinglun Li
Miao Zhang
Nan Yin
Quanjun Yin
Li Shen
FedML
313
6
0
08 Oct 2023
Epidemic Learning: Boosting Decentralized Learning with Randomized
  Communication
Epidemic Learning: Boosting Decentralized Learning with Randomized CommunicationNeural Information Processing Systems (NeurIPS), 2023
M. Vos
Sadegh Farhadkhani
R. Guerraoui
Anne-Marie Kermarrec
Rafael Pires
Rishi Sharma
310
25
0
03 Oct 2023
Home Electricity Data Generator (HEDGE): An open-access tool for the
  generation of electric vehicle, residential demand, and PV generation
  profiles
Home Electricity Data Generator (HEDGE): An open-access tool for the generation of electric vehicle, residential demand, and PV generation profilesMethodsX (MethodsX), 2023
Flora Charbonnier
Thomas Morstyn
Malcolm McCulloch
170
4
0
02 Oct 2023
Collaborative Distributed Machine Learning
Collaborative Distributed Machine LearningACM Computing Surveys (ACM Comput. Surv.), 2023
Sumit Kumar Jha
Patrick Lincoln
Sascha Rank
Ali Sunyaev
394
5
0
28 Sep 2023
A Multi-Token Coordinate Descent Method for Semi-Decentralized Vertical
  Federated Learning
A Multi-Token Coordinate Descent Method for Semi-Decentralized Vertical Federated Learning
Pedro Valdeira
Yuejie Chi
Cláudia Soares
Joao Xavier
196
3
0
18 Sep 2023
Convergence Analysis of Decentralized ASGD
Convergence Analysis of Decentralized ASGD
Mauro Dalle Lucca Tosi
Martin Theobald
264
3
0
07 Sep 2023
Distributed Variational Inference for Online Supervised Learning
Distributed Variational Inference for Online Supervised LearningIEEE Transactions on Control of Network Systems (IEEE TCNS), 2023
P. Paritosh
Nikolay Atanasov
Sonia Martinez
283
1
0
05 Sep 2023
DRAG: Divergence-based Adaptive Aggregation in Federated learning on
  Non-IID Data
DRAG: Divergence-based Adaptive Aggregation in Federated learning on Non-IID Data
Feng Zhu
Jingjing Zhang
Shengyun Liu
Xin Eric Wang
FedML
228
1
0
04 Sep 2023
Sparse Decentralized Federated Learning
Sparse Decentralized Federated LearningIEEE Transactions on Signal Processing (IEEE TSP), 2023
Shenglong Zhou
Kaidi Xu
Geoffrey Ye Li
Geoffrey Ye Li
FedML
139
0
0
31 Aug 2023
On the Tradeoff between Privacy Preservation and Byzantine-Robustness in
  Decentralized Learning
On the Tradeoff between Privacy Preservation and Byzantine-Robustness in Decentralized LearningIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Haoxiang Ye
He Zhu
Qing Ling
FedML
390
20
0
28 Aug 2023
Heterogeneous Decentralized Machine Unlearning with Seed Model
  Distillation
Heterogeneous Decentralized Machine Unlearning with Seed Model Distillation
Guanhua Ye
Tong Chen
Quoc Viet Hung Nguyen
Hongzhi Yin
MU
241
5
0
25 Aug 2023
DFedADMM: Dual Constraints Controlled Model Inconsistency for
  Decentralized Federated Learning
DFedADMM: Dual Constraints Controlled Model Inconsistency for Decentralized Federated Learning
Qinglun Li
Li Shen
Guang-Ming Li
Quanjun Yin
Dacheng Tao
FedML
138
7
0
16 Aug 2023
Decentralized Graph Neural Network for Privacy-Preserving Recommendation
Decentralized Graph Neural Network for Privacy-Preserving RecommendationInternational Conference on Information and Knowledge Management (CIKM), 2023
Xiaolin Zheng
Zhongyu Wang
Chaochao Chen
Jiashu Qian
Yao Yang
FedML
118
11
0
15 Aug 2023
Byzantine-Robust Decentralized Stochastic Optimization with Stochastic
  Gradient Noise-Independent Learning Error
Byzantine-Robust Decentralized Stochastic Optimization with Stochastic Gradient Noise-Independent Learning ErrorSignal Processing (Signal Process.), 2023
Jie Peng
Weiyu Li
Qing Ling
150
4
0
10 Aug 2023
Serverless Federated AUPRC Optimization for Multi-Party Collaborative
  Imbalanced Data Mining
Serverless Federated AUPRC Optimization for Multi-Party Collaborative Imbalanced Data MiningKnowledge Discovery and Data Mining (KDD), 2023
Xidong Wu
Zhengmian Hu
Jian Pei
Heng Huang
219
13
0
06 Aug 2023
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive ReviewEuropean Journal of Electrical Engineering and Computer Science (EJECE), 2023
Sajjad Emdadi Mahdimahalleh
AI4CE
283
6
0
01 Aug 2023
Achieving Linear Speedup in Decentralized Stochastic Compositional
  Minimax Optimization
Achieving Linear Speedup in Decentralized Stochastic Compositional Minimax Optimization
Hongchang Gao
264
1
0
25 Jul 2023
Robust Fully-Asynchronous Methods for Distributed Training over General
  Architecture
Robust Fully-Asynchronous Methods for Distributed Training over General Architecture
Zehan Zhu
Ye Tian
Yan Huang
Jinming Xu
Shibo He
OOD
247
2
0
21 Jul 2023
Decentralized Local Updates with Dual-Slow Estimation and Momentum-based
  Variance-Reduction for Non-Convex Optimization
Decentralized Local Updates with Dual-Slow Estimation and Momentum-based Variance-Reduction for Non-Convex OptimizationEuropean Conference on Artificial Intelligence (ECAI), 2023
Kangyang Luo
Kunkun Zhang
Sheng Zhang
Xiang Li
Ming Gao
127
2
0
17 Jul 2023
Improved Convergence Analysis and SNR Control Strategies for Federated
  Learning in the Presence of Noise
Improved Convergence Analysis and SNR Control Strategies for Federated Learning in the Presence of NoiseIEEE Access (IEEE Access), 2023
Antesh Upadhyay
Abolfazl Hashemi
234
9
0
14 Jul 2023
Variance-reduced accelerated methods for decentralized stochastic
  double-regularized nonconvex strongly-concave minimax problems
Variance-reduced accelerated methods for decentralized stochastic double-regularized nonconvex strongly-concave minimax problems
Gabriel Mancino-Ball
Yangyang Xu
321
9
0
14 Jul 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles
Le‐Yu Chen
Yaohua Ma
J.N. Zhang
439
11
0
26 Jun 2023
Differentially Private Decentralized Deep Learning with Consensus
  Algorithms
Differentially Private Decentralized Deep Learning with Consensus Algorithms
Jasmine Bayrooti
Zhan Gao
Amanda Prorok
FedML
95
1
0
24 Jun 2023
Distributed Random Reshuffling Methods with Improved Convergence
Distributed Random Reshuffling Methods with Improved ConvergenceIEEE Transactions on Automatic Control (TAC), 2023
Kun-Yen Huang
Linli Zhou
Shi Pu
366
4
0
21 Jun 2023
DropCompute: simple and more robust distributed synchronous training via
  compute variance reduction
DropCompute: simple and more robust distributed synchronous training via compute variance reductionNeural Information Processing Systems (NeurIPS), 2023
Niv Giladi
Shahar Gottlieb
Moran Shkolnik
A. Karnieli
Ron Banner
Elad Hoffer
Kfir Y. Levy
Daniel Soudry
356
4
0
18 Jun 2023
Structured Cooperative Learning with Graphical Model Priors
Structured Cooperative Learning with Graphical Model PriorsInternational Conference on Machine Learning (ICML), 2023
Shuang-Yang Li
Wanrong Zhu
Xinmei Tian
Dacheng Tao
246
0
0
16 Jun 2023
Simple Opinion Dynamics for No-Regret Learning
Simple Opinion Dynamics for No-Regret Learning
John Lazarsfeld
Dan Alistarh
259
0
0
14 Jun 2023
$\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in
  Decentralized Deep Learning
A2CiD2\textbf{A}^2\textbf{CiD}^2A2CiD2: Accelerating Asynchronous Communication in Decentralized Deep LearningNeural Information Processing Systems (NeurIPS), 2023
Adel Nabli
Eugene Belilovsky
Edouard Oyallon
346
9
0
14 Jun 2023
Lookaround Optimizer: $k$ steps around, 1 step average
Lookaround Optimizer: kkk steps around, 1 step averageNeural Information Processing Systems (NeurIPS), 2023
Jiangtao Zhang
Shunyu Liu
Mingli Song
Tongtian Zhu
Zhenxing Xu
Weilong Dai
MoMe
433
8
0
13 Jun 2023
On the Computation-Communication Trade-Off with A Flexible Gradient
  Tracking Approach
On the Computation-Communication Trade-Off with A Flexible Gradient Tracking ApproachIEEE Conference on Decision and Control (CDC), 2023
Yan Huang
Jinming Xu
234
7
0
12 Jun 2023
FedDec: Peer-to-peer Aided Federated Learning
FedDec: Peer-to-peer Aided Federated LearningInternational Workshop on Signal Processing Advances in Wireless Communications (SPAWC), 2023
Marina Costantini
Giovanni Neglia
T. Spyropoulos
FedML
135
2
0
11 Jun 2023
Straggler-Resilient Decentralized Learning via Adaptive Asynchronous
  Updates
Straggler-Resilient Decentralized Learning via Adaptive Asynchronous UpdatesACM Interational Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), 2023
Efstathia Soufleri
Gang Yan
Maroun Touma
Jian Li
260
7
0
11 Jun 2023
Communication-Efficient Zeroth-Order Distributed Online Optimization:
  Algorithm, Theory, and Applications
Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and ApplicationsIEEE Access (IEEE Access), 2023
Ege C. Kaya
M. Sahin
Abolfazl Hashemi
179
5
0
09 Jun 2023
G$^2$uardFL: Safeguarding Federated Learning Against Backdoor Attacks
  through Attributed Client Graph Clustering
G2^22uardFL: Safeguarding Federated Learning Against Backdoor Attacks through Attributed Client Graph Clustering
Hao Yu
Chuan Ma
Meng Liu
Xuhong Zhang
Ming Ding
Tao Xiang
Shouling Ji
Xinwang Liu
AAMLFedML
195
14
0
08 Jun 2023
Get More for Less in Decentralized Learning Systems
Get More for Less in Decentralized Learning SystemsIEEE International Conference on Distributed Computing Systems (ICDCS), 2023
Akash Dhasade
Anne-Marie Kermarrec
Rafael Pires
Rishi Sharma
Milos Vujasinovic
Jeffrey Wigger
227
9
0
07 Jun 2023
Decentralized Multi-Level Compositional Optimization Algorithms with
  Level-Independent Convergence Rate
Decentralized Multi-Level Compositional Optimization Algorithms with Level-Independent Convergence RateInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Hongchang Gao
244
1
0
06 Jun 2023
How Can We Train Deep Learning Models Across Clouds and Continents? An
  Experimental Study
How Can We Train Deep Learning Models Across Clouds and Continents? An Experimental StudyProceedings of the VLDB Endowment (PVLDB), 2023
Alexander Isenko
R. Mayer
Hans-Arno Jacobsen
414
11
0
05 Jun 2023
Previous
12345...111213
Next
Page 4 of 13
Pageof 13