ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2003.10422
  4. Cited By
A Unified Theory of Decentralized SGD with Changing Topology and Local
  Updates
v1v2v3 (latest)

A Unified Theory of Decentralized SGD with Changing Topology and Local Updates

International Conference on Machine Learning (ICML), 2020
23 March 2020
Anastasia Koloskova
Nicolas Loizou
Sadra Boreiri
Martin Jaggi
Sebastian U. Stich
    FedML
ArXiv (abs)PDFHTML

Papers citing "A Unified Theory of Decentralized SGD with Changing Topology and Local Updates"

50 / 336 papers shown
Row-stochastic matrices can provably outperform doubly stochastic matrices in decentralized learning
Row-stochastic matrices can provably outperform doubly stochastic matrices in decentralized learning
Bing Liu
Boao Kong
Limin Lu
Kun Yuan
Chengcheng Zhao
184
0
0
24 Nov 2025
Unified Privacy Guarantees for Decentralized Learning via Matrix Factorization
Unified Privacy Guarantees for Decentralized Learning via Matrix Factorization
A. Bellet
Edwige Cyffers
Davide Frey
Romaric Gaudel
Dimitri Lerévérend
François Taïani
237
2
0
20 Oct 2025
DFCA: Decentralized Federated Clustering Algorithm
DFCA: Decentralized Federated Clustering Algorithm
Jonas Kirch
Sebastian Becker
Tiago Koketsu Rodrigues
Stefan Harmeling
FedML
202
1
0
17 Oct 2025
Unveiling the Power of Multiple Gossip Steps: A Stability-Based Generalization Analysis in Decentralized Training
Unveiling the Power of Multiple Gossip Steps: A Stability-Based Generalization Analysis in Decentralized Training
Qinglun Li
Yingqi Liu
Miao Zhang
Xiaochun Cao
Quanjun Yin
Li Shen
161
2
0
09 Oct 2025
Bridging the Physics-Data Gap with FNO-Guided Conditional Flow Matching: Designing Inductive Bias through Hierarchical Physical Constraints
Bridging the Physics-Data Gap with FNO-Guided Conditional Flow Matching: Designing Inductive Bias through Hierarchical Physical Constraints
Tsuyoshi Okita
AI4CE
181
0
0
09 Oct 2025
Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verification
Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verification
Weihao Zeng
Keqing He
Chuqiao Kuang
X. Li
Junxian He
170
0
0
07 Oct 2025
DeMuon: A Decentralized Muon for Matrix Optimization over Graphs
DeMuon: A Decentralized Muon for Matrix Optimization over Graphs
Chuan He
Shuyi Ren
Jingwei Mao
Erik G. Larsson
159
1
0
01 Oct 2025
FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
Yuki Takezawa
Anastasia Koloskova
Xiaowen Jiang
Sebastian U. Stich
197
0
0
30 Sep 2025
Efficiency Boost in Decentralized Optimization: Reimagining Neighborhood Aggregation with Minimal Overhead
Efficiency Boost in Decentralized Optimization: Reimagining Neighborhood Aggregation with Minimal Overhead
Durgesh Kalwar
Mayank Baranwal
H. Khadilkar
117
0
0
26 Sep 2025
Decentralized Optimization with Topology-Independent Communication
Decentralized Optimization with Topology-Independent Communication
Ying Lin
Yao Kuang
Ahmet Alacaoglu
Michael P. Friedlander
143
1
0
17 Sep 2025
Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
Ahmed Khaled
Satyen Kale
Arthur Douillard
Chi Jin
Rob Fergus
Manzil Zaheer
302
3
0
12 Sep 2025
Pareto-optimal Trade-offs Between Communication and Computation with Flexible Gradient Tracking
Pareto-optimal Trade-offs Between Communication and Computation with Flexible Gradient Tracking
Yan Huang
Jinming Xu
Li Chai
Jiming Chen
Karl H. Johansson
150
0
0
11 Sep 2025
Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation
Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation
Kaoru Otsuka
Yuki Takezawa
Makoto Yamada
FedML
262
1
0
03 Sep 2025
CoCoL: A Communication Efficient Decentralized Collaborative Method for Multi-Robot Systems
CoCoL: A Communication Efficient Decentralized Collaborative Method for Multi-Robot Systems
Jiaxi Huang
Yan Huang
Yixian Zhao
Wenchao Meng
Jinming Xu
186
1
0
28 Aug 2025
Cooperative SGD with Dynamic Mixing Matrices
Cooperative SGD with Dynamic Mixing Matrices
Soumya Sarkar
Shweta Jain
248
0
0
20 Aug 2025
Random Walk Learning and the Pac-Man Attack
Xingran Chen
Parimal Parag
Rohit Bhagat
Zonghong Liu
S. E. Rouayheb
AAML
272
2
0
01 Aug 2025
On the Surprising Effectiveness of a Single Global Merging in Decentralized Learning
On the Surprising Effectiveness of a Single Global Merging in Decentralized Learning
Tongtian Zhu
Tianyu Zhang
Mingze Wang
Zhanpeng Zhou
Can Wang
FedML
399
0
0
09 Jul 2025
Robustness of Decentralised Learning to Nodes and Data Disruption
Robustness of Decentralised Learning to Nodes and Data DisruptionComputer Communications (Comput. Commun.), 2024
Luigi Palmieri
Chiara Boldrini
Lorenzo Valerio
A. Passarella
M. Conti
János Kertész
280
2
0
01 Jul 2025
Incentivizing High-quality Participation From Federated Learning Agents
Incentivizing High-quality Participation From Federated Learning Agents
Jinlong Pang
Jiaheng Wei
Yifan Hua
Chen Qian
Yang Liu
FedML
251
0
0
20 Jun 2025
Multi-Timescale Primal Dual Hybrid Gradient with Application to Distributed Optimization
Multi-Timescale Primal Dual Hybrid Gradient with Application to Distributed Optimization
Junhui Zhang
Patrick Jaillet
226
0
0
18 Jun 2025
ImprovDML: Improved Trade-off in Private Byzantine-Resilient Distributed Machine Learning
ImprovDML: Improved Trade-off in Private Byzantine-Resilient Distributed Machine Learning
Bing Liu
Chengcheng Zhao
L. Chai
Peng Cheng
Yaonan Wang
FedML
177
0
0
18 Jun 2025
Constant Stepsize Local GD for Logistic Regression: Acceleration by Instability
Constant Stepsize Local GD for Logistic Regression: Acceleration by Instability
M. Crawshaw
Blake Woodworth
Mingrui Liu
273
1
0
16 Jun 2025
Generalization Error Analysis for Attack-Free and Byzantine-Resilient Decentralized Learning with Data Heterogeneity
Generalization Error Analysis for Attack-Free and Byzantine-Resilient Decentralized Learning with Data Heterogeneity
Haoxiang Ye
Tao Sun
Qing Ling
FedML
281
0
0
11 Jun 2025
Exploiting Similarity for Computation and Communication-Efficient Decentralized Optimization
Exploiting Similarity for Computation and Communication-Efficient Decentralized Optimization
Yuki Takezawa
Xiaowen Jiang
Anton Rodomanov
Sebastian U. Stich
280
1
0
06 Jun 2025
Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism
Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism
Sameera Ramasinghe
Thalaiyasingam Ajanthan
Gil Avraham
Yan Zuo
Alexander Long
GNN
471
1
0
02 Jun 2025
Enhancing Parallelism in Decentralized Stochastic Convex Optimization
Enhancing Parallelism in Decentralized Stochastic Convex Optimization
Ofri Eisen
Ron Dorfman
Kfir Y. Levy
234
0
0
01 Jun 2025
Differential Privacy Analysis of Decentralized Gossip Averaging under Varying Threat Models
Differential Privacy Analysis of Decentralized Gossip Averaging under Varying Threat Models
A. Koskela
Tejas D. Kulkarni
392
2
0
26 May 2025
Distribution-Aware Mobility-Assisted Decentralized Federated Learning
Distribution-Aware Mobility-Assisted Decentralized Federated Learning
Md. Farhamdur Reza
Reza Jahani
Richeng Jin
H. Dai
230
1
0
24 May 2025
LocalKMeans: Convergence of Lloyd's Algorithm with Distributed Local Iterations
LocalKMeans: Convergence of Lloyd's Algorithm with Distributed Local Iterations
Harsh Vardhan
Heng Zhu
A. Ghosh
A. Mazumdar
274
1
0
23 May 2025
Topology-Aware Knowledge Propagation in Decentralized Learning
Topology-Aware Knowledge Propagation in Decentralized Learning
Mansi Sakarvadia
Nathaniel Hudson
Tian Li
Ian Foster
Kyle Chard
286
0
0
16 May 2025
Asynchronous Decentralized SGD under Non-Convexity: A Block-Coordinate Descent Framework
Asynchronous Decentralized SGD under Non-Convexity: A Block-Coordinate Descent Framework
Yijie Zhou
Shi Pu
212
2
0
15 May 2025
Bant: Byzantine Antidote via Trial Function and Trust Scores
Bant: Byzantine Antidote via Trial Function and Trust Scores
Gleb Molodtsov
Daniil Medyakov
Sergey Skorik
Nikolas Khachaturov
Shahane Tigranyan
Vladimir Aletov
A. Avetisyan
Martin Takáč
Aleksandr Beznosikov
AAML
801
1
0
12 May 2025
Sharp Gaussian approximations for Decentralized Federated Learning
Sharp Gaussian approximations for Decentralized Federated Learning
Soham Bonnerjee
Sayar Karmakar
Wei Biao Wu
FedML
405
2
0
12 May 2025
Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training
Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training
Hiroki Naganuma
Xinzhi Zhang
Man-Chung Yue
Ioannis Mitliagkas
Philipp A. Witte
Russell J. Hewett
Yin Tat Lee
522
1
0
25 Apr 2025
GRANITE : a Byzantine-Resilient Dynamic Gossip Learning Framework
GRANITE : a Byzantine-Resilient Dynamic Gossip Learning Framework
Yacine Belal
Mohamed Maouche
Sonia Ben Mokhtar
Anthony Simonet-Boulogne
368
1
0
24 Apr 2025
Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
Yuan Zhou
Xinli Shi
Xuelong Li
Jiachen Zhong
G. Wen
Jinde Cao
FedML
418
3
0
17 Apr 2025
Collaborative Learning of On-Device Small Model and Cloud-Based Large Model: Advances and Future Directions
Collaborative Learning of On-Device Small Model and Cloud-Based Large Model: Advances and Future Directions
Chaoyue Niu
Yucheng Ding
Junhui Lu
Zhengxiang Huang
Hang Zeng
Yutong Dai
Xuezhen Tu
Chengfei Lv
Fan Wu
Guihai Chen
373
3
0
17 Apr 2025
Communication Optimization for Decentralized Learning atop Bandwidth-limited Edge Networks
Communication Optimization for Decentralized Learning atop Bandwidth-limited Edge NetworksInternational Conference on Computer Communications and Networks (ICCCN), 2025
Tingyang Sun
Tuan Nguyen
Ting He
512
0
0
16 Apr 2025
A Tale of Two Learning Algorithms: Multiple Stream Random Walk and Asynchronous Gossip
A Tale of Two Learning Algorithms: Multiple Stream Random Walk and Asynchronous Gossip
Peyman Gholami
H. Seferoglu
243
0
0
14 Apr 2025
Deploying Large AI Models on Resource-Limited Devices with Split Federated Learning
Deploying Large AI Models on Resource-Limited Devices with Split Federated Learning
Xianke Qiang
Hongda Liu
Xinran Zhang
Zheng Chang
Ying-Chang Liang
FedML
309
1
0
12 Apr 2025
Decentralized Domain Generalization with Style Sharing: Formal Model and Convergence Analysis
Decentralized Domain Generalization with Style Sharing: Formal Model and Convergence Analysis
Shahryar Zehtabi
Dong-Jun Han
Seyyedali Hosseinalipour
Christopher G. Brinton
FedMLAI4CE
635
0
0
08 Apr 2025
Exact and Linear Convergence for Federated Learning under Arbitrary Client Participation is Attainable
Exact and Linear Convergence for Federated Learning under Arbitrary Client Participation is Attainable
Bicheng Ying
Zhe Li
Haibo Yang
FedML
513
0
0
25 Mar 2025
Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time
Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time
Runze You
Shi Pu
278
3
0
20 Mar 2025
Unified Analysis of Decentralized Gradient Descent: a Contraction Mapping Framework
Unified Analysis of Decentralized Gradient Descent: a Contraction Mapping FrameworkIEEE Open Journal of Signal Processing (JOSP), 2025
Erik G. Larsson
Nicolo Michelusi
413
5
0
18 Mar 2025
From Centralized to Decentralized Federated Learning: Theoretical Insights, Privacy Preservation, and Robustness Challenges
From Centralized to Decentralized Federated Learning: Theoretical Insights, Privacy Preservation, and Robustness Challenges
Qiongxiu Li
Wenrui Yu
Yufei Xia
Jun Pang
FedML
320
7
0
10 Mar 2025
Chemical knowledge-informed framework for privacy-aware retrosynthesis learning
Chemical knowledge-informed framework for privacy-aware retrosynthesis learningNature Communications (Nat Commun), 2025
Guikun Chen
Xu Zhang
Yue Yang
Yong Liu
Yi Yang
Wenguan Wang
352
0
0
26 Feb 2025
Scalable Decentralized Algorithms for Online Personalized Mean Estimation
Scalable Decentralized Algorithms for Online Personalized Mean EstimationAAAI Conference on Artificial Intelligence (AAAI), 2024
Franco Galante
Giovanni Neglia
Emilio Leonardi
FedML
438
4
0
20 Feb 2025
A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration
A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration
Yuchen Hu
Xi Chen
Weidong Liu
Xiaojun Mao
410
0
0
31 Jan 2025
Brain-Inspired Decentralized Satellite Learning in Space Computing Power Networks
Brain-Inspired Decentralized Satellite Learning in Space Computing Power NetworksIEEE Transactions on Mobile Computing (IEEE TMC), 2025
Peng Yang
Ting Wang
Haibin Cai
Yuanming Shi
Chunxiao Jiang
Linling Kuang
295
1
0
28 Jan 2025
Decentralized Low-Rank Fine-Tuning of Large Language Models
Decentralized Low-Rank Fine-Tuning of Large Language Models
Sajjad Ghiasvand
Mahnoosh Alizadeh
Ramtin Pedarsani
ALM
715
12
0
26 Jan 2025
1234567
Next
Page 1 of 7