Communication-Efficient Topologies for Decentralized Learning with
$O(1)$ Consensus Rate

Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate

14 October 2022

Papers citing "Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate"

19 / 19 papers shown

Title
GRANITE : a Byzantine-Resilient Dynamic Gossip Learning Framework Yacine Belal Mohamed Maouche Sonia Ben Mokhtar Anthony Simonet-Boulogne 47 0 0 24 Apr 2025
Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time Runze You Shi Pu 44 0 0 20 Mar 2025
Accelerating MoE Model Inference with Expert Sharding Oana Balmau Anne-Marie Kermarrec Rafael Pires André Loureiro Espírito Santo M. Vos Milos Vujasinovic MoE 74 0 0 11 Mar 2025
Scalable Decentralized Learning with Teleportation Yuki Takezawa Sebastian U. Stich 72 1 0 25 Jan 2025
Review of Mathematical Optimization in Federated Learning Shusen Yang Fangyuan Zhao Zihao Zhou Liang Shi Xuebin Ren Zongben Xu FedML AI4CE 93 0 0 02 Dec 2024
Boosting Asynchronous Decentralized Learning with Model Fragmentation Sayan Biswas Anne-Marie Kermarrec Alexis Marouani Rafael Pires Rishi Sharma M. Vos 30 1 0 16 Oct 2024
DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networks Eunjeong Jeong Marios Kountouris 33 0 0 19 Jun 2024
Estimation Network Design framework for efficient distributed optimization M. Bianchi Sergio Grammatico 28 0 0 23 Apr 2024
Federated Learning Can Find Friends That Are Advantageous N. Tupitsa Samuel Horváth Martin Takávc Eduard A. Gorbunov FedML 49 2 0 07 Feb 2024
Communication-Efficient Federated Optimization over Semi-Decentralized Networks He Wang Yuejie Chi FedML 44 2 0 30 Nov 2023
Epidemic Learning: Boosting Decentralized Learning with Randomized Communication M. Vos Sadegh Farhadkhani R. Guerraoui Anne-Marie Kermarrec Rafael Pires Rishi Sharma 31 15 0 03 Oct 2023
Structured Cooperative Learning with Graphical Model Priors Shuang-Yang Li Dinesh Manocha Xinmei Tian Dacheng Tao 38 0 0 16 Jun 2023
Decentralized Multi-Level Compositional Optimization Algorithms with Level-Independent Convergence Rate Hongchang Gao 29 0 0 06 Jun 2023
Decentralized SGD and Average-direction SAM are Asymptotically Equivalent Tongtian Zhu Fengxiang He Kaixuan Chen Mingli Song Dacheng Tao 34 15 0 05 Jun 2023
DSGD-CECA: Decentralized SGD with Communication-Optimal Exact Consensus Algorithm Lisang Ding Kexin Jin Bicheng Ying Kun Yuan W. Yin 24 9 0 01 Jun 2023
Beyond Exponential Graph: Communication-Efficient Topologies for Decentralized Learning via Finite-time Convergence Yuki Takezawa Ryoma Sato Han Bao Kenta Niwa M. Yamada 44 9 0 19 May 2023
Decentralized Learning Made Practical with Client Sampling M. Vos Akash Dhasade Anne-Marie Kermarrec Erick Lavoie J. Pouwelse Rishi Sharma 31 1 0 27 Feb 2023
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning Bicheng Ying Kun Yuan Hanbin Hu Yiming Chen W. Yin FedML 44 27 0 08 Nov 2021
ADOM: Accelerated Decentralized Optimization Method for Time-Varying Networks D. Kovalev Egor Shulgin Peter Richtárik Alexander Rogozin Alexander Gasnikov ODL 35 31 0 18 Feb 2021