DADAO: Decoupled Accelerated Decentralized Asynchronous Optimization

26 July 2022

Papers citing "DADAO: Decoupled Accelerated Decentralized Asynchronous Optimization"

6 / 6 papers shown

Title
DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networks Eunjeong Jeong Marios Kountouris 29 0 0 19 Jun 2024
ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training Adel Nabli Louis Fournier Pierre Erbacher Louis Serrano Eugene Belilovsky Edouard Oyallon FedML 54 1 0 03 Jun 2024
Distributed Event-Based Learning via ADMM Güner Dilsad Er Sebastian Trimpe Michael Muehlebach FedML 44 2 0 17 May 2024
Can We Learn Communication-Efficient Optimizers? Charles-Étienne Joseph Benjamin Thérien A. Moudgil Boris Knyazev Eugene Belilovsky 40 1 0 02 Dec 2023
$$\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in Decentralized Deep Learning$ $\textbf{A}^2\textbf{CiD}^2$ : Accelerating Asynchronous Communication in Decentralized Deep Learning Adel Nabli Eugene Belilovsky Edouard Oyallon 24 6 0 14 Jun 2023
ADOM: Accelerated Decentralized Optimization Method for Time-Varying Networks D. Kovalev Egor Shulgin Peter Richtárik Alexander Rogozin Alexander Gasnikov ODL 35 31 0 18 Feb 2021