Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1907.09356
Cited By
v1
v2
v3 (latest)
Decentralized Deep Learning with Arbitrary Communication Compression
International Conference on Learning Representations (ICLR), 2019
22 July 2019
Anastasia Koloskova
Tao Lin
Sebastian U. Stich
Martin Jaggi
FedML
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Decentralized Deep Learning with Arbitrary Communication Compression"
50 / 132 papers shown
Improved Convergence in Parameter-Agnostic Error Feedback through Momentum
Abdurakhmon Sadiev
Yury Demidovich
Igor Sokolov
Grigory Malinovsky
Sarit Khirirat
Peter Richtárik
129
0
0
18 Nov 2025
On the Fast Adaptation of Delayed Clients in Decentralized Federated Learning: A Centroid-Aligned Distillation Approach
Jiahui Bai
Hai Dong
•. A. K. Qin
FedML
177
1
0
05 Aug 2025
Topology-Aware Knowledge Propagation in Decentralized Learning
Mansi Sakarvadia
Nathaniel Hudson
Tian Li
Ian Foster
Kyle Chard
286
0
0
16 May 2025
Dyn-D
2
^2
2
P: Dynamic Differentially Private Decentralized Learning with Provable Utility Guarantee
International Joint Conference on Artificial Intelligence (IJCAI), 2025
Zehan Zhu
Yan Huang
Xin Wang
Shouling Ji
Jinming Xu
333
0
0
10 May 2025
Communication Optimization for Decentralized Learning atop Bandwidth-limited Edge Networks
International Conference on Computer Communications and Networks (ICCCN), 2025
Tingyang Sun
Tuan Nguyen
Ting He
512
0
0
16 Apr 2025
Accelerated Distributed Optimization with Compression and Error Feedback
Yuan Gao
Anton Rodomanov
Jeremy Rack
Sebastian U. Stich
431
4
0
11 Mar 2025
Scalable Decentralized Learning with Teleportation
International Conference on Learning Representations (ICLR), 2025
Yuki Takezawa
Sebastian U. Stich
480
1
0
25 Jan 2025
Fully First-Order Methods for Decentralized Bilevel Optimization
Xiaoyu Wang
Xuxing Chen
Shiqian Ma
Tong Zhang
538
3
0
25 Oct 2024
Boosting Asynchronous Decentralized Learning with Model Fragmentation
The Web Conference (WWW), 2024
Sayan Biswas
Anne-Marie Kermarrec
Alexis Marouani
Rafael Pires
Rishi Sharma
M. Vos
322
6
0
16 Oct 2024
Overlay-based Decentralized Federated Learning in Bandwidth-limited Networks
ACM Interational Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), 2024
Yudi Huang
Tingyang Sun
Ting He
254
3
0
08 Aug 2024
Near Optimal Decentralized Optimization with Compression and Momentum Tracking
Rustem Islamov
Yuan Gao
Sebastian U. Stich
324
0
0
30 May 2024
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data
Sakshi Choudhary
Sai Aparna Aketi
Kaushik Roy
FedML
403
1
0
22 May 2024
Scale-Robust Timely Asynchronous Decentralized Learning
Purbesh Mitra
S. Ulukus
240
1
0
30 Apr 2024
Beyond Noise: Privacy-Preserving Decentralized Learning with Virtual Nodes
Sayan Biswas
Mathieu Even
Anne-Marie Kermarrec
Laurent Massoulie
Rafael Pires
Rishi Sharma
M. Vos
271
0
0
15 Apr 2024
AdaGossip: Adaptive Consensus Step-size for Decentralized Deep Learning with Communication Compression
Sai Aparna Aketi
Abolfazl Hashemi
Kaushik Roy
244
0
0
09 Apr 2024
Averaging Rate Scheduler for Decentralized Learning on Heterogeneous Data
Sai Aparna Aketi
Sakshi Choudhary
Kaushik Roy
237
2
0
05 Mar 2024
Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization
Jiaxiang Li
Xuxing Chen
Shiqian Ma
Mingyi Hong
ODL
287
12
0
13 Feb 2024
Decentralized Optimization in Networks with Arbitrary Delays
Tomàs Ortega
Hamid Jafarkhani
218
1
0
20 Jan 2024
Energy-efficient Decentralized Learning via Graph Sparsification
Xusheng Zhang
Cho-Chun Chiu
Ting He
417
2
0
05 Jan 2024
Communication-Efficient Federated Optimization over Semi-Decentralized Networks
IEEE Transactions on Signal and Information Processing over Networks (TSIPN), 2023
He Wang
Yuejie Chi
FedML
580
6
0
30 Nov 2023
Communication-Efficient Heterogeneous Federated Learning with Generalized Heavy-Ball Momentum
Riccardo Zaccone
Sai Praneeth Karimireddy
Carlo Masone
Marco Ciccone
FedML
563
3
0
30 Nov 2023
Compressed and Sparse Models for Non-Convex Decentralized Learning
Andrew Campbell
Hang Liu
Leah Woldemariam
Anna Scaglione
264
0
0
09 Nov 2023
EControl: Fast Distributed Optimization with Compression and Error Control
International Conference on Learning Representations (ICLR), 2023
Yuan Gao
Rustem Islamov
Sebastian U. Stich
329
18
0
06 Nov 2023
Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent Algorithm
Neural Information Processing Systems (NeurIPS), 2023
Miaoxi Zhu
Li Shen
Bo Du
Dacheng Tao
307
9
0
31 Oct 2023
Escaping Saddle Points in Heterogeneous Federated Learning via Distributed SGD with Communication Compression
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Sijin Chen
Zhize Li
Yuejie Chi
FedML
300
5
0
29 Oct 2023
Decentralized Learning over Wireless Networks with Broadcast-Based Subgraph Sampling
Daniel Pérez Herrera
Zheng Chen
Erik G. Larsson
317
2
0
24 Oct 2023
Federated Multi-Level Optimization over Decentralized Networks
Shuoguang Yang
Xuezhou Zhang
Mengdi Wang
AI4CE
244
0
0
10 Oct 2023
Sparse Decentralized Federated Learning
IEEE Transactions on Signal Processing (IEEE TSP), 2023
Shenglong Zhou
Kaidi Xu
Geoffrey Ye Li
Geoffrey Ye Li
FedML
183
0
0
31 Aug 2023
Achieving Linear Speedup in Decentralized Stochastic Compositional Minimax Optimization
Hongchang Gao
308
1
0
25 Jul 2023
Simple Opinion Dynamics for No-Regret Learning
John Lazarsfeld
Dan Alistarh
334
0
0
14 Jun 2023
A
2
CiD
2
\textbf{A}^2\textbf{CiD}^2
A
2
CiD
2
: Accelerating Asynchronous Communication in Decentralized Deep Learning
Neural Information Processing Systems (NeurIPS), 2023
Adel Nabli
Eugene Belilovsky
Edouard Oyallon
378
10
0
14 Jun 2023
Get More for Less in Decentralized Learning Systems
IEEE International Conference on Distributed Computing Systems (ICDCS), 2023
Akash Dhasade
Anne-Marie Kermarrec
Rafael Pires
Rishi Sharma
Milos Vujasinovic
Jeffrey Wigger
272
10
0
07 Jun 2023
Decentralized Multi-Level Compositional Optimization Algorithms with Level-Independent Convergence Rate
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Hongchang Gao
322
2
0
06 Jun 2023
Decentralized Federated Learning: A Survey and Perspective
IEEE Internet of Things Journal (IEEE IoT J.), 2023
Liangqi Yuan
Ziran Wang
Lichao Sun
Philip S. Yu
Christopher G. Brinton
FedML
396
259
0
02 Jun 2023
Error Feedback Shines when Features are Rare
Peter Richtárik
Elnur Gasanov
Konstantin Burlachenko
235
2
0
24 May 2023
Momentum Provably Improves Error Feedback!
Neural Information Processing Systems (NeurIPS), 2023
Ilyas Fatkhullin
Alexander Tyurin
Peter Richtárik
388
42
0
24 May 2023
Beyond Exponential Graph: Communication-Efficient Topologies for Decentralized Learning via Finite-time Convergence
Neural Information Processing Systems (NeurIPS), 2023
Yuki Takezawa
Ryoma Sato
Han Bao
Kenta Niwa
M. Yamada
365
18
0
19 May 2023
Decentralized Learning Made Easy with DecentralizePy
Akash Dhasade
Anne-Marie Kermarrec
Rafael Pires
Rishi Sharma
Milos Vujasinovic
257
22
0
17 Apr 2023
Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning
Deepak Ravikumar
Gobinda Saha
Sai Aparna Aketi
Kaushik Roy
277
5
0
09 Apr 2023
Compressed Regression over Adaptive Networks
IEEE Transactions on Signal and Information Processing over Networks (TSIPN), 2023
Marco Carpentiero
Vincenzo Matta
Ali H. Sayed
237
4
0
07 Apr 2023
CoDeC: Communication-Efficient Decentralized Continual Learning
Sakshi Choudhary
Sai Aparna Aketi
Gobinda Saha
Kaushik Roy
CLL
242
5
0
27 Mar 2023
Communication-Efficient Design for Quantized Decentralized Federated Learning
IEEE Transactions on Signal Processing (IEEE TSP), 2023
Lixing Chen
Wei Liu
Yunfei Chen
Weidong Wang
FedML
MQ
334
26
0
15 Mar 2023
Gossiped and Quantized Online Multi-Kernel Learning
IEEE Signal Processing Letters (IEEE SPL), 2023
Tomàs Ortega
Hamid Jafarkhani
226
8
0
24 Jan 2023
CEDAS: A Compressed Decentralized Stochastic Gradient Method with Improved Convergence
IEEE Transactions on Automatic Control (TAC), 2023
Kun-Yen Huang
Shin-Yi Pu
352
20
0
14 Jan 2023
Decentralized Gradient Tracking with Local Steps
Optimization Methods and Software (OMS), 2023
Yue Liu
Tao Lin
Anastasia Koloskova
Sebastian U. Stich
293
62
0
03 Jan 2023
Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems
Hongchang Gao
427
20
0
06 Dec 2022
Linear Convergent Distributed Nash Equilibrium Seeking with Compression
IEEE Transactions on Automatic Control (TAC), 2022
Xiaomeng Chen
Yuchi Wu
Xinlei Yi
Minyi Huang
Ling Shi
328
8
0
15 Nov 2022
Hybrid Decentralized Optimization: Leveraging Both First- and Zeroth-Order Optimizers for Faster Convergence
AAAI Conference on Artificial Intelligence (AAAI), 2022
Matin Ansaripour
Shayan Talaei
Giorgi Nadiradze
Dan Alistarh
296
0
0
14 Oct 2022
PersA-FL: Personalized Asynchronous Federated Learning
Optimization Methods and Software (OMS), 2022
Taha Toghani
Soomin Lee
César A. Uribe
FedML
408
8
0
03 Oct 2022
Unbounded Gradients in Federated Learning with Buffered Asynchronous Aggregation
Allerton Conference on Communication, Control, and Computing (Allerton), 2022
Taha Toghani
César A. Uribe
FedML
262
18
0
03 Oct 2022
1
2
3
Next
Page 1 of 3
