Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2002.11787
Cited By
v1
v2
v3 (latest)
Moniqua: Modulo Quantized Communication in Decentralized SGD
International Conference on Machine Learning (ICML), 2020
26 February 2020
Yucheng Lu
Christopher De Sa
MQ
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Moniqua: Modulo Quantized Communication in Decentralized SGD"
30 / 30 papers shown
Overlay-based Decentralized Federated Learning in Bandwidth-limited Networks
ACM Interational Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), 2024
Yudi Huang
Tingyang Sun
Ting He
252
3
0
08 Aug 2024
AdaGossip: Adaptive Consensus Step-size for Decentralized Deep Learning with Communication Compression
Sai Aparna Aketi
Abolfazl Hashemi
Kaushik Roy
242
0
0
09 Apr 2024
Faster Convergence with Less Communication: Broadcast-Based Subgraph Sampling for Decentralized Learning over Wireless Networks
IEEE Open Journal of the Communications Society (OJ-COMSOC), 2024
Daniel Pérez Herrera
Zheng Chen
Erik G. Larsson
499
4
0
24 Jan 2024
Energy-efficient Decentralized Learning via Graph Sparsification
Xusheng Zhang
Cho-Chun Chiu
Ting He
417
2
0
05 Jan 2024
FAVANO: Federated AVeraging with Asynchronous NOdes
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Louis Leconte
Van Minh Nguyen
Eric Moulines
FedML
332
4
0
25 May 2023
Beyond Exponential Graph: Communication-Efficient Topologies for Decentralized Learning via Finite-time Convergence
Neural Information Processing Systems (NeurIPS), 2023
Yuki Takezawa
Ryoma Sato
Han Bao
Kenta Niwa
M. Yamada
365
18
0
19 May 2023
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression
Yutong He
Xinmeng Huang
Yiming Chen
W. Yin
Kun Yuan
499
12
0
12 May 2023
Quantized Distributed Training of Large Models with Convergence Guarantees
International Conference on Machine Learning (ICML), 2023
I. Markov
Adrian Vladu
Qi Guo
Dan Alistarh
MQ
296
17
0
05 Feb 2023
Decentralized Entropic Optimal Transport for Privacy-preserving Distributed Distribution Comparison
Xiangfeng Wang
Hongteng Xu
Moyi Yang
OT
336
2
0
28 Jan 2023
Momentum Tracking: Momentum Acceleration for Decentralized Deep Learning on Heterogeneous Data
Yuki Takezawa
Hang Bao
Kenta Niwa
Ryoma Sato
Makoto Yamada
277
28
0
30 Sep 2022
Communication-Efficient Federated Learning With Data and Client Heterogeneity
International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Hossein Zakerinia
Shayan Talaei
Giorgi Nadiradze
Dan Alistarh
FedML
561
15
0
20 Jun 2022
GraB: Finding Provably Better Data Permutations than Random Reshuffling
Neural Information Processing Systems (NeurIPS), 2022
Yucheng Lu
Wentao Guo
Christopher De Sa
FedML
410
18
0
22 May 2022
Communication Compression for Decentralized Learning with Operator Splitting Methods
IEEE Transactions on Signal and Information Processing over Networks (TSIPN), 2022
Yuki Takezawa
Kenta Niwa
M. Yamada
246
3
0
08 May 2022
The Role of Local Steps in Local SGD
Optimization Methods and Software (OMS), 2022
Tiancheng Qin
S. Rasoul Etesami
César A. Uribe
334
5
0
14 Mar 2022
Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam
International Conference on Learning Representations (ICLR), 2022
Yucheng Lu
Conglong Li
Minjia Zhang
Christopher De Sa
Yuxiong He
OffRL
AI4CE
421
22
0
12 Feb 2022
Low Precision Decentralized Distributed Training over IID and non-IID Data
Sai Aparna Aketi
Sangamesh Kodge
Kaushik Roy
MQ
188
12
0
17 Nov 2021
Communication Efficient Generalized Tensor Factorization for Decentralized Healthcare Networks
Jing Ma
Qiuchen Zhang
Jian Lou
Li Xiong
S. Bhavani
Joyce C. Ho
192
0
0
03 Sep 2021
Decentralized Composite Optimization with Compression
Yao Li
Xiaorui Liu
Shucheng Zhou
Ming Yan
Kun Yuan
245
10
0
10 Aug 2021
Innovation Compression for Communication-efficient Distributed Optimization with Linear Convergence
IEEE Transactions on Automatic Control (IEEE TAC), 2021
Jiaqi Zhang
Keyou You
Lihua Xie
211
39
0
14 May 2021
Distributed Learning Systems with First-order Methods
Ji Liu
Ce Zhang
247
47
0
12 Apr 2021
Cross-Gradient Aggregation for Decentralized Learning from Non-IID data
International Conference on Machine Learning (ICML), 2021
Yasaman Esfandiari
Sin Yong Tan
Zhanhong Jiang
Aditya Balu
Ethan Herron
Chinmay Hegde
Soumik Sarkar
OOD
388
61
0
02 Mar 2021
Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data
International Conference on Machine Learning (ICML), 2021
Tao Lin
Sai Praneeth Karimireddy
Sebastian U. Stich
Martin Jaggi
FedML
396
118
0
09 Feb 2021
Wyner-Ziv Estimators for Distributed Mean Estimation with Side Information and Optimization
IEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2020
Prathamesh Mayekar
Shubham K. Jha
A. Suresh
Himanshu Tyagi
FedML
341
2
0
24 Nov 2020
On the Benefits of Multiple Gossip Steps in Communication-Constrained Decentralized Optimization
Abolfazl Hashemi
Anish Acharya
Rudrajit Das
H. Vikalo
Sujay Sanghavi
Inderjit Dhillon
338
9
0
20 Nov 2020
Communication-efficient Decentralized Local SGD over Undirected Networks
Tiancheng Qin
S. Rasoul Etesami
César A. Uribe
FedML
209
14
0
06 Nov 2020
PowerGossip: Practical Low-Rank Communication Compression in Decentralized Deep Learning
Thijs Vogels
Sai Praneeth Karimireddy
Martin Jaggi
FedML
300
63
0
04 Aug 2020
Linear Convergent Decentralized Optimization with Compression
Xiaorui Liu
Yao Li
Rongrong Wang
Shucheng Zhou
Ming Yan
266
52
0
01 Jul 2020
Optimal Complexity in Decentralized Training
International Conference on Machine Learning (ICML), 2020
Yucheng Lu
Christopher De Sa
546
94
0
15 Jun 2020
MixML: A Unified Analysis of Weakly Consistent Parallel Learning
Yucheng Lu
J. Nash
Christopher De Sa
FedML
220
12
0
14 May 2020
Asynchronous Decentralized SGD with Quantized and Local Updates
Neural Information Processing Systems (NeurIPS), 2019
Giorgi Nadiradze
Amirmojtaba Sabour
Peter Davies
Shigang Li
Dan Alistarh
380
52
0
27 Oct 2019
1
Page 1 of 1
