Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1807.06629
Cited By
v1
v2
v3 (latest)
Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learning
AAAI Conference on Artificial Intelligence (AAAI), 2018
17 July 2018
Hao Yu
Sen Yang
Shenghuo Zhu
MoMe
FedML
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learning"
50 / 344 papers shown
Multi-Granularity Mutual Refinement Network for Zero-Shot Learning
Ning Wang
Long Yu
Cong Hua
Guangming Zhu
Lin Mei
Syed Afaq Ali Shah
Mohammed Bennamoun
Liang Zhang
167
1
0
11 Nov 2025
On Provable Benefits of Muon in Federated Learning
Xinwen Zhang
Hongchang Gao
FedML
140
1
0
04 Oct 2025
Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation
Kaoru Otsuka
Yuki Takezawa
Makoto Yamada
FedML
254
1
0
03 Sep 2025
Cooperative SGD with Dynamic Mixing Matrices
Soumya Sarkar
Shweta Jain
242
0
0
20 Aug 2025
Pigeon-SL: Robust Split Learning Framework for Edge Intelligence under Malicious Clients
Sangjun Park
Tony Q.S. Quek
Hyowoon Seo
AAML
193
0
0
04 Aug 2025
Asynchronous Federated Learning with non-convex client objective functions and heterogeneous dataset
IEEE Transactions on Artificial Intelligence (IEEE TAI), 2025
Ali Forootani
Raffaele Iervolino
FedML
194
0
0
03 Aug 2025
Convergence Analysis of Aggregation-Broadcast in LoRA-enabled Distributed Fine-Tuning
Xin Chen
Shuaijun Chen
Omid Tavallaie
Nguyen H. Tran
Shuhuang Xiang
Albert Y. Zomaya
319
0
0
02 Aug 2025
Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
Tolga Dimlioglu
A. Choromańska
FedML
314
1
0
27 Jul 2025
Optimal Batch-Size Control for Low-Latency Federated Learning with Device Heterogeneity
Huiling Yang
Zhanwei Wang
Kaibin Huang
304
3
0
21 Jul 2025
FedWSQ: Efficient Federated Learning with Weight Standardization and Distribution-Aware Non-Uniform Quantization
Seung-Wook Kim
Seongyeol Kim
Jiah Kim
Seowon Ji
Se-Ho Lee
FedML
MQ
289
0
0
30 Jun 2025
Incentivizing High-quality Participation From Federated Learning Agents
Jinlong Pang
Jiaheng Wei
Yifan Hua
Chen Qian
Yang Liu
FedML
251
0
0
20 Jun 2025
FSL-SAGE: Accelerating Federated Split Learning via Smashed Activation Gradient Estimation
Srijith Nair
Michael Lin
Amirreza Talebi
Peizhong Ju
Elizabeth S. Bentley
Jia Liu
FedML
236
4
0
29 May 2025
The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning
Shiwei Li
Xiandi Luo
Haozhao Wang
Xing Tang
Shijie Xu
Weihong Luo
Yuhua Li
Xiuqiang He
Ruixuan Li
FedML
388
5
0
29 May 2025
FedHL: Federated Learning for Heterogeneous Low-Rank Adaptation via Unbiased Aggregation
Zihao Peng
Jiandian Zeng
Boyuan Li
Guo Li
Shengbo Chen
Tian Wang
FedML
469
2
0
24 May 2025
Topology-Aware Knowledge Propagation in Decentralized Learning
Mansi Sakarvadia
Nathaniel Hudson
Tian Li
Ian Foster
Kyle Chard
284
0
0
16 May 2025
FDA-Opt: Communication-Efficient Federated Fine-Tuning of Language Models
Michail Theologitis
V. Samoladas
Antonios Deligiannakis
488
0
0
07 May 2025
Cluster-Aware Multi-Round Update for Wireless Federated Learning in Heterogeneous Environments
Pengcheng Sun
Erwu Liu
Wei Ni
Kanglei Yu
Rui Wang
Abbas Jamalipour
FedML
365
1
0
06 May 2025
Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training
Hiroki Naganuma
Xinzhi Zhang
Man-Chung Yue
Ioannis Mitliagkas
Philipp A. Witte
Russell J. Hewett
Yin Tat Lee
521
1
0
25 Apr 2025
Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
Yuan Zhou
Xinli Shi
Xuelong Li
Jiachen Zhong
G. Wen
Jinde Cao
FedML
416
3
0
17 Apr 2025
FedCanon: Non-Convex Composite Federated Learning with Efficient Proximal Operation on Heterogeneous Data
IEEE Transactions on Signal Processing (IEEE TSP), 2025
Yuan Zhou
Jiachen Zhong
Xinli Shi
G. Wen
Xinghuo Yu
FedML
473
2
0
16 Apr 2025
Biased Federated Learning under Wireless Heterogeneity
Muhammad Faraz Ul Abrar
Nicolò Michelusi
FedML
278
1
0
08 Mar 2025
Convergence Analysis of Federated Learning Methods Using Backward Error Analysis
AAAI Conference on Artificial Intelligence (AAAI), 2025
Jinwoo Lim
Suhyun Kim
Soo-Mook Moon
FedML
333
0
0
05 Mar 2025
Communication-Efficient Device Scheduling for Federated Learning Using Lyapunov Optimization
Jake B. Perazzone
Maroun Touma
Mingyue Ji
Kevin S. Chan
FedML
463
3
0
01 Mar 2025
Preconditioned Inexact Stochastic ADMM for Deep Model
Shenglong Zhou
Ouya Wang
Ziyan Luo
Yongxu Zhu
Geoffrey Ye Li
546
2
0
15 Feb 2025
Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks
IEEE Transactions on Mobile Computing (IEEE TMC), 2025
Shuai Wang
Yanqing Xu
Chaoqun You
Mingjie Shao
Tony Q.S. Quek
258
6
0
20 Jan 2025
Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis
International Conference on Artificial Intelligence and Statistics (AISTATS), 2025
Ruichen Luo
Sebastian U Stich
Samuel Horváth
Martin Takáč
608
2
0
08 Jan 2025
A Unified Analysis of Federated Learning with Arbitrary Client Participation
Neural Information Processing Systems (NeurIPS), 2022
Maroun Touma
Mingyue Ji
FedML
745
80
0
31 Dec 2024
EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models
International Conference on Learning Representations (ICLR), 2024
Jialiang Cheng
Ning Gao
Yun Yue
Zhiling Ye
Jiadi Jiang
Jian Sha
OffRL
541
1
0
10 Dec 2024
Review of Mathematical Optimization in Federated Learning
Shusen Yang
Fangyuan Zhao
Zihao Zhou
Liang Shi
Xuebin Ren
Zongben Xu
FedML
AI4CE
427
6
0
02 Dec 2024
Adaptive Consensus Gradients Aggregation for Scaled Distributed Training
Yoni Choukroun
Shlomi Azoulay
P. Kisilev
336
0
0
06 Nov 2024
Why Go Full? Elevating Federated Learning Through Partial Network Updates
Neural Information Processing Systems (NeurIPS), 2024
Haolin Wang
Xuefeng Liu
Jianwei Niu
Wenkai Guo
Shaojie Tang
FedML
553
6
0
15 Oct 2024
Communication-Efficient Federated Group Distributionally Robust Optimization
Neural Information Processing Systems (NeurIPS), 2024
Zhishuai Guo
Tianbao Yang
FedML
404
3
0
08 Oct 2024
Aiding Global Convergence in Federated Learning via Local Perturbation and Mutual Similarity Information
Emanuel Buttaci
Giuseppe Carlo Calafiore
FedML
294
0
0
07 Oct 2024
No Need to Talk: Asynchronous Mixture of Language Models
International Conference on Learning Representations (ICLR), 2024
Anastasiia Filippova
Angelos Katharopoulos
David Grangier
Ronan Collobert
MoE
467
4
0
04 Oct 2024
Selective Aggregation for Low-Rank Adaptation in Federated Learning
International Conference on Learning Representations (ICLR), 2024
Pengxin Guo
Shuang Zeng
Y. Wang
Huijie Fan
Feifei Wang
Liangqiong Qu
FedML
610
63
0
02 Oct 2024
Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning
Zhidong Gao
Zhenxiao Zhang
Yu Zhang
Tongnian Wang
Yanmin Gong
Yuanxiong Guo
430
0
0
29 Sep 2024
Heterogeneity-Aware Resource Allocation and Topology Design for Hierarchical Federated Edge Learning
Zhidong Gao
Yu Zhang
Yanmin Gong
Yuanxiong Guo
214
0
0
29 Sep 2024
Hierarchical Federated Learning with Multi-Timescale Gradient Correction
Neural Information Processing Systems (NeurIPS), 2024
Wenzhi Fang
Dong-Jun Han
Evan Chen
Jianing Zhang
Christopher G. Brinton
236
21
0
27 Sep 2024
Efficient Federated Learning against Heterogeneous and Non-stationary Client Unavailability
Neural Information Processing Systems (NeurIPS), 2024
Ming Xiang
Stratis Ioannidis
Edmund Yeh
Carlee Joe-Wong
Lili Su
FedML
399
15
0
26 Sep 2024
Riemannian Federated Learning via Averaging Gradient Streams
Zhenwei Huang
Wen Huang
Pratik Jawanpuria
Bamdev Mishra
FedML
379
3
0
11 Sep 2024
Heterogeneity-Aware Cooperative Federated Edge Learning with Adaptive Computation and Communication Compression
IEEE Transactions on Mobile Computing (IEEE TMC), 2024
Zhenxiao Zhang
Zhidong Gao
Yuanxiong Guo
Yanmin Gong
283
13
0
06 Sep 2024
Understanding Data Reconstruction Leakage in Federated Learning from a Theoretical Perspective
Zifan Wang
Binghui Zhang
Meng Pang
Yuan Hong
Binghui Wang
FedML
309
0
0
22 Aug 2024
Federated Frank-Wolfe Algorithm
Ali Dadras
Sourasekhar Banerjee
Karthik Prakhya
A. Yurtsever
FedML
290
5
0
19 Aug 2024
FedBAT: Communication-Efficient Federated Learning via Learnable Binarization
International Conference on Machine Learning (ICML), 2024
Shiwei Li
Wenchao Xu
Haozhao Wang
Xing Tang
Tianzhe Xiao
Shijie Xu
Weihong Luo
Yuhua Li
Xiuqiang He
Ruixuan Li
FedML
231
13
0
06 Aug 2024
A New Theoretical Perspective on Data Heterogeneity in Federated Optimization
Jiayi Wang
Maroun Touma
Rong-Rong Chen
Mingyue Ji
FedML
296
3
0
22 Jul 2024
FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization
Linping Qu
Shenghui Song
Chi-Ying Tsui
MQ
FedML
272
8
0
26 Jun 2024
Communication-Efficient Adaptive Batch Size Strategies for Distributed Local Gradient Methods
Tim Tsz-Kit Lau
Weijian Li
Chenwei Xu
Han Liu
Mladen Kolar
353
3
0
20 Jun 2024
Nonconvex Federated Learning on Compact Smooth Submanifolds With Heterogeneous Data
Jiaojiao Zhang
Jiang Hu
Anthony Man-Cho So
Mikael Johansson
230
7
0
12 Jun 2024
FedStaleWeight: Buffered Asynchronous Federated Learning with Fair Aggregation via Staleness Reweighting
Jeffrey Ma
Alan Tu
Yiling Chen
Vijay Janapa Reddi
FedML
288
7
0
05 Jun 2024
Communication-Efficient Distributed Deep Learning via Federated Dynamic Averaging
Michail Theologitis
Georgios Frangias
Georgios Anestis
V. Samoladas
Antonios Deligiannakis
FedML
509
2
0
31 May 2024
1
2
3
4
5
6
7
Next
Page 1 of 7
