ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2012.04061
  4. Cited By
Faster Non-Convex Federated Learning via Global and Local Momentum
v1v2v3v4 (latest)

Faster Non-Convex Federated Learning via Global and Local Momentum

7 December 2020
Rudrajit Das
Anish Acharya
Abolfazl Hashemi
Sujay Sanghavi
Inderjit S. Dhillon
Ufuk Topcu
    FedML
ArXiv (abs)PDFHTML

Papers citing "Faster Non-Convex Federated Learning via Global and Local Momentum"

48 / 48 papers shown
Adaptive Federated Learning via Dynamical System Model
Adaptive Federated Learning via Dynamical System Model
Aayushya Agarwal
L. Pileggi
Gauri Joshi
FedML
217
1
0
05 Oct 2025
One-shot Robust Federated Learning of Independent Component Analysis
One-shot Robust Federated Learning of Independent Component Analysis
Dian Jin
Xin Bing
Yuqian Zhang
FedML
384
0
0
26 May 2025
Federated Learning for Diffusion Models
Federated Learning for Diffusion ModelsIEEE Transactions on Cognitive Communications and Networking (TCCN), 2025
Zihao Peng
Xijun Wang
Shengbo Chen
Hong Rao
Cong Shen
DiffMFedML
399
5
0
09 Mar 2025
Robust Federated Learning in Unreliable Wireless Networks: A Client Selection Approach
Robust Federated Learning in Unreliable Wireless Networks: A Client Selection Approach
Longji Xu
Wenkai Ji
Jian Zhou
Fu Xiao
Tsung-Hui Chang
469
3
0
24 Feb 2025
Non-Convex Optimization in Federated Learning via Variance Reduction and
  Adaptive Learning
Non-Convex Optimization in Federated Learning via Variance Reduction and Adaptive Learning
Dipanwita Thakur
Antonella Guzzo
Giancarlo Fortino
Sajal K. Das
FedML
323
2
0
16 Dec 2024
Equitable Federated Learning with Activation Clustering
Equitable Federated Learning with Activation Clustering
Antesh Upadhyay
Abolfazl Hashemi
FedML
229
0
0
24 Oct 2024
FedECADO: A Dynamical System Model of Federated Learning
FedECADO: A Dynamical System Model of Federated Learning
Aayushya Agarwal
Gauri Joshi
L. Pileggi
FedML
218
2
0
13 Oct 2024
Submodular Maximization Approaches for Equitable Client Selection in
  Federated Learning
Submodular Maximization Approaches for Equitable Client Selection in Federated Learning
Andrés Catalino Castillo Jiménez
Ege C. Kaya
Lintao Ye
Abolfazl Hashemi
FedML
290
3
0
24 Aug 2024
Sequential Federated Learning in Hierarchical Architecture on Non-IID
  Datasets
Sequential Federated Learning in Hierarchical Architecture on Non-IID DatasetsIEEE Transactions on Mobile Computing (IEEE TMC), 2024
Xingrun Yan
Shiyuan Zuo
Rongfei Fan
Han Hu
Li Shen
Puning Zhao
Yong Luo
FedML
250
1
0
19 Aug 2024
A New Theoretical Perspective on Data Heterogeneity in Federated
  Optimization
A New Theoretical Perspective on Data Heterogeneity in Federated Optimization
Jiayi Wang
Maroun Touma
Rong-Rong Chen
Mingyue Ji
FedML
287
3
0
22 Jul 2024
Adaptive Variance Reduction for Stochastic Optimization under Weaker
  Assumptions
Adaptive Variance Reduction for Stochastic Optimization under Weaker Assumptions
Wei Jiang
Sifan Yang
Yibo Wang
Lijun Zhang
334
6
0
04 Jun 2024
Near Optimal Decentralized Optimization with Compression and Momentum
  Tracking
Near Optimal Decentralized Optimization with Compression and Momentum Tracking
Rustem Islamov
Yuan Gao
Sebastian U. Stich
306
0
0
30 May 2024
FedEGG: Federated Learning with Explicit Global Guidance
FedEGG: Federated Learning with Explicit Global Guidance
Kun Zhai
Yifeng Gao
Jiabo He
Difan Zou
Guangnan Ye
Yu-Gang Jiang
Yu-Gang Jiang
FedML
251
0
0
18 Apr 2024
Localized Distributional Robustness in Submodular Multi-Task Subset Selection
Localized Distributional Robustness in Submodular Multi-Task Subset SelectionIEEE Transactions on Signal Processing (IEEE TSP), 2024
Ege C. Kaya
Abolfazl Hashemi
287
2
0
04 Apr 2024
FedLion: Faster Adaptive Federated Optimization with Fewer Communication
FedLion: Faster Adaptive Federated Optimization with Fewer Communication
Zhiwei Tang
Tsung-Hui Chang
303
14
0
15 Feb 2024
Differentially Private Low-Rank Adaptation of Large Language Model Using
  Federated Learning
Differentially Private Low-Rank Adaptation of Large Language Model Using Federated LearningACM Transactions on Management Information Systems (ACM TMIS), 2023
Xiao-Yang Liu
Rongyi Zhu
Daochen Zha
Jiechao Gao
Shan Zhong
Matt White
Yijia Zhao
321
65
0
29 Dec 2023
Communication-Efficient Heterogeneous Federated Learning with Generalized Heavy-Ball Momentum
Communication-Efficient Heterogeneous Federated Learning with Generalized Heavy-Ball Momentum
Riccardo Zaccone
Sai Praneeth Karimireddy
Carlo Masone
Marco Ciccone
FedML
535
3
0
30 Nov 2023
Over-the-Air Federated Learning and Optimization
Over-the-Air Federated Learning and Optimization
Jingyang Zhu
Yuanming Shi
Yong Zhou
Chunxiao Jiang
Wei Chen
Khaled B. Letaief
FedML
541
29
0
16 Oct 2023
Federated Learning: A Cutting-Edge Survey of the Latest Advancements and
  Applications
Federated Learning: A Cutting-Edge Survey of the Latest Advancements and ApplicationsComputer Communications (Comput. Commun.), 2023
Azim Akhtarshenas
Mohammad Ali Vahedifar
Navid Ayoobi
B. Maham
Tohid Alizadeh
Sina Ebrahimi
David López-Pérez
FedML
296
30
0
08 Oct 2023
Federated Conditional Stochastic Optimization
Federated Conditional Stochastic OptimizationNeural Information Processing Systems (NeurIPS), 2023
Xidong Wu
Jianhui Sun
Zhengmian Hu
Junyi Li
Aidong Zhang
Heng-Chiao Huang
FedML
468
4
0
04 Oct 2023
Stochastic Controlled Averaging for Federated Learning with
  Communication Compression
Stochastic Controlled Averaging for Federated Learning with Communication CompressionInternational Conference on Learning Representations (ICLR), 2023
Xinmeng Huang
Ping Li
Xiaoyun Li
438
276
0
16 Aug 2023
FedBug: A Bottom-Up Gradual Unfreezing Framework for Federated Learning
FedBug: A Bottom-Up Gradual Unfreezing Framework for Federated Learning
Chia-Hsiang Kao
Yu-Chiang Frank Wang
FedML
390
3
0
19 Jul 2023
Improved Convergence Analysis and SNR Control Strategies for Federated
  Learning in the Presence of Noise
Improved Convergence Analysis and SNR Control Strategies for Federated Learning in the Presence of NoiseIEEE Access (IEEE Access), 2023
Antesh Upadhyay
Abolfazl Hashemi
279
9
0
14 Jul 2023
Momentum Benefits Non-IID Federated Learning Simply and Provably
Momentum Benefits Non-IID Federated Learning Simply and ProvablyInternational Conference on Learning Representations (ICLR), 2023
Ziheng Cheng
Xinmeng Huang
Pengfei Wu
Kun Yuan
FedML
700
38
0
28 Jun 2023
Communication-Efficient Zeroth-Order Distributed Online Optimization:
  Algorithm, Theory, and Applications
Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and ApplicationsIEEE Access (IEEE Access), 2023
Ege C. Kaya
M. Sahin
Abolfazl Hashemi
266
5
0
09 Jun 2023
Dynamic Regularized Sharpness Aware Minimization in Federated Learning:
  Approaching Global Consistency and Smooth Landscape
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth LandscapeInternational Conference on Machine Learning (ICML), 2023
Yan Sun
Li Shen
Shi-Yong Chen
Liang Ding
Dacheng Tao
FedML
359
67
0
19 May 2023
TAMUNA: Doubly Accelerated Distributed Optimization with Local Training,
  Compression, and Partial Participation
TAMUNA: Doubly Accelerated Distributed Optimization with Local Training, Compression, and Partial Participation
Laurent Condat
Ivan Agarský
Grigory Malinovsky
Peter Richtárik
FedML
416
4
0
20 Feb 2023
FedDA: Faster Framework of Local Adaptive Gradient Methods via Restarted
  Dual Averaging
FedDA: Faster Framework of Local Adaptive Gradient Methods via Restarted Dual Averaging
Junyi Li
Feihu Huang
Heng-Chiao Huang
FedML
310
2
0
13 Feb 2023
A Communication-Efficient Adaptive Algorithm for Federated Learning
  under Cumulative Regret
A Communication-Efficient Adaptive Algorithm for Federated Learning under Cumulative RegretIEEE Transactions on Signal Processing (IEEE TSP), 2023
Sudeep Salgia
Qing Zhao
T. Gabay
Kobi Cohen
FedML
380
15
0
21 Jan 2023
Faster Adaptive Federated Learning
Faster Adaptive Federated LearningAAAI Conference on Artificial Intelligence (AAAI), 2022
Xidong Wu
Feihu Huang
Zhengmian Hu
Heng Huang
FedML
498
99
0
02 Dec 2022
Online Federated Learning via Non-Stationary Detection and Adaptation
  amidst Concept Drift
Online Federated Learning via Non-Stationary Detection and Adaptation amidst Concept DriftIEEE/ACM Transactions on Networking (TON), 2022
Bhargav Ganguly
Vaneet Aggarwal
FedML
259
21
0
22 Nov 2022
Adaptive Federated Minimax Optimization with Lower Complexities
Adaptive Federated Minimax Optimization with Lower ComplexitiesInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Feihu Huang
Xinrui Wang
Junyi Li
Songcan Chen
FedML
456
5
0
14 Nov 2022
CompressedScaffnew: The First Theoretical Double Acceleration of Communication from Local Training and Compression in Distributed Optimization
CompressedScaffnew: The First Theoretical Double Acceleration of Communication from Local Training and Compression in Distributed Optimization
Laurent Condat
Ivan Agarský
Peter Richtárik
393
18
0
24 Oct 2022
Towards Efficient Communications in Federated Learning: A Contemporary
  Survey
Towards Efficient Communications in Federated Learning: A Contemporary SurveyJournal of the Franklin Institute (JFI), 2022
Zihao Zhao
Yuzhu Mao
Yang Liu
Linqi Song
Ouyang Ye
Xinlei Chen
Wenbo Ding
FedML
400
73
0
02 Aug 2022
FedVARP: Tackling the Variance Due to Partial Client Participation in
  Federated Learning
FedVARP: Tackling the Variance Due to Partial Client Participation in Federated LearningConference on Uncertainty in Artificial Intelligence (UAI), 2022
Divyansh Jhunjhunwala
Pranay Sharma
Aushim Nagarkatti
Gauri Joshi
FedML
274
92
0
28 Jul 2022
Federated Learning with a Sampling Algorithm under Isoperimetry
Federated Learning with a Sampling Algorithm under Isoperimetry
Lukang Sun
Adil Salim
Peter Richtárik
FedML
300
8
0
02 Jun 2022
FedBR: Improving Federated Learning on Heterogeneous Data via Local
  Learning Bias Reduction
FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias ReductionInternational Conference on Machine Learning (ICML), 2022
Yongxin Guo
Xiaoying Tang
Tao Lin
FedML
304
52
0
26 May 2022
Privacy-Aware Compression for Federated Data Analysis
Privacy-Aware Compression for Federated Data AnalysisConference on Uncertainty in Artificial Intelligence (UAI), 2022
Kamalika Chaudhuri
Chuan Guo
Michael G. Rabbat
FedML
396
29
0
15 Mar 2022
Escaping Saddle Points with Bias-Variance Reduced Local Perturbed SGD
  for Communication Efficient Nonconvex Distributed Learning
Escaping Saddle Points with Bias-Variance Reduced Local Perturbed SGD for Communication Efficient Nonconvex Distributed LearningNeural Information Processing Systems (NeurIPS), 2022
Tomoya Murata
Taiji Suzuki
FedML
433
4
0
12 Feb 2022
Communication-Efficient Federated Learning with Accelerated Client
  Gradient
Communication-Efficient Federated Learning with Accelerated Client GradientComputer Vision and Pattern Recognition (CVPR), 2022
Geeho Kim
Jinkyu Kim
Bohyung Han
FedML
290
45
0
10 Jan 2022
Towards Federated Learning on Time-Evolving Heterogeneous Data
Towards Federated Learning on Time-Evolving Heterogeneous Data
Yongxin Guo
Tao Lin
Xiaoying Tang
FedML
330
41
0
25 Dec 2021
Faster Rates for Compressed Federated Learning with Client-Variance
  Reduction
Faster Rates for Compressed Federated Learning with Client-Variance ReductionSIAM Journal on Mathematics of Data Science (SIMODS), 2021
Haoyu Zhao
Konstantin Burlachenko
Zhize Li
Peter Richtárik
FedML
460
21
0
24 Dec 2021
MDPGT: Momentum-based Decentralized Policy Gradient Tracking
MDPGT: Momentum-based Decentralized Policy Gradient TrackingAAAI Conference on Artificial Intelligence (AAAI), 2021
Zhanhong Jiang
Xian Yeow Lee
Sin Yong Tan
Kai Liang Tan
Aditya Balu
Young M. Lee
Chinmay Hegde
Soumik Sarkar
239
11
0
06 Dec 2021
Robust Training in High Dimensions via Block Coordinate Geometric Median
  Descent
Robust Training in High Dimensions via Block Coordinate Geometric Median Descent
Anish Acharya
Abolfazl Hashemi
Prateek Jain
Sujay Sanghavi
Inderjit S. Dhillon
Ufuk Topcu
187
36
0
16 Jun 2021
Quasi-Global Momentum: Accelerating Decentralized Deep Learning on
  Heterogeneous Data
Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous DataInternational Conference on Machine Learning (ICML), 2021
Tao Lin
Sai Praneeth Karimireddy
Sebastian U. Stich
Martin Jaggi
FedML
383
115
0
09 Feb 2021
Bias-Variance Reduced Local SGD for Less Heterogeneous Federated
  Learning
Bias-Variance Reduced Local SGD for Less Heterogeneous Federated LearningInternational Conference on Machine Learning (ICML), 2021
Tomoya Murata
Taiji Suzuki
FedML
259
61
0
05 Feb 2021
FedADC: Accelerated Federated Learning with Drift Control
FedADC: Accelerated Federated Learning with Drift ControlInternational Symposium on Information Theory (ISIT), 2020
Emre Ozfatura
Kerem Ozfatura
Deniz Gunduz
FedML
505
49
0
16 Dec 2020
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning
Sai Praneeth Karimireddy
Martin Jaggi
Satyen Kale
M. Mohri
Sashank J. Reddi
Sebastian U. Stich
A. Suresh
FedML
710
241
0
08 Aug 2020
1
Page 1 of 1