Minibatch vs Local SGD for Heterogeneous Distributed Learning

8 June 2020

Papers citing "Minibatch vs Local SGD for Heterogeneous Distributed Learning"

26 / 26 papers shown

Title
On the Convergence of a Federated Expectation-Maximization Algorithm Zhixu Tao Rajita Chandak Sanjeev R. Kulkarni FedML 30 0 0 11 Aug 2024
A New Theoretical Perspective on Data Heterogeneity in Federated Optimization Jiayi Wang Shiqiang Wang Rong-Rong Chen Mingyue Ji FedML 18 1 0 22 Jul 2024
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework Siyuan Yu Wei Chen H. V. Poor 22 0 0 17 Jun 2024
The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication Kumar Kshitij Patel Margalit Glasgow Ali Zindari Lingxiao Wang Sebastian U. Stich Ziheng Cheng Nirmit Joshi Nathan Srebro 39 6 0 19 May 2024
FedImpro: Measuring and Improving Client Update in Federated Learning Zhenheng Tang Yonggang Zhang S. Shi Xinmei Tian Tongliang Liu Bo Han Xiaowen Chu FedML 13 13 0 10 Feb 2024
FedDRO: Federated Compositional Optimization for Distributionally Robust Learning Prashant Khanduri Chengyin Li Rafi Ibn Sultan Yao Qiang Joerg Kliewer Dongxiao Zhu 32 0 0 21 Nov 2023
Distributed Personalized Empirical Risk Minimization Yuyang Deng Mohammad Mahdi Kamani Pouria Mahdavinia M. Mahdavi 19 4 0 26 Oct 2023
When MiniBatch SGD Meets SplitFed Learning:Convergence Analysis and Performance Evaluation Chao Huang Geng Tian Ming Tang FedML 22 4 0 23 Aug 2023
SLowcal-SGD: Slow Query Points Improve Local-SGD for Stochastic Convex Optimization Kfir Y. Levy Kfir Y. Levy FedML 32 2 0 09 Apr 2023
Federated Gradient Matching Pursuit Halyun Jeong Deanna Needell Jing Qin FedML 35 1 0 20 Feb 2023
Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities Aleksandr Beznosikov Martin Takáč Alexander Gasnikov 21 10 0 15 Feb 2023
Federated Temporal Difference Learning with Linear Function Approximation under Environmental Heterogeneity Han Wang A. Mitra Hamed Hassani George J. Pappas James Anderson FedML 13 21 0 04 Feb 2023
Distributed Stochastic Optimization under a General Variance Condition Kun-Yen Huang Xiao Li Shin-Yi Pu FedML 20 5 0 30 Jan 2023
FedSysID: A Federated Approach to Sample-Efficient System Identification Han Wang Leonardo F. Toso James Anderson FedML 15 17 0 25 Nov 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 13 21 0 30 Jun 2022
Certified Robustness in Federated Learning Motasem Alfarra Juan C. Pérez Egor Shulgin Peter Richtárik Bernard Ghanem AAML FedML 10 7 0 06 Jun 2022
FedAvg with Fine Tuning: Local Updates Lead to Representation Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML 19 74 0 27 May 2022
Towards Federated Learning on Time-Evolving Heterogeneous Data Yongxin Guo Tao R. Lin Xiaoying Tang FedML 6 30 0 25 Dec 2021
On Convergence of Federated Averaging Langevin Dynamics Wei Deng Qian Zhang Yi-An Ma Zhao-quan Song Guang Lin FedML 20 16 0 09 Dec 2021
What Do We Mean by Generalization in Federated Learning? Honglin Yuan Warren Morningstar Lin Ning K. Singhal OOD FedML 15 71 0 27 Oct 2021
A Stochastic Newton Algorithm for Distributed Convex Optimization Brian Bullins Kumar Kshitij Patel Ohad Shamir Nathan Srebro Blake E. Woodworth 16 15 0 07 Oct 2021
FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning Charlie Hou K. K. Thekumparampil Giulia Fanti Sewoong Oh FedML 22 14 0 16 Aug 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 173 410 0 14 Jul 2021
On Communication Compression for Distributed Optimization on Heterogeneous Data Sebastian U. Stich 34 22 0 04 Sep 2020
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications Jihong Park S. Samarakoon Anis Elgabli Joongheon Kim M. Bennis Seong-Lyun Kim Mérouane Debbah 8 159 0 06 Aug 2020
Adaptive Personalized Federated Learning Yuyang Deng Mohammad Mahdi Kamani M. Mahdavi FedML 183 541 0 30 Mar 2020