Local SGD Converges Fast and Communicates Little

24 May 2018

Papers citing "Local SGD Converges Fast and Communicates Little"

50 / 629 papers shown

Title
Towards Fast Personalized Semi-Supervised Federated Learning in Edge Networks: Algorithm Design and Theoretical Guarantee Shuai Wang Yanqing Xu Yanli Yuan Tony Q. S. Quek FedML 16 8 0 07 Jun 2023
Guiding The Last Layer in Federated Learning with Pre-Trained Models G. Legate Nicolas Bernier Lucas Page-Caccia Edouard Oyallon Eugene Belilovsky FedML 11 8 0 06 Jun 2023
A Lightweight Method for Tackling Unknown Participation Statistics in Federated Averaging Shiqiang Wang Mingyue Ji FedML 30 0 0 06 Jun 2023
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation Davoud Ataee Tarzanagh Mingchen Li Pranay Sharma Samet Oymak 24 0 0 02 Jun 2023
Adaptive Self-Distillation for Minimizing Client Drift in Heterogeneous Federated Learning M.Yashwanth Gaurav Kumar Nayak Aryaveer Singh Yogesh Singh Anirban Chakraborty FedML 22 1 0 31 May 2023
SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learning Yifan Yang Peiyao Xiao Kaiyi Ji FedML 24 14 0 30 May 2023
Global-QSGD: Practical Floatless Quantization for Distributed Learning with Theoretical Guarantees Jihao Xin Marco Canini Peter Richtárik Samuel Horváth 20 2 0 29 May 2023
Partially Personalized Federated Learning: Breaking the Curse of Data Heterogeneity Konstantin Mishchenko Rustem Islamov Eduard A. Gorbunov Samuel Horváth FedML 33 11 0 29 May 2023
Unbiased Compression Saves Communication in Distributed Optimization: When and How Much? Yutong He Xinmeng Huang Kun Yuan 29 8 0 25 May 2023
Federated Composite Saddle Point Optimization Site Bai Brian Bullins FedML 30 0 0 25 May 2023
Towards More Suitable Personalization in Federated Learning via Decentralized Partial Model Training Yi Shi Yingqi Liu Yan Sun Zihao Lin Li Shen Xueqian Wang Dacheng Tao FedML 40 10 0 24 May 2023
Local SGD Accelerates Convergence by Exploiting Second Order Information of the Loss Function Linxuan Pan Shenghui Song FedML 17 2 0 24 May 2023
Asynchronous Multi-Model Dynamic Federated Learning over Wireless Networks: Theory, Modeling, and Optimization Zhangyu Chang Seyyedali Hosseinalipour M. Chiang Christopher G. Brinton 24 3 0 22 May 2023
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape Yan Sun Li Shen Shi-Yong Chen Liang Ding Dacheng Tao FedML 31 33 0 19 May 2023
Is Aggregation the Only Choice? Federated Learning via Layer-wise Model Recombination Ming Hu Zhihao Yue Zhiwei Ling Cheng Chen Yihao Huang Xian Wei Xiang Lian Yang Liu Mingsong Chen FedML 19 8 0 18 May 2023
Simplifying Distributed Neural Network Training on Massive Graphs: Randomized Partitions Improve Model Aggregation Jiong Zhu Aishwarya N. Reganti E-Wen Huang Charles Dickens Nikhil S. Rao Karthik Subbian Danai Koutra GNN FedML 32 3 0 17 May 2023
Federated TD Learning over Finite-Rate Erasure Channels: Linear Speedup under Markovian Sampling Nicolò Dal Fabbro A. Mitra George J. Pappas FedML 33 12 0 14 May 2023
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression Yutong He Xinmeng Huang Yiming Chen W. Yin Kun Yuan 26 7 0 12 May 2023
Mobilizing Personalized Federated Learning in Infrastructure-Less and Heterogeneous Environments via Random Walk Stochastic ADMM Ziba Parsons Fei Dou Houyi Du Zheng Song Jin Lu 19 3 0 25 Apr 2023
More Communication Does Not Result in Smaller Generalization Error in Federated Learning Romain Chor Milad Sefidgaran A. Zaidi FedML AI4CE 21 10 0 24 Apr 2023
Hierarchical Weight Averaging for Deep Neural Networks Xiaozhe Gu Zixun Zhang Yuncheng Jiang Tao Luo Ruimao Zhang Shuguang Cui Zhuguo Li 16 5 0 23 Apr 2023
Joint Client Assignment and UAV Route Planning for Indirect-Communication Federated Learning Jieming Bian Cong Shen Jie Xu FedML 25 2 0 21 Apr 2023
Federated Compositional Deep AUC Maximization Xinwen Zhang Yihang Zhang Tianbao Yang Richard Souvenir Hongchang Gao FedML 20 7 0 20 Apr 2023
Incentive Mechanism Design for Unbiased Federated Learning with Randomized Client Participation Bing Luo Yutong Feng Shiqiang Wang Jianwei Huang Leandros Tassiulas FedML 21 10 0 17 Apr 2023
Re-Weighted Softmax Cross-Entropy to Control Forgetting in Federated Learning G. Legate Lucas Page-Caccia Eugene Belilovsky FedML 21 10 0 11 Apr 2023
Accelerating Hybrid Federated Learning Convergence under Partial Participation Jieming Bian Lei Wang Kun Yang Cong Shen Jie Xu FedML 12 11 0 10 Apr 2023
Probably Approximately Correct Federated Learning Xiaojin Zhang Anbu Huang Lixin Fan Kai Chen Qiang Yang FedML 25 5 0 10 Apr 2023
SLowcal-SGD: Slow Query Points Improve Local-SGD for Stochastic Convex Optimization Kfir Y. Levy Kfir Y. Levy FedML 43 2 0 09 Apr 2023
On the Local Cache Update Rules in Streaming Federated Learning Heqiang Wang Jieming Bian Jie Xu 24 4 0 28 Mar 2023
Adaptive Federated Learning via New Entropy Approach Shensheng Zheng Wenhao Yuan Xuehe Wang Ling-Yu Duan FedML OOD 22 1 0 27 Mar 2023
Communication-Efficient Design for Quantized Decentralized Federated Learning L. Chen Wei Liu Yunfei Chen Weidong Wang FedML MQ 52 14 0 15 Mar 2023
Making Batch Normalization Great in Federated Deep Learning Jike Zhong Hong-You Chen Wei-Lun Chao FedML 21 9 0 12 Mar 2023
Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering Xu Zhang Wenpeng Li Yunfeng Shao Yinchuan Li FedML 19 4 0 08 Mar 2023
A Unified Momentum-based Paradigm of Decentralized SGD for Non-Convex Models and Heterogeneous Data Haizhou Du Chengdong Ni 17 1 0 01 Mar 2023
Post Quantum Secure Blockchain-based Federated Learning for Mobile Edge Computing Rongxin Xu Shiva Raj Pokhrel Qiujun Lan Gang Li 21 5 0 26 Feb 2023
TAMUNA: Doubly Accelerated Distributed Optimization with Local Training, Compression, and Partial Participation Laurent Condat Ivan Agarský Grigory Malinovsky Peter Richtárik FedML 22 4 0 20 Feb 2023
Magnitude Matters: Fixing SIGNSGD Through Magnitude-Aware Sparsification in the Presence of Data Heterogeneity Richeng Jin Xiaofan He C. Zhong Zhaoyang Zhang Tony Q. S. Quek H. Dai FedML 21 1 0 19 Feb 2023
Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities Aleksandr Beznosikov Martin Takáč Alexander Gasnikov 21 10 0 15 Feb 2023
Sparse-SignSGD with Majority Vote for Communication-Efficient Distributed Learning Chanho Park Namyoon Lee FedML 19 3 0 15 Feb 2023
Federated Learning via Indirect Server-Client Communications Jieming Bian Cong Shen Jie Xu FedML 13 4 0 14 Feb 2023
EPISODE: Episodic Gradient Clipping with Periodic Resampled Corrections for Federated Learning with Heterogeneous Data M. Crawshaw Yajie Bao Mingrui Liu FedML 14 8 0 14 Feb 2023
FedDA: Faster Framework of Local Adaptive Gradient Methods via Restarted Dual Averaging Junyi Li Feihu Huang Heng-Chiao Huang FedML 25 1 0 13 Feb 2023
Achieving Linear Speedup in Non-IID Federated Bilevel Learning Minhui Huang Dewei Zhang Kaiyi Ji FedML 27 18 0 10 Feb 2023
Communication-Efficient Federated Hypergradient Computation via Aggregated Iterative Differentiation Peiyao Xiao Kaiyi Ji FedML 24 10 0 09 Feb 2023
Delay Sensitive Hierarchical Federated Learning with Stochastic Local Updates Abdulmoneam Ali A. Arafa FedML 34 4 0 09 Feb 2023
Federated Minimax Optimization with Client Heterogeneity Pranay Sharma Rohan Panda Gauri Joshi FedML 30 9 0 08 Feb 2023
Federated Learning with Regularized Client Participation Grigory Malinovsky Samuel Horváth Konstantin Burlachenko Peter Richtárik FedML 20 13 0 07 Feb 2023
On the Convergence of Federated Averaging with Cyclic Client Participation Yae Jee Cho Pranay Sharma Gauri Joshi Zheng Xu Satyen Kale Tong Zhang FedML 31 27 0 06 Feb 2023
Gradient Descent with Linearly Correlated Noise: Theory and Applications to Differential Privacy Anastasia Koloskova Ryan McKenna Zachary B. Charles Keith Rush Brendan McMahan 27 8 0 02 Feb 2023
Time-sensitive Learning for Heterogeneous Federated Edge Intelligence Yong Xiao Xiaohan Zhang Guangming Shi Marwan Krunz Diep N. Nguyen D. Hoang 21 15 0 26 Jan 2023