Local SGD Converges Fast and Communicates Little

24 May 2018

Papers citing "Local SGD Converges Fast and Communicates Little"

50 / 629 papers shown

Title
Accelerating Fair Federated Learning: Adaptive Federated Adam Li Ju Tianru Zhang Salman Toor A. Hellander FedML 19 18 0 23 Jan 2023
ABS: Adaptive Bounded Staleness Converges Faster and Communicates Less Qiao Tan Feng Zhu Jingjing Zhang 28 0 0 21 Jan 2023
A Communication-Efficient Adaptive Algorithm for Federated Learning under Cumulative Regret Sudeep Salgia Qing Zhao T. Gabay Kobi Cohen FedML 27 10 0 21 Jan 2023
Network Adaptive Federated Learning: Congestion and Lossy Compression Parikshit Hegde G. Veciana Aryan Mokhtari FedML 18 4 0 11 Jan 2023
Decentralized Gradient Tracking with Local Steps Yue Liu Tao R. Lin Anastasia Koloskova Sebastian U. Stich 24 37 0 03 Jan 2023
Temporal Difference Learning with Compressed Updates: Error-Feedback meets Reinforcement Learning A. Mitra George J. Pappas Hamed Hassani 19 12 0 03 Jan 2023
When Do Curricula Work in Federated Learning? Saeed Vahidian Sreevatsank Kadaveru Woo-Ram Baek Weijia Wang Vyacheslav Kungurtsev C. L. P. Chen M. Shah Bill Lin FedML 32 11 0 24 Dec 2022
Deep Unfolding-based Weighted Averaging for Federated Learning in Heterogeneous Environments Ayano Nakai-Kasai T. Wadayama FedML 16 0 0 23 Dec 2022
Graph Federated Learning with Hidden Representation Sharing Shuang Wu Mingxuan Zhang Yuantong Li Carl Yang Pan Li FedML 19 1 0 23 Dec 2022
Federated Learning with Flexible Control Shiqiang Wang Jake B. Perazzone Mingyue Ji Kevin S. Chan FedML 28 17 0 16 Dec 2022
Scheduling and Aggregation Design for Asynchronous Federated Learning over Wireless Networks Chung-Hsuan Hu Zheng Chen Erik G. Larsson 22 64 0 14 Dec 2022
Tackling Data Heterogeneity in Federated Learning with Class Prototypes Yutong Dai Z. Chen Junnan Li Shelby Heinecke Lichao Sun Ran Xu FedML 15 77 0 06 Dec 2022
FedKNOW: Federated Continual Learning with Signature Task Knowledge Integration at Edge Yaxin Luopan Rui Han Qinglong Zhang Chi Harold Liu Guoren Wang FedML 23 18 0 04 Dec 2022
Beyond ADMM: A Unified Client-variance-reduced Adaptive Federated Learning Framework Shuai Wang Yanqing Xu Z. Wang Tsung-Hui Chang Tony Q. S. Quek Defeng Sun FedML 25 9 0 03 Dec 2022
Analysis of Error Feedback in Federated Non-Convex Optimization with Biased Compression Xiaoyun Li Ping Li FedML 32 4 0 25 Nov 2022
Online Federated Learning via Non-Stationary Detection and Adaptation amidst Concept Drift Bhargav Ganguly Vaneet Aggarwal FedML 16 8 0 22 Nov 2022
Explainable, Domain-Adaptive, and Federated Artificial Intelligence in Medicine A. Chaddad Qizong Lu Jiali Li Y. Katib R. Kateb C. Tanougast Ahmed Bouridane Ahmed Abdulkadir OOD 24 38 0 17 Nov 2022
Federated Learning for Appearance-based Gaze Estimation in the Wild Mayar Elfares Zhiming Hu Pascal Reisert Andreas Bulling Ralf Küsters FedML 19 11 0 14 Nov 2022
Adaptive Federated Minimax Optimization with Lower Complexities Feihu Huang Xinrui Wang Junyi Li Songcan Chen FedML 11 5 0 14 Nov 2022
Alternating Implicit Projected SGD and Its Efficient Variants for Equality-constrained Bilevel Optimization Quan-Wu Xiao Han Shen W. Yin Tianyi Chen 16 8 0 14 Nov 2022
Clustered Federated Learning based on Nonconvex Pairwise Fusion Xue Yu Ziyi Liu Wu Wang Yifan Sun FedML 32 7 0 08 Nov 2022
Stochastic Coded Federated Learning: Theoretical Analysis and Incentive Mechanism Design Yuchang Sun Jiawei Shao Yuyi Mao Songze Li Jun Zhang FedML 9 8 0 08 Nov 2022
Over-The-Air Clustered Wireless Federated Learning Ayush Madhan-Sohini Divin Dominic Nazreen Shah Ranjitha Prasad 24 2 0 07 Nov 2022
Faster Adaptive Momentum-Based Federated Methods for Distributed Composition Optimization Feihu Huang FedML 20 1 0 03 Nov 2022
A Convergence Theory for Federated Average: Beyond Smoothness Xiaoxiao Li Zhao-quan Song Runzhou Tao Guangyi Zhang FedML 32 5 0 03 Nov 2022
Fast Adaptive Federated Bilevel Optimization Feihu Huang FedML 20 7 0 02 Nov 2022
RCD-SGD: Resource-Constrained Distributed SGD in Heterogeneous Environment via Submodular Partitioning Haoze He Parijat Dube 13 1 0 02 Nov 2022
Optimal Complexity in Non-Convex Decentralized Learning over Time-Varying Networks Xinmeng Huang Kun Yuan 22 6 0 01 Nov 2022
LOFT: Finding Lottery Tickets through Filter-wise Training Qihan Wang Chen Dun Fangshuo Liao C. Jermaine Anastasios Kyrillidis 18 3 0 28 Oct 2022
Efficient and Light-Weight Federated Learning via Asynchronous Distributed Dropout Chen Dun Mirian Hipolito Garcia C. Jermaine Dimitrios Dimitriadis Anastasios Kyrillidis 56 20 0 28 Oct 2022
FeDXL: Provable Federated Learning for Deep X-Risk Optimization Zhishuai Guo R. L. Jin Jiebo Luo Tianbao Yang FedML 47 8 0 26 Oct 2022
FedGRec: Federated Graph Recommender System with Lazy Update of Latent Embeddings Junyi Li Heng-Chiao Huang FedML 21 6 0 25 Oct 2022
Provably Doubly Accelerated Federated Learning: The First Theoretically Successful Combination of Local Training and Communication Compression Laurent Condat Ivan Agarský Peter Richtárik FedML 24 16 0 24 Oct 2022
Local SGD in Overparameterized Linear Regression Mike Nguyen Charly Kirst Nicole Mücke 15 0 0 20 Oct 2022
lo-fi: distributed fine-tuning without communication Mitchell Wortsman Suchin Gururangan Shen Li Ali Farhadi Ludwig Schmidt Michael G. Rabbat Ari S. Morcos 24 24 0 19 Oct 2022
Random Orthogonalization for Federated Learning in Massive MIMO Systems Xizixiang Wei Cong Shen Jing Yang H. Vincent Poor 47 14 0 18 Oct 2022
Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerability Zhao-quan Song Yitan Wang Zheng Yu Licheng Zhang FedML 23 28 0 15 Oct 2022
FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation Ming Hu Peiheng Zhou Zhihao Yue Zhiwei Ling Yihao Huang Anran Li Yang Liu Xiang Lian Mingsong Chen FedML 16 14 0 15 Oct 2022
Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization Kun Yuan Xinmeng Huang Yiming Chen Xiaohan Zhang Yingya Zhang Pan Pan 16 17 0 14 Oct 2022
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities Brian Bartoldson B. Kailkhura Davis W. Blalock 29 47 0 13 Oct 2022
On the Performance of Gradient Tracking with Local Updates Edward Duc Hien Nguyen Sulaiman A. Alghunaim Kun Yuan César A. Uribe 35 18 0 10 Oct 2022
Scaling up Stochastic Gradient Descent for Non-convex Optimisation S. Mohamad H. Alamri A. Bouchachia 39 3 0 06 Oct 2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization Feng Zhu Jingjing Zhang Xin Eric Wang 26 3 0 06 Oct 2022
ISFL: Federated Learning for Non-i.i.d. Data with Local Importance Sampling Zheqi Zhu Yuchen Shi Pingyi Fan Chenghui Peng Khaled B. Letaief FedML 23 8 0 05 Oct 2022
PersA-FL: Personalized Asynchronous Federated Learning Taha Toghani Soomin Lee César A. Uribe FedML 32 6 0 03 Oct 2022
Unbounded Gradients in Federated Learning with Buffered Asynchronous Aggregation Taha Toghani César A. Uribe FedML 35 14 0 03 Oct 2022
Block-wise Training of Residual Networks via the Minimizing Movement Scheme Skander Karkar Ibrahim Ayed Emmanuel de Bézenac Patrick Gallinari 27 1 0 03 Oct 2022
Distributed Non-Convex Optimization with One-Bit Compressors on Heterogeneous Data: Efficient and Resilient Algorithms Ming Xiang Lili Su FedML 21 2 0 03 Oct 2022
$SAGDA: Achieving $\mathcal{O}(ε^{-2})$ Communication Complexity in Federated Min-Max Learning$ SAGDA: Achieving $\mathcal{O}(ε^{-2})$ Communication Complexity in Federated Min-Max Learning Haibo Yang Zhuqing Liu Xin Zhang Jia-Wei Liu FedML 28 0 0 02 Oct 2022
On the Stability Analysis of Open Federated Learning Systems Youbang Sun H. Fernando Tianyi Chen Shahin Shahrampour FedML 29 1 0 25 Sep 2022