Variance Reduced Local SGD with Lower Communication Complexity

30 December 2019

Enhong Chen

Papers citing "Variance Reduced Local SGD with Lower Communication Complexity"

34 / 34 papers shown

Title
Provably Near-Optimal Federated Ensemble Distillation with Negligible Overhead Won-Jun Jang Hyeon-Seo Park Si-Hyeon Lee FedML 143 0 0 10 Feb 2025
FedNE: Surrogate-Assisted Federated Neighbor Embedding for Dimensionality Reduction Ziwei Li Xiaoqi Wang Hong-You Chen Han-Wei Shen Wei-Lun Chao FedML 30 0 0 17 Sep 2024
On the Convergence of a Federated Expectation-Maximization Algorithm Zhixu Tao Rajita Chandak Sanjeev R. Kulkarni FedML 30 0 0 11 Aug 2024
Benchmarking Algorithms for Federated Domain Generalization Ruqi Bai S. Bagchi David I. Inouye FedML 32 12 0 11 Jul 2023
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape Yan Sun Li Shen Shi-Yong Chen Liang Ding Dacheng Tao FedML 27 33 0 19 May 2023
Beyond ADMM: A Unified Client-variance-reduced Adaptive Federated Learning Framework Shuai Wang Yanqing Xu Z. Wang Tsung-Hui Chang Tony Q. S. Quek Defeng Sun FedML 25 9 0 03 Dec 2022
Scalable Collaborative Learning via Representation Sharing Frédéric Berdoz Abhishek Singh Martin Jaggi Ramesh Raskar FedML 17 3 0 20 Nov 2022
FedFM: Anchor-based Feature Matching for Data Heterogeneity in Federated Learning Rui Ye Zhenyang Ni Chenxin Xu Jianyu Wang Siheng Chen Yonina C. Eldar FedML 19 31 0 14 Oct 2022
Communication-Efficient Adam-Type Algorithms for Distributed Data Mining Wenhan Xian Feihu Huang Heng-Chiao Huang FedML 25 0 0 14 Oct 2022
FedVeca: Federated Vectorized Averaging on Non-IID Data with Adaptive Bi-directional Global Objective Ping Luo Jieren Cheng Zhenhao Liu N. Xiong Jie Wu FedML 14 1 0 28 Sep 2022
NET-FLEET: Achieving Linear Convergence Speedup for Fully Decentralized Federated Learning with Heterogeneous Data Xin Zhang Minghong Fang Zhuqing Liu Haibo Yang Jia-Wei Liu Zhengyuan Zhu FedML 8 14 0 17 Aug 2022
Confederated Learning: Federated Learning with Decentralized Edge Servers Bin Wang Jun Fang Hongbin Li Xiaojun Yuan Qing Ling FedML 21 23 0 30 May 2022
FedAvg with Fine Tuning: Local Updates Lead to Representation Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML 24 74 0 27 May 2022
Tighter Regret Analysis and Optimization of Online Federated Learning Dohyeok Kwon Jonghwan Park Songnam Hong 18 11 0 13 May 2022
Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentation An Xu Wenqi Li Pengfei Guo Dong Yang H. Roth Ali Hatamizadeh Can Zhao Daguang Xu Heng-Chiao Huang Ziyue Xu FedML 28 51 0 18 Mar 2022
Federated Semi-Supervised Learning with Class Distribution Mismatch Zhiguo Wang Xintong Wang Ruoyu Sun Tsung-Hui Chang FedML 6 12 0 29 Oct 2021
Cost-Effective Federated Learning in Mobile Edge Networks Bing Luo Xiang Li Shiqiang Wang Jianwei Huang Leandros Tassiulas FedML 49 71 0 12 Sep 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 173 411 0 14 Jul 2021
On Bridging Generic and Personalized Federated Learning for Image Classification Hong-You Chen Wei-Lun Chao FedML 16 21 0 02 Jul 2021
Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy Xinwei Zhang Xiangyi Chen Min-Fong Hong Zhiwei Steven Wu Jinfeng Yi FedML 22 90 0 25 Jun 2021
Behavior Mimics Distribution: Combining Individual and Group Behaviors for Federated Learning Hua Huang Fanhua Shang Yuanyuan Liu Hongying Liu FedML 11 14 0 23 Jun 2021
FedCM: Federated Learning with Client-level Momentum Jing Xu Sen Wang Liwei Wang Andrew Chi-Chih Yao FedML 22 94 0 21 Jun 2021
Local Adaptivity in Federated Learning: Convergence and Consistency Jianyu Wang Zheng Xu Zachary Garrett Zachary B. Charles Luyang Liu Gauri Joshi FedML 18 38 0 04 Jun 2021
FedCor: Correlation-Based Active Client Selection Strategy for Heterogeneous Federated Learning Minxue Tang Xuefei Ning Yitu Wang Jingwei Sun Yu Wang H. Li Yiran Chen FedML 19 78 0 24 Mar 2021
Faster Non-Convex Federated Learning via Global and Local Momentum Rudrajit Das Anish Acharya Abolfazl Hashemi Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu FedML 21 82 0 07 Dec 2020
Federated Composite Optimization Honglin Yuan Manzil Zaheer Sashank J. Reddi FedML 14 57 0 17 Nov 2020
Local SGD: Unified Theory and New Efficient Methods Eduard A. Gorbunov Filip Hanzely Peter Richtárik FedML 17 108 0 03 Nov 2020
Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters Filip Hanzely 19 0 0 26 Aug 2020
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization Jianyu Wang Qinghua Liu Hao Liang Gauri Joshi H. Vincent Poor MoMe FedML 14 1,295 0 15 Jul 2020
FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data Xinwei Zhang Mingyi Hong S. Dhople W. Yin Yang Liu FedML 16 227 0 22 May 2020
On the Convergence of Local Descent Methods in Federated Learning Farzin Haddadpour M. Mahdavi FedML 11 265 0 31 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 6 555 0 01 Oct 2019
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 250 13,360 0 25 Aug 2014
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 166 683 0 07 Dec 2010