Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning

27 January 2021

Haibo Yang

Papers citing "Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning"

50 / 56 papers shown

Title
Cluster-Aware Multi-Round Update for Wireless Federated Learning in Heterogeneous Environments Pengcheng Sun Erwu Liu Wei Ni Kanglei Yu Rui-cang Wang Abbas Jamalipour FedML 21 0 0 06 May 2025
Convergence Analysis of Asynchronous Federated Learning with Gradient Compression for Non-Convex Optimization Diying Yang Yingwei Hou Danyang Xiao Weigang Wu FedML 39 0 0 28 Apr 2025
Communication-Efficient Device Scheduling for Federated Learning Using Lyapunov Optimization Jake B. Perazzone Shiqiang Wang Mingyue Ji Kevin S. Chan FedML 65 0 0 01 Mar 2025
FedSat: A Statistical Aggregation Approach for Class Imbalanced Clients in Federated Learning S. Chowdhury Raju Halder FedML 35 0 0 31 Dec 2024
OledFL: Unleashing the Potential of Decentralized Federated Learning via Opposite Lookahead Enhancement Qinglun Li Miao Zhang Mengzhu Wang Quanjun Yin Li Shen OODD FedML 19 0 0 09 Oct 2024
Online-Score-Aided Federated Learning: Taming the Resource Constraints in Wireless Networks Md Ferdous Pervej Minseok Choi A. Molisch 33 0 0 12 Aug 2024
A New Theoretical Perspective on Data Heterogeneity in Federated Optimization Jiayi Wang Shiqiang Wang Rong-Rong Chen Mingyue Ji FedML 28 1 0 22 Jul 2024
Understanding Server-Assisted Federated Learning in the Presence of Incomplete Client Participation Haibo Yang Pei-Yuan Qiu Prashant Khanduri Minghong Fang Jia Liu FedML 40 1 0 04 May 2024
LoCoDL: Communication-Efficient Distributed Learning with Local Training and Compression Laurent Condat A. Maranjyan Peter Richtárik 39 3 0 07 Mar 2024
FedUV: Uniformity and Variance for Heterogeneous Federated Learning Ha Min Son M. Kim Tai-Myung Chung Chao Huang Xin Liu FedML 41 3 0 27 Feb 2024
FedImpro: Measuring and Improving Client Update in Federated Learning Zhenheng Tang Yonggang Zhang S. Shi Xinmei Tian Tongliang Liu Bo Han Xiaowen Chu FedML 17 13 0 10 Feb 2024
Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codes Xiaoxin Su Yipeng Zhou Laizhong Cui John C. S. Lui Jiangchuan Liu FedML 27 1 0 06 Feb 2024
AirFL-Mem: Improving Communication-Learning Trade-Off by Long-Term Memory Haifeng Wen Hong Xing Osvaldo Simeone 32 0 0 25 Oct 2023
A Survey for Federated Learning Evaluations: Goals and Measures Di Chai Leye Wang Liu Yang Junxue Zhang Kai Chen Qian Yang ELM FedML 17 21 0 23 Aug 2023
Efficient Federated Learning via Local Adaptive Amended Optimizer with Linear Speedup Yan Sun Li Shen Hao Sun Liang Ding Dacheng Tao FedML 19 16 0 30 Jul 2023
Efficient Semi-Supervised Federated Learning for Heterogeneous Participants Zhipeng Sun Yang Xu Hong-Ze Xu Liusheng Huang C. Qiao FedML 17 0 0 29 Jul 2023
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape Yan Sun Li Shen Shi-Yong Chen Liang Ding Dacheng Tao FedML 34 33 0 19 May 2023
Faster Federated Learning with Decaying Number of Local SGD Steps Jed Mills Jia Hu Geyong Min FedML 30 7 0 16 May 2023
On the Local Cache Update Rules in Streaming Federated Learning Heqiang Wang Jieming Bian Jie Xu 24 4 0 28 Mar 2023
Federated Gradient Matching Pursuit Halyun Jeong Deanna Needell Jing Qin FedML 35 1 0 20 Feb 2023
Distributed Stochastic Optimization under a General Variance Condition Kun-Yen Huang Xiao Li Shin-Yi Pu FedML 37 5 0 30 Jan 2023
Entropy-driven Fair and Effective Federated Learning Lung-Chuang Wang Zhichao Wang Sai Praneeth Karimireddy Xiaoying Tang Xiaoying Tang FedML 33 9 0 29 Jan 2023
Federated Learning with Flexible Control Shiqiang Wang Jake B. Perazzone Mingyue Ji Kevin S. Chan FedML 28 17 0 16 Dec 2022
GlueFL: Reconciling Client Sampling and Model Masking for Bandwidth Efficient Federated Learning Shiqi He Qifan Yan Feijie Wu Lanjun Wang Mathias Lécuyer Ivan Beschastnikh FedML 36 7 0 03 Dec 2022
Analysis of Error Feedback in Federated Non-Convex Optimization with Biased Compression Xiaoyun Li Ping Li FedML 32 4 0 25 Nov 2022
Federated Hypergradient Descent A. K. Kan FedML 32 3 0 03 Nov 2022
Communication-Efficient Local SGD with Age-Based Worker Selection Feng Zhu Jingjing Zhang Xin Eric Wang 18 1 0 31 Oct 2022
Hierarchical Federated Learning with Momentum Acceleration in Multi-Tier Networks Zhengjie Yang Sen Fu Wei Bao Dong Yuan Albert Y. Zomaya FedML 39 5 0 26 Oct 2022
Federated Learning Using Variance Reduced Stochastic Gradient for Probabilistically Activated Agents M. Rostami S. S. Kia FedML 28 8 0 25 Oct 2022
FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settings Jean Ogier du Terrail Samy Ayed Edwige Cyffers Felix Grimberg Chaoyang He ... Sai Praneeth Karimireddy Marco Lorenzi Giovanni Neglia Marc Tommasi M. Andreux FedML 38 142 0 10 Oct 2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization Feng Zhu Jingjing Zhang Xin Eric Wang 26 3 0 06 Oct 2022
NET-FLEET: Achieving Linear Convergence Speedup for Fully Decentralized Federated Learning with Heterogeneous Data Xin Zhang Minghong Fang Zhuqing Liu Haibo Yang Jia-Wei Liu Zhengyuan Zhu FedML 13 14 0 17 Aug 2022
On the Convergence of Multi-Server Federated Learning with Overlapping Area Zhe Qu Xingyu Li Jie Xu Bo Tang Zhuo Lu Yao-Hong Liu FedML 45 14 0 16 Aug 2022
A Fast Blockchain-based Federated Learning Framework with Compressed Communications Laizhong Cui Xiaoxin Su Yipeng Zhou FedML 8 23 0 12 Aug 2022
Generalized Federated Learning via Sharpness Aware Minimization Zhe Qu Xingyu Li Rui Duan Yaojiang Liu Bo Tang Zhuo Lu FedML 20 130 0 06 Jun 2022
DELTA: Diverse Client Sampling for Fasting Federated Learning Lung-Chuang Wang Yongxin Guo Tao R. Lin Xiaoying Tang FedML 23 21 0 27 May 2022
Semi-Decentralized Federated Learning with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 34 32 0 23 May 2022
Over-the-Air Federated Learning with Joint Adaptive Computation and Power Control Haibo Yang Pei-Yuan Qiu Jia Liu Aylin Yener 10 18 0 12 May 2022
Communication-Efficient Adaptive Federated Learning Yujia Wang Lu Lin Jinghui Chen FedML 21 69 0 05 May 2022
FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction Liang Gao H. Fu Li Li Yingwen Chen Minghua Xu Chengzhong Xu FedML 21 242 0 22 Mar 2022
Federated Class-Incremental Learning Jiahua Dong Lixu Wang Zhen Fang Gan Sun Shichao Xu Xiao Wang Qi Zhu CLL FedML 22 168 0 22 Mar 2022
Federated Minimax Optimization: Improved Convergence Analyses and Algorithms Pranay Sharma Rohan Panda Gauri Joshi P. Varshney FedML 21 46 0 09 Mar 2022
Min-Max Bilevel Multi-objective Optimization with Applications in Machine Learning Alex Gu Songtao Lu Parikshit Ram Tsui-Wei Weng 32 10 0 03 Mar 2022
Robust Federated Learning with Connectivity Failures: A Semi-Decentralized Framework with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 40 8 0 24 Feb 2022
Learnings from Federated Learning in the Real world Christophe Dupuy Tanya Roosta Leo Long Clement Chung Rahul Gupta A. Avestimehr FedML 20 10 0 08 Feb 2022
Communication-Efficient Device Scheduling for Federated Learning Using Stochastic Optimization Jake B. Perazzone Shiqiang Wang Mingyue Ji Kevin S. Chan FedML 19 71 0 19 Jan 2022
A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning S. Zhang Jieyu Lin Qi Zhang 35 62 0 09 Jan 2022
Optimal Rate Adaption in Federated Learning with Compressed Communications Laizhong Cui Xiaoxin Su Yipeng Zhou Jiangchuan Liu FedML 30 38 0 13 Dec 2021
Context-Aware Online Client Selection for Hierarchical Federated Learning Zhe Qu Rui Duan Lixing Chen Jie Xu Zhuo Lu Yao-Hong Liu 26 61 0 02 Dec 2021
EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback Ilyas Fatkhullin Igor Sokolov Eduard A. Gorbunov Zhize Li Peter Richtárik 44 44 0 07 Oct 2021