On the Convergence of FedAvg on Non-IID Data

4 July 2019

Xiang Li

Kaixuan Huang

Wenhao Yang

Papers citing "On the Convergence of FedAvg on Non-IID Data"

35 / 1,085 papers shown

Title
Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence Nicolas Loizou Sharan Vaswani I. Laradji Simon Lacoste-Julien 27 181 0 24 Feb 2020
An Accuracy-Lossless Perturbation Method for Defending Privacy Attacks in Federated Learning Xue Yang Yan Feng Weijun Fang Jun Shao Xiaohu Tang Shutao Xia Rongxing Lu FedML AAML 11 44 0 23 Feb 2020
Dynamic Federated Learning Elsa Rizk Stefan Vlaski A. H. Sayed FedML 14 25 0 20 Feb 2020
Communication-Efficient Distributed SVD via Local Power Iterations Xiang Li Shusen Wang Kun Chen Zhihua Zhang 35 21 0 19 Feb 2020
Personalized Federated Learning: A Meta-Learning Approach Alireza Fallah Aryan Mokhtari Asuman Ozdaglar FedML 31 561 0 19 Feb 2020
Distributed Non-Convex Optimization with Sublinear Speedup under Intermittent Client Availability Yikai Yan Chaoyue Niu Yucheng Ding Zhenzhe Zheng Fan Wu Guihai Chen Shaojie Tang Zhihua Wu FedML 36 37 0 18 Feb 2020
Federated Matrix Factorization: Algorithm Design and Application to Data Clustering Shuai Wang Tsung-Hui Chang FedML 9 5 0 12 Feb 2020
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning Jinhyun So Başak Güler A. Avestimehr FedML 12 289 0 11 Feb 2020
Faster On-Device Training Using New Federated Momentum Algorithm Zhouyuan Huo Qian Yang Bin Gu Heng-Chiao Huang FedML 14 47 0 06 Feb 2020
Learning to Detect Malicious Clients for Robust Federated Learning Suyi Li Yong Cheng Wei Wang Yang Liu Tianjian Chen AAML FedML 19 223 0 01 Feb 2020
Convergence of Update Aware Device Scheduling for Federated Learning at the Wireless Edge M. Amiri Deniz Gunduz Sanjeev R. Kulkarni H. Vincent Poor 86 170 0 28 Jan 2020
FedDANE: A Federated Newton-Type Method Tian Li Anit Kumar Sahu Manzil Zaheer Maziar Sanjabi Ameet Talwalkar Virginia Smith FedML 18 155 0 07 Jan 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 69 6,069 0 10 Dec 2019
Secure Federated Submodel Learning Chaoyue Niu Fan Wu Shaojie Tang Lifeng Hua Rongfei Jia Chengfei Lv Zhihua Wu Guihai Chen FedML 6 30 0 06 Nov 2019
Device Scheduling with Fast Convergence for Wireless Federated Learning Misha Sra C. Schmandt Z. Niu FedML 16 189 0 03 Nov 2019
On the Convergence of Local Descent Methods in Federated Learning Farzin Haddadpour M. Mahdavi FedML 19 266 0 31 Oct 2019
Federated Uncertainty-Aware Learning for Distributed Hospital EHR Data Sabri Boughorbel Fethi Jarray Neethu Venugopal S. Moosa Haithum Elhadi Michel Makhlouf OOD FedML 21 51 0 27 Oct 2019
Abnormal Client Behavior Detection in Federated Learning Suyi Li Yong Cheng Yang Liu Wei Wang Tianjian Chen AAML 6 134 0 22 Oct 2019
Communication-Efficient Local Decentralized SGD Methods Xiang Li Wenhao Yang Shusen Wang Zhihua Zhang 22 53 0 21 Oct 2019
Federated Learning with Unbiased Gradient Aggregation and Controllable Meta Updating Xin Yao Tianchi Huang Ruixiao Zhang Ruiyu Li Lifeng Sun FedML 27 70 0 18 Oct 2019
Overcoming Forgetting in Federated Learning on Non-IID Data N. Shoham Tomer Avidor Aviv Keren Nadav Tal-Israel Daniel Benditkis Liron Mor Yosef Itai Zeitak CLL FedML 23 217 0 17 Oct 2019
SCAFFOLD: Stochastic Controlled Averaging for Federated Learning Sai Praneeth Karimireddy Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 17 343 0 14 Oct 2019
Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraints Felix Sattler K. Müller Wojciech Samek FedML 40 965 0 04 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 6 556 0 01 Oct 2019
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization Amirhossein Reisizadeh Aryan Mokhtari Hamed Hassani Ali Jadbabaie Ramtin Pedarsani FedML 174 760 0 28 Sep 2019
Improving Federated Learning Personalization via Model Agnostic Meta Learning Yihan Jiang Jakub Konecný Keith Rush Sreeram Kannan FedML 6 586 0 27 Sep 2019
Model Pruning Enables Efficient Federated Learning on Edge Devices Yuang Jiang Shiqiang Wang Victor Valls Bongjun Ko Wei-Han Lee Kin K. Leung Leandros Tassiulas 30 443 0 26 Sep 2019
Matrix Sketching for Secure Collaborative Machine Learning Mengjiao Zhang Shusen Wang FedML 16 14 0 24 Sep 2019
Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification T. Hsu Qi Matthew Brown FedML 6 1,111 0 13 Sep 2019
Tighter Theory for Local SGD on Identical and Heterogeneous Data Ahmed Khaled Konstantin Mishchenko Peter Richtárik 18 424 0 10 Sep 2019
First Analysis of Local GD on Heterogeneous Data Ahmed Khaled Konstantin Mishchenko Peter Richtárik FedML 13 172 0 10 Sep 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 16 4,414 0 21 Aug 2019
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection Q. Li Zeyi Wen Zhaomin Wu Sixu Hu Naibo Wang Yuan N. Li Xu Liu Bingsheng He FedML 29 968 0 23 Jul 2019
Client-Edge-Cloud Hierarchical Federated Learning Lumin Liu Jun Zhang S. H. Song Khaled B. Letaief FedML 8 727 0 16 May 2019
Adaptive Federated Learning in Resource Constrained Edge Computing Systems Shiqiang Wang Tiffany Tuor Theodoros Salonidis K. Leung C. Makaya T. He Kevin S. Chan 144 1,687 0 14 Apr 2018