On the Convergence of FedAvg on Non-IID Data

4 July 2019

Xiang Li

Kaixuan Huang

Wenhao Yang

Papers citing "On the Convergence of FedAvg on Non-IID Data"

50 / 1,085 papers shown

Title
Communication-Efficient Training Workload Balancing for Decentralized Multi-Agent Learning Seyed Mahmoud Sajjadi Mohammadabadi Lei Yang Feng Yan Junshan Zhang 26 5 0 01 May 2024
WHALE-FL: Wireless and Heterogeneity Aware Latency Efficient Federated Learning over Mobile Devices via Adaptive Subnetwork Scheduling Huai-an Su Jiaxiang Geng Liang Li Xiaoqi Qin Yanzhao Hou Xin Fu Miao Pan Miao Pan 40 1 0 01 May 2024
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition Yuxuan Yan Qianqian Yang Shunpu Tang Zhiguo Shi 38 13 0 29 Apr 2024
An Aggregation-Free Federated Learning for Tackling Data Heterogeneity Yuan Wang Huazhu Fu Renuga Kanagavelu Qingsong Wei Yong Liu Rick Siow Mong Goh FedML 18 29 0 29 Apr 2024
Joint Energy and Latency Optimization in Federated Learning over Cell-Free Massive MIMO Networks Afsaneh Mahmoudi M. Zaher Emil Björnson 26 3 0 28 Apr 2024
An Element-Wise Weights Aggregation Method for Federated Learning Yi Hu Hanchi Ren Chen Hu Jingjing Deng Xianghua Xie FedML 24 3 0 24 Apr 2024
Collaborative Heterogeneous Causal Inference Beyond Meta-analysis Tianyu Guo Sai Praneeth Karimireddy Michael I. Jordan FedML 28 1 0 24 Apr 2024
FLARE: A New Federated Learning Framework with Adjustable Learning Rates over Resource-Constrained Wireless Networks Bingnan Xiao Jingjing Zhang Wei Ni Xin Eric Wang 36 0 0 23 Apr 2024
Adaptive Heterogeneous Client Sampling for Federated Learning over Wireless Networks Bing Luo Wenli Xiao Shiqiang Wang Jianwei Huang Leandros Tassiulas FedML 25 4 0 22 Apr 2024
PAFedFV: Personalized and Asynchronous Federated Learning for Finger Vein Recognition Hengyu Mu Jian Guo Chong Han Lijuan Sun FedML 24 5 0 20 Apr 2024
A Survey on Federated Analytics: Taxonomy, Enabling Techniques, Applications and Open Issues Zibo Wang Haichao Ji Yifei Zhu Dan Wang Zhu Han 51 1 0 19 Apr 2024
Empowering Federated Learning with Implicit Gossiping: Mitigating Connection Unreliability Amidst Unknown and Arbitrary Dynamics Ming Xiang Stratis Ioannidis Edmund Yeh Carlee Joe-Wong Lili Su FedML 24 2 0 15 Apr 2024
Federated Learning on Riemannian Manifolds with Differential Privacy Zhenwei Huang Wen Huang Pratik Jawanpuria Bamdev Mishra FedML 34 6 0 15 Apr 2024
On the Efficiency of Privacy Attacks in Federated Learning Nawrin Tabassum Ka-Ho Chow Xuyu Wang Wenbin Zhang Yanzhao Wu FedML 37 1 0 15 Apr 2024
Communication-Efficient Model Aggregation with Layer Divergence Feedback in Federated Learning Liwei Wang Jun Li Wen Chen Qing-Bin Wu Ming Ding 43 1 0 12 Apr 2024
FLoRA: Enhancing Vision-Language Models with Parameter-Efficient Federated Learning Duy Phuong Nguyen J. P. Muñoz Ali Jannesari VLM 29 6 0 12 Apr 2024
Stochastic Constrained Decentralized Optimization for Machine Learning with Fewer Data Oracles: a Gradient Sliding Approach Hoang Huy Nguyen Yan Li Tuo Zhao 21 1 0 03 Apr 2024
CATGNN: Cost-Efficient and Scalable Distributed Training for Graph Neural Networks Xin Huang Weipeng Zhuo Minh Phu Vuong Shiju Li Jongryool Kim Bradley Rees Chul-Ho Lee GNN 25 0 0 02 Apr 2024
Rethinking Resource Management in Edge Learning: A Joint Pre-training and Fine-tuning Design Paradigm Zhonghao Lyu Yuchen Li Guangxu Zhu Jie Xu H. Vincent Poor Shuguang Cui 29 7 0 01 Apr 2024
Biased Over-the-Air Federated Learning under Wireless Heterogeneity Muhammad Faraz Ul Abrar Nicolò Michelusi 36 2 0 28 Mar 2024
Transformers-based architectures for stroke segmentation: A review Yalda Zafari-Ghadim Essam A. Rashed M. Mabrok MedIm 24 1 0 27 Mar 2024
Stragglers-Aware Low-Latency Synchronous Federated Learning via Layer-Wise Model Updates Natalie Lang Alejandro Cohen Nir Shlezinger FedML 53 4 0 27 Mar 2024
GPFL: A Gradient Projection-Based Client Selection Framework for Efficient Federated Learning Shijie Na Yuzhi Liang S.M. Yiu FedML 31 0 0 26 Mar 2024
FedMIL: Federated-Multiple Instance Learning for Video Analysis with Optimized DPP Scheduling Ashish Bastola Hao Wang Xiwen Chen Abolfazl Razi 26 0 0 26 Mar 2024
FedFixer: Mitigating Heterogeneous Label Noise in Federated Learning Xinyuan Ji Zhaowei Zhu Wei Xi Olga Gadyatskaya Zilong Song Yong Cai Yang Liu FedML 47 7 0 25 Mar 2024
Rethinking the Representation in Federated Unsupervised Learning with Non-IID Data Xinting Liao Weiming Liu Chaochao Chen Pengyang Zhou Fengyuan Yu Huabin Zhu Binhui Yao Tao Wang Xiaolin Zheng Yanchao Tan FedML 43 7 0 25 Mar 2024
Efficiently Assemble Normalization Layers and Regularization for Federated Domain Generalization Khiem Le-Huy Long Ho Cuong D. Do Danh Le-Phuoc Kok-Seng Wong OOD FedML 37 3 0 22 Mar 2024
FedMef: Towards Memory-efficient Federated Dynamic Pruning Hong Huang Weiming Zhuang Chen Chen Lingjuan Lyu 60 6 0 21 Mar 2024
FAGH: Accelerating Federated Learning with Approximated Global Hessian Mrinmay Sen A. K. Qin Krishna Mohan FedML 19 0 0 16 Mar 2024
FedComLoc: Communication-Efficient Distributed Training of Sparse and Quantized Models Kai Yi Georg Meinhardt Laurent Condat Peter Richtárik FedML 37 6 0 14 Mar 2024
Fisher Mask Nodes for Language Model Merging Thennal D K Ganesh Nathan Suchithra M S MoMe AI4CE 47 5 0 14 Mar 2024
DA-PFL: Dynamic Affinity Aggregation for Personalized Federated Learning Xu Yang Jiyuan Feng Songyue Guo Ye Wang Ye Ding Binxing Fang Qing Liao FedML 37 1 0 14 Mar 2024
Federated Learning of Socially Appropriate Agent Behaviours in Simulated Home Environments Saksham Checker Nikhil Churamani Hatice Gunes FedML 26 3 0 12 Mar 2024
FedClust: Optimizing Federated Learning on Non-IID Data through Weight-Driven Client Clustering Md Sirajul Islam Simin Javaherian Fei Xu Xu Yuan Li Chen Nianfeng Tzeng FedML 17 8 0 07 Mar 2024
Training Machine Learning models at the Edge: A Survey Aymen Rayane Khouas Mohamed Reda Bouadjenek Hakim Hacid Sunil Aryal 29 10 0 05 Mar 2024
Improving Group Connectivity for Generalization of Federated Deep Learning Zexi Li Jie Lin Zhiqi Li Didi Zhu Chao Wu AI4CE FedML 38 0 0 29 Feb 2024
Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approach Bin Wang Jun Fang Hongbin Li Yonina C. Eldar FedML 28 1 0 28 Feb 2024
Training Neural Networks from Scratch with Parallel Low-Rank Adapters Minyoung Huh Brian Cheung Jeremy Bernstein Phillip Isola Pulkit Agrawal 35 10 0 26 Feb 2024
Dependable Distributed Training of Compressed Machine Learning Models F. Malandrino G. Giacomo Marco Levorato C. Chiasserini 29 0 0 22 Feb 2024
FedADMM-InSa: An Inexact and Self-Adaptive ADMM for Federated Learning Yongcun Song Ziqi Wang Enrique Zuazua FedML 35 2 0 21 Feb 2024
Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients Xiaolu Wang Zijian Li Shi Jin Jun Zhang FedML 21 3 0 17 Feb 2024
Adaptive Federated Learning in Heterogeneous Wireless Networks with Independent Sampling Jiaxiang Geng Yanzhao Hou Xiaofeng Tao Juncheng Wang Bing Luo FedML 19 0 0 15 Feb 2024
FLASH: Federated Learning Across Simultaneous Heterogeneities Xiangyu Chang Sk. Miraj Ahmed S. Krishnamurthy Başak Güler A. Swami Samet Oymak A. Roy-Chowdhury FedML 24 2 0 13 Feb 2024
FedImpro: Measuring and Improving Client Update in Federated Learning Zhenheng Tang Yonggang Zhang S. Shi Xinmei Tian Tongliang Liu Bo Han Xiaowen Chu FedML 22 13 0 10 Feb 2024
OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learning Rui Ye Wenhao Wang Jingyi Chai Dihan Li Zexi Li Yinda Xu Yaxin Du Yanfeng Wang Siheng Chen ALM FedML AIFin 11 76 0 10 Feb 2024
On the Convergence of Zeroth-Order Federated Tuning for Large Language Models Zhenqing Ling Daoyuan Chen Liuyi Yao Yaliang Li Ying Shen FedML 47 12 0 08 Feb 2024
Expediting In-Network Federated Learning by Voting-Based Consensus Model Compression Xiaoxin Su Yipeng Zhou Laizhong Cui Song Guo FedML 11 3 0 06 Feb 2024
Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codes Xiaoxin Su Yipeng Zhou Laizhong Cui John C. S. Lui Jiangchuan Liu FedML 32 1 0 06 Feb 2024
The Landscape and Challenges of HPC Research and LLMs Le Chen Nesreen K. Ahmed Akashnil Dutta Arijit Bhattacharjee Sixing Yu ... Vy A. Vo J. P. Muñoz Ted Willke Tim Mattson Ali Jannesari AI4CE 48 20 0 03 Feb 2024
SignSGD with Federated Defense: Harnessing Adversarial Attacks through Gradient Sign Decoding Chanho Park Namyoon Lee FedML AAML 22 1 0 02 Feb 2024