TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Training

14 April 2023

Salman Avestimehr

Papers citing "TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Training"

21 / 21 papers shown

Title
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models Zheng Lin Yuxin Zhang Zhe Chen Zihan Fang Xianhao Chen Praneeth Vepakomma Wei Ni Jun-Jie Luo Yue Gao MoE 32 0 0 05 May 2025
Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training Hiroki Naganuma Xinzhi Zhang Man-Chung Yue Ioannis Mitliagkas Philipp A. Witte Russell J. Hewett Yin Tat Lee 63 0 0 25 Apr 2025
Unlocking the Value of Decentralized Data: A Federated Dual Learning Approach for Model Aggregation Junyi Zhu Ruicong Yao Taha Ceritli Savas Ozkan Matthew B. Blaschko Eunchung Noh Jeongwon Min Cho Jung Min Mete Ozay FedML 96 0 0 26 Mar 2025
Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogenous Federated Learning Jihyun Lim Junhyuk Jo Tuo Zhang Salman Avestimehr Sunwoo Lee FedML 39 0 0 14 Mar 2025
SEAFL: Enhancing Efficiency in Semi-Asynchronous Federated Learning through Adaptive Aggregation and Selective Training Md Sirajul Islam Sanjeev Panta F. Xu Xu Yuan Li Chen N. Tzeng FedML 33 0 0 22 Feb 2025
EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models Jialiang Cheng Ning Gao Yun Yue Zhiling Ye Jiadi Jiang Jian Sha OffRL 72 0 0 10 Dec 2024
Unity is Power: Semi-Asynchronous Collaborative Training of Large-Scale Models with Structured Pruning in Resource-Limited Clients Yan Li Mingyi Li Xiao Zhang Guangwei Xu Feng Chen Yuan Yuan Yifei Zou Mengying Zhao Jianbo Lu Dongxiao Yu 20 0 0 11 Oct 2024
Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration Mahdi Morafah Vyacheslav Kungurtsev Hojin Chang C. L. P. Chen Bill Lin FedML 22 0 0 27 Sep 2024
FedTSA: A Cluster-based Two-Stage Aggregation Method for Model-heterogeneous Federated Learning Boyu Fan Chenrui Wu Xiang Su Pan Hui FedML 27 2 0 06 Jul 2024
Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models Zihan Fang Zheng Lin Zhe Chen Xianhao Chen Yue Gao Yuguang Fang 46 33 0 09 Apr 2024
Stragglers-Aware Low-Latency Synchronous Federated Learning via Layer-Wise Model Updates Natalie Lang Alejandro Cohen Nir Shlezinger FedML 43 4 0 27 Mar 2024
Asynchronous Local-SGD Training for Language Modeling Bo Liu Rachita Chhaparia Arthur Douillard Satyen Kale Andrei A. Rusu Jiajun Shen Arthur Szlam MarcÁurelio Ranzato FedML 20 10 0 17 Jan 2024
FLrce: Resource-Efficient Federated Learning with Early-Stopping Strategy Ziru Niu Senior Member Ieee Hai Dong •. A. K. Qin Senior Member Ieee Tao Gu 17 4 0 15 Oct 2023
Federated Learning in IoT: a Survey from a Resource-Constrained Perspective Ishmeet Kaur 17 2 0 25 Aug 2023
FedAgg: Adaptive Federated Learning with Aggregated Gradients Wenhao Yuan Xuehe Wang FedML 17 0 0 28 Mar 2023
Adaptive Federated Learning via New Entropy Approach Shensheng Zheng Wenhao Yuan Xuehe Wang Ling-Yu Duan FedML OOD 11 1 0 27 Mar 2023
Papaya: Practical, Private, and Scalable Federated Learning Dzmitry Huba John Nguyen Kshitiz Malik Ruiyu Zhu Michael G. Rabbat ... H. Srinivas Kaikai Wang Anthony Shoumikhin Jesik Min Mani Malek FedML 97 133 0 08 Nov 2021
Efficient and Private Federated Learning with Partially Trainable Networks Hakim Sidahmed Zheng Xu Ankush Garg Yuan Cao Mingqing Chen FedML 38 13 0 06 Oct 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 167 410 0 14 Jul 2021
Stragglers Are Not Disaster: A Hybrid Federated Learning Algorithm with Delayed Gradients Xingyu Li Zhe Qu Bo Tang Zhuo Lu FedML 63 31 0 12 Feb 2021
FedML: A Research Library and Benchmark for Federated Machine Learning Chaoyang He Songze Li Jinhyun So Xiao Zeng Mi Zhang ... Yang Liu Ramesh Raskar Qiang Yang M. Annavaram Salman Avestimehr FedML 156 553 0 27 Jul 2020