On the Convergence of Zeroth-Order Federated Tuning for Large Language Models

8 February 2024

Papers citing "On the Convergence of Zeroth-Order Federated Tuning for Large Language Models"

6 / 6 papers shown

Title
Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization Zhe Li Bicheng Ying Zidong Liu Haibo Yang Haibo Yang FedML 36 3 0 24 May 2024
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes Zhen Qin Daoyuan Chen Bingchen Qian Bolin Ding Yaliang Li Shuiguang Deng FedML 20 30 0 11 Dec 2023
Efficient Personalized Federated Learning via Sparse Model-Adaptation Daoyuan Chen Fandong Meng Dawei Gao Bolin Ding Yaliang Li FedML 96 45 0 04 May 2023
Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning Wenzhi Fang Ziyi Yu Yuning Jiang Yuanming Shi Colin N. Jones Yong Zhou FedML 68 53 0 24 Jan 2022
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 160 358 0 14 Jul 2021
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 40 85 0 23 Oct 2020