FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large
Language Models

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

7 June 2024

Yanfeng Wang

Papers citing "FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models"

12 / 12 papers shown

Title
Symmetric Pruning of Large Language Models Kai Yi Peter Richtárik AAML VLM 57 0 0 31 Jan 2025
Data Quality Control in Federated Instruction-tuning of Large Language Models Yaxin Du Rui Ye Fengting Yuchi W. Zhao Jingjing Qu Y. Wang Siheng Chen ALM FedML 45 0 0 15 Oct 2024
Federated Instruction Tuning of LLMs with Domain Coverage Augmentation Zezhou Wang Yaxin Du Zhuzhong Qian Yugang Jiang Zhuzhong Qian Siheng Chen FedML 47 0 0 30 Sep 2024
WildChat: 1M ChatGPT Interaction Logs in the Wild Wenting Zhao Xiang Ren Jack Hessel Claire Cardie Yejin Choi Yuntian Deng 40 171 0 02 May 2024
FewFedPIT: Towards Privacy-preserving and Few-shot Federated Instruction Tuning Zhuo Zhang Jingyuan Zhang Jintao Huang Lizhen Qu Hongzhi Zhang Qifan Wang Xun Zhou Zenglin Xu FedML 16 3 0 10 Mar 2024
Enhancing Data Quality in Federated Fine-Tuning of Foundation Models Wanru Zhao Yaxin Du Nicholas D. Lane Siheng Chen Yanfeng Wang 27 1 0 07 Mar 2024
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning Shivalika Singh Freddie Vargus Daniel D'souza Börje F. Karlsson Abinaya Mahendiran ... Max Bartolo Julia Kreutzer A. Ustun Marzieh Fadaee Sara Hooker 115 115 0 09 Feb 2024
Vertical Federated Graph Neural Network for Recommender System Peihua Mai Yan Pang FedML 69 7 0 10 Mar 2023
Revisiting Weighted Aggregation in Federated Learning with Neural Networks Zexi Li Tao R. Lin Xinyi Shang Chao-Xiang Wu FedML 30 58 0 14 Feb 2023
Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned Deep Ganguli Liane Lovitt John Kernion Amanda Askell Yuntao Bai ... Nicholas Joseph Sam McCandlish C. Olah Jared Kaplan Jack Clark 218 441 0 23 Aug 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 167 410 0 14 Jul 2021