FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning

1 September 2023

Jingren Zhou

Papers citing "FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning"

50 / 86 papers shown

Title
QualBench: Benchmarking Chinese LLMs with Localized Professional Qualifications for Vertical Domain Evaluation Mengze Hong Wailing Ng Di Jiang Chen Zhang ELM 55 0 0 08 May 2025
Federated Adapter on Foundation Models: An Out-Of-Distribution Approach Yiyuan Yang Guodong Long Dinesh Manocha Qinghua Lu Shanshan Ye Jing Jiang OODD 174 1 0 02 May 2025
Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Yang Liu Bingjie Yan Tianyuan Zou Jianqing Zhang Zixuan Gu ... J. Li Xiaozhou Ye Ye Ouyang Qiang Yang Yuhang Zhang ALM 155 1 0 24 Apr 2025
Efficient Federated Split Learning for Large Language Models over Communication Networks Kai Zhao Zhaohui Yang 37 0 0 20 Apr 2025
Tree-based Models for Vertical Federated Learning: A Survey Bingchen Qian Yuexiang Xie Yaliang Li Bolin Ding Jingren Zhou FedML 56 0 0 03 Apr 2025
Towards Resilient Federated Learning in CyberEdge Networks: Recent Advances and Future Trends Kai Li Zhengyang Zhang Azadeh Pourkabirian Wei Ni Falko Dressler Ozgur B. Akan 50 0 0 01 Apr 2025
Communication-Efficient and Personalized Federated Foundation Model Fine-Tuning via Tri-Matrix Adaptation Yongqian Li Bo Liu Sheng Huang Zhe Zhang Xiaotong Yuan Richang Hong 46 0 0 31 Mar 2025
A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applications Jian-Yu Guan Jian Wu J. Li Chuanqi Cheng Wei Yu Wu LM&MA 74 0 0 21 Mar 2025
FedSCA: Federated Tuning with Similarity-guided Collaborative Aggregation for Heterogeneous Medical Image Segmentation Yumin Zhang Yan Gao Haoran Duan Hanqing Guo Tejal Shah R. Ranjan Bo Wei FedML 80 0 0 19 Mar 2025
A Survey on Federated Fine-tuning of Large Language Models Yebo Wu Chunlin Tian Jingguang Li He Sun Kahou Tam Li Li Chengzhong Xu FedML 81 0 0 15 Mar 2025
FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-the-World LoRA Jieming Bian Lei Wang Letian Zhang Jie Xu 52 1 0 14 Mar 2025
PluralLLM: Pluralistic Alignment in LLMs via Federated Learning Mahmoud Srewa Tianyu Zhao Salma Elmalaki FedML 55 0 0 13 Mar 2025
FedMABench: Benchmarking Mobile Agents on Decentralized Heterogeneous User Data Wenhao Wang Zijie Yu Rui Ye Junzhe Zhang S. Chen Yanfeng Wang FedML 51 0 0 07 Mar 2025
Can Textual Gradient Work in Federated Learning? Minghui Chen Ruinan Jin Wenlong Deng Yuanyuan Chen Zhi Huang Han Yu Xiaoxiao Li FedML 86 2 0 27 Feb 2025
Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning Raghav Singhal Kaustubh Ponkshe Rohit Vartak Lav R. Varshney Praneeth Vepakomma FedML 79 0 0 24 Feb 2025
A Hybrid Swarm Intelligence Approach for Optimizing Multimodal Large Language Models Deployment in Edge-Cloud-based Federated Learning Environments Gaith Rjouba Hanae Elmekki Saidul Islam Jamal Bentahar Rachida Dssouli 38 0 0 04 Feb 2025
Decentralized Low-Rank Fine-Tuning of Large Language Models Sajjad Ghiasvand Mahnoosh Alizadeh Ramtin Pedarsani ALM 66 0 0 26 Jan 2025
The Transition from Centralized Machine Learning to Federated Learning for Mental Health in Education: A Survey of Current Methods and Future Directions Maryam Ebrahimi Rajeev Sahay Seyyedali Hosseinalipour Bita Akram 44 1 0 20 Jan 2025
Federated Learning and RAG Integration: A Scalable Approach for Medical Large Language Models Jincheol Jung Hongju Jeong Eui-Nam Huh 91 0 0 18 Dec 2024
Large Language Model Federated Learning with Blockchain and Unlearning for Cross-Organizational Collaboration Xuhan Zuo Minghao Wang Tianqing Zhu Shui Yu Wanlei Zhou MU 72 2 0 18 Dec 2024
DuetML: Human-LLM Collaborative Machine Learning Framework for Non-Expert Users Wataru Kawabe Yusuke Sugano HAI 71 0 0 28 Nov 2024
Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures Yicheng Zhang Zhen Qin Zhaomin Wu Jian Hou Shuiguang Deng 80 2 0 28 Nov 2024
Photon: Federated LLM Pre-Training Lorenzo Sani Alex Iacob Zeyu Cao Royson Lee Bill Marino ... Dongqi Cai Zexi Li Wanru Zhao Xinchi Qiu Nicholas D. Lane AI4CE 36 7 0 05 Nov 2024
Data Quality Control in Federated Instruction-tuning of Large Language Models Yaxin Du Rui Ye Fengting Yuchi W. Zhao Jingjing Qu Yunhong Wang Siheng Chen ALM FedML 51 0 0 15 Oct 2024
Federated Data-Efficient Instruction Tuning for Large Language Models Zhen Qin Zhaomin Wu Bingsheng He Shuiguang Deng FedML 35 2 0 14 Oct 2024
Randomized Asymmetric Chain of LoRA: The First Meaningful Theoretical Framework for Low-Rank Adaptation Grigory Malinovsky Umberto Michieli Hasan Hammoud Taha Ceritli Hayder Elesedy Mete Ozay Peter Richtárik AI4CE 32 2 0 10 Oct 2024
Selective Aggregation for Low-Rank Adaptation in Federated Learning Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 44 8 0 02 Oct 2024
Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models Ji Liu Jiaxiang Ren Ruoming Jin Zijie Zhang Yang Zhou P. Valduriez Dejing Dou FedML 42 1 0 30 Sep 2024
Federated Instruction Tuning of LLMs with Domain Coverage Augmentation Zezhou Wang Yaxin Du Zhuzhong Qian Yugang Jiang Zhuzhong Qian Siheng Chen FedML 137 0 0 30 Sep 2024
Federated Large Language Models: Current Progress and Future Directions Yuhang Yao Jianyi Zhang Junda Wu Chengkai Huang Yu Xia ... Ang Li Lina Yao Julian McAuley Yiran Chen Carlee Joe-Wong FedML AIFin 63 8 0 24 Sep 2024
On the Feasibility of Fully AI-automated Vishing Attacks João Figueiredo Afonso Carvalho Daniel Castro Daniel Gonçalves Nuno Santos 27 2 0 20 Sep 2024
Advances in APPFL: A Comprehensive and Extensible Federated Learning Framework Zilinghan Li Shilan He Ze Yang Minseok Ryu Kibaek Kim Ravi K. Madduri FedML 57 5 0 17 Sep 2024
Leveraging Unstructured Text Data for Federated Instruction Tuning of Large Language Models Rui Ye Rui Ge Yuchi Fengting Jingyi Chai Yanfeng Wang Siheng Chen FedML 40 1 0 11 Sep 2024
Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models Yao Shu Wenyang Hu Szu Hui Ng Bryan Kian Hsiang Low Fei Richard Yu FedML 35 0 0 10 Sep 2024
Enhancing Group Fairness in Federated Learning through Personalization Yifan Yang Ali Payani Parinaz Naghizadeh Ardabili FedML 40 0 0 27 Jul 2024
On ADMM in Heterogeneous Federated Learning: Personalization, Robustness, and Fairness Shengkun Zhu Jinshan Zeng Sheng Wang Yuan Sun Xiaodong Li Yuan Yao Zhiyong Peng 46 0 0 23 Jul 2024
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey Guanqiao Qu Qiyuan Chen Wei Wei Zheng Lin Xianhao Chen Kaibin Huang 42 43 0 09 Jul 2024
SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models Zheng Lin Xuanjie Hu Yuxin Zhang Zhe Chen Zihan Fang Xianhao Chen Ang Li Praneeth Vepakomma Yue Gao 41 31 0 01 Jul 2024
FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model Feijie Wu Zitao Li Yaliang Li Bolin Ding Jing Gao 34 41 0 25 Jun 2024
Synergizing Foundation Models and Federated Learning: A Survey Shenghui Li Fanghua Ye Meng Fang Jiaxu Zhao Yun-Hin Chan Edith C. -H. Ngai Thiemo Voigt AI4CE 57 5 0 18 Jun 2024
Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent Lin Wang Zhichao Wang Xiaoying Tang 45 1 0 17 Jun 2024
Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models Rui Ye Jingyi Chai Xiangrui Liu Yaodong Yang Yanfeng Wang Siheng Chen AAML 52 8 0 15 Jun 2024
Recent Advances in Federated Learning Driven Large Language Models: A Survey on Architecture, Performance, and Security Youyang Qu Ming Liu Tianqing Zhu Longxiang Gao Shui Yu Wanlei Zhou MU FedML 65 2 0 14 Jun 2024
Unique Security and Privacy Threats of Large Language Model: A Comprehensive Survey Shang Wang Tianqing Zhu Bo Liu Ming Ding Xu Guo Dayong Ye Wanlei Zhou Philip S. Yu PILM 67 17 0 12 Jun 2024
Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas Chengyuan Deng Yiqun Duan Xin Jin Heng Chang Yijun Tian ... Kuofeng Gao Sihong He Jun Zhuang Lu Cheng Haohan Wang AILaw 43 16 0 08 Jun 2024
FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models Rui Ye Rui Ge Xinyu Zhu Jingyi Chai Yaxin Du Yang Liu Yanfeng Wang Siheng Chen FedML 41 14 0 07 Jun 2024
Federated TrustChain: Blockchain-Enhanced LLM Training and Unlearning Xuhan Zuo Minghao Wang Tianqing Zhu Lefeng Zhang Dayong Ye Shui Yu Wanlei Zhou MU 26 4 0 06 Jun 2024
Leveraging Large Language Models for Entity Matching Qianyu Huang Tongfang Zhao 34 1 0 31 May 2024
Federated and Transfer Learning for Cancer Detection Based on Image Analysis Amine Bechar Y. Elmir Yassine Himeur Rafik Medjoudj Abbes Amira MedIm 38 4 0 30 May 2024
Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting Qingxiang Liu Xu Liu Chenghao Liu Qingsong Wen Yuxuan Liang AI4TS AI4CE 48 6 0 23 May 2024