Title
Implicit Federated In-context Learning For Task-Specific LLM Fine-Tuning Dongcheng Li Junhan Chen Aoxiang Zhou Chunpei Li Youquan Xian Peng Liu Xianxian Li FedML 338 0 0 10 Nov 2025
Bridging Symmetry and Robustness: On the Role of Equivariance in Enhancing Adversarial Robustness Longwei Wang Ifrat Ikhtear Uddin KC Santosh Chaowei Zhang Xiao Qin Yang Zhou AAML 243 2 0 17 Oct 2025
FedPOB: Sample-Efficient Federated Prompt Optimization via Bandits Pingchen Lu Zhi Hong Zhiwei Shang Zhiyong Wang Yikun Ban Yao Shu Min Zhang Shuang Qiu Zhongxiang Dai FedML 100 0 0 29 Sep 2025
FedAPT: Federated Adversarial Prompt Tuning for Vision-Language Models Kun Zhai Siheng Chen Xingjun Ma Yu Jiang VLM AAML FedML 98 0 0 03 Sep 2025
On the Evolution of Federated Post-Training Large Language Models: A Model Accessibility View Tao Guo Junxiao Wang Fushuo Huo Laizhong Cui Song Guo Jie Gui Dacheng Tao 92 0 0 22 Aug 2025
CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuning Wenqiao Zhu Ji Liu Rongjuncheng Zhang Haipang Wu Yulun Zhang OffRL LRM 187 0 0 21 Aug 2025
FedSODA: Federated Fine-tuning of LLMs via Similarity Group Pruning and Orchestrated Distillation Alignment Manning Zhu Songtao Guo Pengzhan Zhou Yansong Ning Chang Han Dewen Qiao 104 0 0 18 Aug 2025
FedDPG: An Adaptive Yet Efficient Prompt-tuning Approach in Federated Learning SettingsPacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2025 A. Shakeri Wei Zhang Amin Beheshti Weitong Chen J. Yang L. Yang FedML 121 0 0 22 Jul 2025
Scaling Decentralized Learning with FLock Zehua Cheng Rui Sun Jiahao Sun Yike Guo FedML 226 0 0 21 Jul 2025
FedOne: Query-Efficient Federated Learning for Black-box Discrete Prompt Learning Ganyu Wang Jinjie Fang Maxwell J. Ying Bin Gu Xi Chen Boyu Wang Yi Chang Charles Ling FedML 260 1 0 17 Jun 2025
FedNano: Toward Lightweight Federated Tuning for Pretrained Multimodal Large Language Models Y. Zhang Hewei Gao Haokun Chen Weiguo Li Yunpu Ma Volker Tresp 140 1 0 12 Jun 2025
SGDPO: Self-Guided Direct Preference Optimization for Language Model AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Wenqiao Zhu Ji Liu Lulu Wang Jun Wu Yulun Zhang 362 2 0 18 May 2025
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models Zheng Lin Yuxin Zhang Zhe Chen Zihan Fang Xianhao Chen Praneeth Vepakomma Wei Ni Jun Luo Yue Gao MoE 360 17 0 05 May 2025
FHBench: Towards Efficient and Personalized Federated Learning for Multimodal Healthcare Penghao Wang Qian Chen Teng Zhang Yu Zhang Wang Lu Yiqiang Chen 289 1 0 15 Apr 2025
Communication-Efficient and Personalized Federated Foundation Model Fine-Tuning via Tri-Matrix Adaptation Yongqian Li Bo Liu Sheng Huang Zhe Zhang Xiaotong Yuan Richang Hong 359 1 0 31 Mar 2025
A Survey on Federated Fine-tuning of Large Language Models Yebo Wu Chunlin Tian Jingguang Li He Sun Kahou Tam Zhanting Zhou Haicheng Liao Zhijiang Guo Li Li Chengzhong Xu FedML 467 5 0 15 Mar 2025
FedPref: Federated Learning Across Heterogeneous Multi-objective PreferencesACM Transactions on Modeling and Performance Evaluation of Computing Systems (TOMPECS), 2024 Maria Hartmann Grégoire Danoy Pascal Bouvry FedML 224 2 0 23 Jan 2025
Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures Yicheng Zhang Zhen Qin Zhaomin Wu Jian Hou Shuiguang Deng 693 7 0 28 Nov 2024
Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Sajjad Ghiasvand Yifan Yang Zhiyu Xue Mahnoosh Alizadeh Zheng Zhang Ramtin Pedarsani FedML 552 6 0 16 Oct 2024
Federated Data-Efficient Instruction Tuning for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Zhen Qin Zhaomin Wu Bingsheng He Shuiguang Deng FedML 350 3 0 14 Oct 2024
Selective Aggregation for Low-Rank Adaptation in Federated LearningInternational Conference on Learning Representations (ICLR), 2024 Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 504 42 0 02 Oct 2024
Fisher Information-based Efficient Curriculum Federated Learning with Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Ji Liu Jiaxiang Ren Ruoming Jin Zijie Zhang Yang Zhou P. Valduriez Dejing Dou FedML 265 8 0 30 Sep 2024
Federated Large Language Models: Current Progress and Future Directions Yuhang Yao Jianyi Zhang Junda Wu Chengkai Huang Yu Xia ... Ang Li L. Yao Julian McAuley Yiran Chen Carlee Joe-Wong FedML AIFin 509 20 0 24 Sep 2024
Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models Yao Shu Wenyang Hu Szu Hui Ng Bryan Kian Hsiang Low Fei Richard Yu FedML 443 2 0 10 Sep 2024
Fine-Tuning and Deploying Large Language Models Over Edges: Issues and Approaches Yanjie Dong Xiaoyi Fan Fangxin Wang Chengming Li Victor C. M. Leung Xiping Hu 226 10 0 20 Aug 2024
Efficient Federated Learning Using Dynamic Update and Adaptive Pruning with Momentum on Shared Server DataACM Transactions on Intelligent Systems and Technology (ACM TIST), 2024 Ji Liu Juncheng Jia Hong Zhang Yuhui Yun Leye Wang Yang Zhou H. Dai Dejing Dou FedML 226 12 0 11 Aug 2024
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey Guanqiao Qu Qiyuan Chen Wei Wei Zheng Lin Xianhao Chen Kaibin Huang 505 148 0 09 Jul 2024
Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series ForecastingNeural Information Processing Systems (NeurIPS), 2024 Qingxiang Liu Xu Liu Chenghao Liu Qingsong Wen Yuxuan Liang AI4TS AI4CE 253 19 0 23 May 2024
Grounding Foundation Models through Federated Transfer Learning: A General FrameworkACM Transactions on Intelligent Systems and Technology (ACM TIST), 2023 Weijing Chen Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 482 27 0 29 Nov 2023
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning Sai Praneeth Karimireddy Martin Jaggi Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 534 232 0 08 Aug 2020

Home
Papers
2310.15080
Cited By

v1v2v3 (latest)

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023

23 October 2023

ArXiv (abs)PDF HTML Github (31★)

Papers citing "Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization"

30 / 30 papers shown

Title
Implicit Federated In-context Learning For Task-Specific LLM Fine-Tuning Dongcheng Li Junhan Chen Aoxiang Zhou Chunpei Li Youquan Xian Peng Liu Xianxian Li FedML 338 0 0 10 Nov 2025
Bridging Symmetry and Robustness: On the Role of Equivariance in Enhancing Adversarial Robustness Longwei Wang Ifrat Ikhtear Uddin KC Santosh Chaowei Zhang Xiao Qin Yang Zhou AAML 243 2 0 17 Oct 2025
FedPOB: Sample-Efficient Federated Prompt Optimization via Bandits Pingchen Lu Zhi Hong Zhiwei Shang Zhiyong Wang Yikun Ban Yao Shu Min Zhang Shuang Qiu Zhongxiang Dai FedML 100 0 0 29 Sep 2025
FedAPT: Federated Adversarial Prompt Tuning for Vision-Language Models Kun Zhai Siheng Chen Xingjun Ma Yu Jiang VLM AAML FedML 98 0 0 03 Sep 2025
On the Evolution of Federated Post-Training Large Language Models: A Model Accessibility View Tao Guo Junxiao Wang Fushuo Huo Laizhong Cui Song Guo Jie Gui Dacheng Tao 92 0 0 22 Aug 2025
CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuning Wenqiao Zhu Ji Liu Rongjuncheng Zhang Haipang Wu Yulun Zhang OffRL LRM 187 0 0 21 Aug 2025
FedSODA: Federated Fine-tuning of LLMs via Similarity Group Pruning and Orchestrated Distillation Alignment Manning Zhu Songtao Guo Pengzhan Zhou Yansong Ning Chang Han Dewen Qiao 104 0 0 18 Aug 2025
FedDPG: An Adaptive Yet Efficient Prompt-tuning Approach in Federated Learning SettingsPacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2025 A. Shakeri Wei Zhang Amin Beheshti Weitong Chen J. Yang L. Yang FedML 121 0 0 22 Jul 2025
Scaling Decentralized Learning with FLock Zehua Cheng Rui Sun Jiahao Sun Yike Guo FedML 226 0 0 21 Jul 2025
FedOne: Query-Efficient Federated Learning for Black-box Discrete Prompt Learning Ganyu Wang Jinjie Fang Maxwell J. Ying Bin Gu Xi Chen Boyu Wang Yi Chang Charles Ling FedML 260 1 0 17 Jun 2025
FedNano: Toward Lightweight Federated Tuning for Pretrained Multimodal Large Language Models Y. Zhang Hewei Gao Haokun Chen Weiguo Li Yunpu Ma Volker Tresp 140 1 0 12 Jun 2025
SGDPO: Self-Guided Direct Preference Optimization for Language Model AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Wenqiao Zhu Ji Liu Lulu Wang Jun Wu Yulun Zhang 362 2 0 18 May 2025
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models Zheng Lin Yuxin Zhang Zhe Chen Zihan Fang Xianhao Chen Praneeth Vepakomma Wei Ni Jun Luo Yue Gao MoE 360 17 0 05 May 2025
FHBench: Towards Efficient and Personalized Federated Learning for Multimodal Healthcare Penghao Wang Qian Chen Teng Zhang Yu Zhang Wang Lu Yiqiang Chen 289 1 0 15 Apr 2025
Communication-Efficient and Personalized Federated Foundation Model Fine-Tuning via Tri-Matrix Adaptation Yongqian Li Bo Liu Sheng Huang Zhe Zhang Xiaotong Yuan Richang Hong 359 1 0 31 Mar 2025
A Survey on Federated Fine-tuning of Large Language Models Yebo Wu Chunlin Tian Jingguang Li He Sun Kahou Tam Zhanting Zhou Haicheng Liao Zhijiang Guo Li Li Chengzhong Xu FedML 467 5 0 15 Mar 2025
FedPref: Federated Learning Across Heterogeneous Multi-objective PreferencesACM Transactions on Modeling and Performance Evaluation of Computing Systems (TOMPECS), 2024 Maria Hartmann Grégoire Danoy Pascal Bouvry FedML 224 2 0 23 Jan 2025
Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures Yicheng Zhang Zhen Qin Zhaomin Wu Jian Hou Shuiguang Deng 693 7 0 28 Nov 2024
Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Sajjad Ghiasvand Yifan Yang Zhiyu Xue Mahnoosh Alizadeh Zheng Zhang Ramtin Pedarsani FedML 552 6 0 16 Oct 2024
Federated Data-Efficient Instruction Tuning for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Zhen Qin Zhaomin Wu Bingsheng He Shuiguang Deng FedML 350 3 0 14 Oct 2024
Selective Aggregation for Low-Rank Adaptation in Federated LearningInternational Conference on Learning Representations (ICLR), 2024 Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 504 42 0 02 Oct 2024
Fisher Information-based Efficient Curriculum Federated Learning with Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Ji Liu Jiaxiang Ren Ruoming Jin Zijie Zhang Yang Zhou P. Valduriez Dejing Dou FedML 265 8 0 30 Sep 2024
Federated Large Language Models: Current Progress and Future Directions Yuhang Yao Jianyi Zhang Junda Wu Chengkai Huang Yu Xia ... Ang Li L. Yao Julian McAuley Yiran Chen Carlee Joe-Wong FedML AIFin 509 20 0 24 Sep 2024
Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models Yao Shu Wenyang Hu Szu Hui Ng Bryan Kian Hsiang Low Fei Richard Yu FedML 443 2 0 10 Sep 2024
Fine-Tuning and Deploying Large Language Models Over Edges: Issues and Approaches Yanjie Dong Xiaoyi Fan Fangxin Wang Chengming Li Victor C. M. Leung Xiping Hu 226 10 0 20 Aug 2024
Efficient Federated Learning Using Dynamic Update and Adaptive Pruning with Momentum on Shared Server DataACM Transactions on Intelligent Systems and Technology (ACM TIST), 2024 Ji Liu Juncheng Jia Hong Zhang Yuhui Yun Leye Wang Yang Zhou H. Dai Dejing Dou FedML 226 12 0 11 Aug 2024
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey Guanqiao Qu Qiyuan Chen Wei Wei Zheng Lin Xianhao Chen Kaibin Huang 505 148 0 09 Jul 2024
Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series ForecastingNeural Information Processing Systems (NeurIPS), 2024 Qingxiang Liu Xu Liu Chenghao Liu Qingsong Wen Yuxuan Liang AI4TS AI4CE 253 19 0 23 May 2024
Grounding Foundation Models through Federated Transfer Learning: A General FrameworkACM Transactions on Intelligent Systems and Technology (ACM TIST), 2023 Weijing Chen Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 482 27 0 29 Nov 2023
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning Sai Praneeth Karimireddy Martin Jaggi Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 534 232 0 08 Aug 2020