ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2211.08025
  4. Cited By
FedTune: A Deep Dive into Efficient Federated Fine-Tuning with
  Pre-trained Transformers

FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers

15 November 2022
Jinyu Chen
Wenchao Xu
Song Guo
Junxiao Wang
Jie Zhang
Yining Qi
    FedML
ArXiv (abs)PDFHTMLGithub

Papers citing "FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers"

26 / 26 papers shown
FedReFT: Federated Representation Fine-Tuning with All-But-Me Aggregation
FedReFT: Federated Representation Fine-Tuning with All-But-Me Aggregation
Fatema Siddika
Md Anwar Hossen
J. P. Muñoz
Tanya Roosta
Anuj Sharma
Ali Jannesari
FedML
357
1
0
24 Dec 2025
Foundational Models and Federated Learning: Survey, Taxonomy, Challenges and Practical Insights
Foundational Models and Federated Learning: Survey, Taxonomy, Challenges and Practical InsightsPeerJ Computer Science (PeerJ CS), 2025
Cosmin Hatfaludi
Alex Serban
FedML
253
3
0
05 Sep 2025
Communication-Efficient Federated Learning with Adaptive Number of Participants
Communication-Efficient Federated Learning with Adaptive Number of Participants
Sergey Skorik
Vladislav Dorofeev
Gleb Molodtsov
A. Avetisyan
Dmitry Bylinkin
Daniil Medyakov
Aleksandr Beznosikov
FedML
177
0
0
19 Aug 2025
FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA
FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA
Divyansh Jhunjhunwala
Arian Raje
Madan Ravi Ganesh
Chaithanya Kumar Mummadi
Chaoqun Dong
Jiawei Zhou
Wan-Yi Lin
Gauri Joshi
Zhenzhen Li
363
1
0
01 Jun 2025
Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection
Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection
Yeshwanth Venkatesha
Souvik Kundu
Priyadarshini Panda
219
1
0
31 May 2025
FedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization
FedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization
Haoyang Li
Zesheng Zhou
Zhenbiao Cao
Xiaochen Li
Wei Chen
Xinsong Zhang
FedML
564
0
0
05 May 2025
Rate-My-LoRA: Efficient and Adaptive Federated Model Tuning for Cardiac MRI Segmentation
Rate-My-LoRA: Efficient and Adaptive Federated Model Tuning for Cardiac MRI SegmentationIEEE International Symposium on Biomedical Imaging (ISBI), 2025
Xiaoxiao He
Haizhou Shi
Ligong Han
Chaowei Tan
Bo Liu
Zihao Xu
Meng Ye
L. Axel
Kang Li
Dimitris N. Metaxas
FedML
249
4
0
06 Jan 2025
Federated Large Language Models: Current Progress and Future Directions
Federated Large Language Models: Current Progress and Future Directions
Yuhang Yao
Jianyi Zhang
Junda Wu
Chengkai Huang
Yu Xia
...
Ang Li
L. Yao
Julian McAuley
Yiran Chen
Carlee Joe-Wong
FedMLAIFin
591
27
0
24 Sep 2024
SFPrompt: Communication-Efficient Split Federated Fine-Tuning for Large
  Pre-Trained Models over Resource-Limited Devices
SFPrompt: Communication-Efficient Split Federated Fine-Tuning for Large Pre-Trained Models over Resource-Limited Devices
Linxiao Cao
Yifei Zhu
Wei Gong
FedML
251
8
0
24 Jul 2024
Leveraging Foundation Models for Multi-modal Federated Learning with
  Incomplete Modality
Leveraging Foundation Models for Multi-modal Federated Learning with Incomplete Modality
Liwei Che
Yuan Liu
Xinyue Liu
Fenglong Ma
271
10
0
16 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age
  of LLMs
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs
Charlie Hou
Akshat Shrivastava
Hongyuan Zhan
Rylan Conway
Trang Le
Adithya Sagar
Giulia Fanti
Daniel Lazar
350
29
0
05 Jun 2024
Accelerating Heterogeneous Federated Learning with Closed-form
  Classifiers
Accelerating Heterogeneous Federated Learning with Closed-form Classifiers
Eros Fani
Raffaello Camoriano
Barbara Caputo
Marco Ciccone
319
10
0
03 Jun 2024
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation
Jie Xu
Karthikeyan P. Saravanan
Rogier van Dalen
Haaris Mehmood
David Tuckey
Mete Ozay
847
11
0
10 May 2024
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning
  Leveraging Weight Decomposition
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition
Yuxuan Yan
Qianqian Yang
Shunpu Tang
Zhiguo Shi
652
36
0
29 Apr 2024
Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation
  Models
Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Yae Jee Cho
Luyang Liu
Zheng Xu
Aldi Fahrezi
Gauri Joshi
392
119
0
12 Jan 2024
Towards Integrated Fine-tuning and Inference when Generative AI meets
  Edge Intelligence
Towards Integrated Fine-tuning and Inference when Generative AI meets Edge Intelligence
Ning Chen
Zhipeng Cheng
Xuwei Fan
Xiaoyu Xia
Lianfen Huang
370
4
0
05 Jan 2024
Language-Guided Transformer for Federated Multi-Label Classification
Language-Guided Transformer for Federated Multi-Label ClassificationAAAI Conference on Artificial Intelligence (AAAI), 2023
I-Jieh Liu
Ci-Siang Lin
Fu-En Yang
Yu-Chiang Frank Wang
370
14
0
12 Dec 2023
Leveraging Foundation Models to Improve Lightweight Clients in Federated
  Learning
Leveraging Foundation Models to Improve Lightweight Clients in Federated Learning
Xidong Wu
Wan-Yi Lin
Devin Willmott
Filipe Condessa
Yufei Huang
Zhenzhen Li
Madan Ravi Ganesh
FedML
307
5
0
14 Nov 2023
Profit: Benchmarking Personalization and Robustness Trade-off in
  Federated Prompt Tuning
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning
Liam Collins
Shanshan Wu
Sewoong Oh
K. Sim
FedML
315
11
0
06 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models
Zihao Lin
Yan Sun
Yifan Shi
Xueqian Wang
Lifu Huang
Li Shen
Dacheng Tao
319
16
0
04 Oct 2023
FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language
  Models
FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language ModelsInternational Conference on Machine Learning (ICML), 2023
Jingwei Sun
Ziyue Xu
Hongxu Yin
Dong Yang
Daguang Xu
Yiran Chen
Holger R. Roth
VLM
294
38
0
02 Oct 2023
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal
  Heterogeneous Federated Learning
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated LearningAAAI Conference on Artificial Intelligence (AAAI), 2023
Haokun Chen
Yao Zhang
Denis Krompass
Jindong Gu
Volker Tresp
FedML
244
99
0
21 Aug 2023
On the Efficacy of Differentially Private Few-shot Image Classification
On the Efficacy of Differentially Private Few-shot Image Classification
Marlon Tobaben
Aliaksandra Shysheya
J. Bronskill
Andrew Paverd
Shruti Tople
Santiago Zanella Béguelin
Richard Turner
Antti Honkela
555
17
0
02 Feb 2023
CyclicFL: A Cyclic Model Pre-Training Approach to Efficient Federated
  Learning
CyclicFL: A Cyclic Model Pre-Training Approach to Efficient Federated Learning
Peng Zhang
Yingbo Zhou
Ming Hu
Xin Fu
Xian Wei
Xiao He
FedML
160
2
0
28 Jan 2023
When Federated Learning Meets Pre-trained Language Models'
  Parameter-Efficient Tuning Methods
When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning MethodsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Zhuo Zhang
Yuanhang Yang
Yong Dai
Zhuang Li
Zenglin Xu
FedML
510
123
0
20 Dec 2022
CLIP-Adapter: Better Vision-Language Models with Feature Adapters
CLIP-Adapter: Better Vision-Language Models with Feature AdaptersInternational Journal of Computer Vision (IJCV), 2021
Shiyang Feng
Shijie Geng
Renrui Zhang
Teli Ma
Rongyao Fang
Zelong Li
Jiaming Song
Yu Qiao
VLMCLIP
1.4K
1,599
0
09 Oct 2021
1
Page 1 of 1