Pretrained Models for Multilingual Federated Learning

North American Chapter of the Association for Computational Linguistics (NAACL), 2022

6 June 2022

Papers citing "Pretrained Models for Multilingual Federated Learning"

23 / 23 papers shown

Title
Gradient Inversion Attacks on Parameter-Efficient Fine-TuningComputer Vision and Pattern Recognition (CVPR), 2025 Hasin Us Sami Swapneel Sen Amit K. Roy-Chowdhury S. Krishnamurthy Başak Güler FedML SILM 183 2 0 04 Jun 2025
Selective Aggregation for Low-Rank Adaptation in Federated LearningInternational Conference on Learning Representations (ICLR), 2024 Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 488 42 0 02 Oct 2024
A Survey for Large Language Models in BiomedicineArtificial Intelligence in Medicine (AIM), 2024 Chong Wang Mengyao Li Junjun He Zhongruo Wang Erfan Darzi ... Yi Yu Pietro Liò Tianyun Wang Yu Guang Wang Yiqing Shen LM&MA 321 0 0 29 Aug 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 248 25 0 05 Jun 2024
The Future of Large Language Model Pre-training is Federated Lorenzo Sani Alexandru Iacob Zeyu Cao Bill Marino Yan Gao ... Wanru Zhao William F. Shen Preslav Aleksandrov Xinchi Qiu Nicholas D. Lane AI4CE 414 37 0 17 May 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare Xingyu Li Lu Peng Yuping Wang Weihua Zhang AI4CE MedIm LM&MA 293 28 0 10 May 2024
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition Yuxuan Yan Qianqian Yang Shunpu Tang Zhiguo Shi 511 31 0 29 Apr 2024
Only Send What You Need: Learning to Communicate Efficiently in Federated Multilingual Machine TranslationIEEE Transactions on Audio, Speech, and Language Processing (IEEE TASLP), 2024 Yun-Wei Chu Dong-Jun Han Christopher G. Brinton 262 5 0 15 Jan 2024
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning Liam Collins Shanshan Wu Sewoong Oh K. Sim FedML 224 11 0 06 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models Zihao Lin Yan Sun Yifan Shi Xueqian Wang Lifu Huang Li Shen Dacheng Tao 220 14 0 04 Oct 2023
FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language ModelsInternational Conference on Machine Learning (ICML), 2023 Jingwei Sun Ziyue Xu Hongxu Yin Dong Yang Daguang Xu Yiran Chen Holger R. Roth VLM 231 32 0 02 Oct 2023
Fingerprint Attack: Client De-Anonymization in Federated LearningEuropean Conference on Artificial Intelligence (ECAI), 2023 Xingliang Yuan Trevor Cohn Olga Ohrimenko FedML 159 2 0 12 Sep 2023
FedYolo: Augmenting Federated Learning with Pretrained Transformers Xuechen Zhang Mingchen Li Xiangyu Chang Jiasi Chen Amit K. Roy-Chowdhury A. Suresh Samet Oymak FedML 161 10 0 10 Jul 2023
Communication Efficient Federated Learning for Multilingual Neural Machine Translation with AdapterAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yi Liu Xiaohan Bi Lei Li Sishuo Chen Wenkai Yang Xu Sun FedML 141 14 0 21 May 2023
Towards Building the Federated GPT: Federated Instruction TuningIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 Jianyi Zhang Saeed Vahidian Martin Kuo Chunyuan Li Ruiyi Zhang Tong Yu Jiuxiang Gu Guoyin Wang Yiran Chen ALM FedML 228 175 0 09 May 2023
Personalized Federated Learning via Gradient Modulation for Heterogeneous Text SummarizationIEEE International Joint Conference on Neural Network (IJCNN), 2023 Rong Pan Jianzong Wang Lingwei Kong Zhangcheng Huang Jing Xiao FedML 148 2 0 23 Apr 2023
Federated Learning Based Multilingual Emoji Prediction In Clean and Attack Scenarios Karim Gamal A. Gaber Hossam Amer FedML 252 6 0 30 Mar 2023
On the Efficacy of Differentially Private Few-shot Image Classification Marlon Tobaben Aliaksandra Shysheya J. Bronskill Andrew Paverd Shruti Tople Santiago Zanella Béguelin Richard Turner Antti Honkela 344 16 0 02 Feb 2023
When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning MethodsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Zhuo Zhang Yuanhang Yang Yong Dai Zhuang Li Zenglin Xu FedML 348 110 0 20 Dec 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated LearningInternational Conference on Learning Representations (ICLR), 2022 John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 203 92 0 14 Oct 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 172 21 0 30 Jun 2022
On the Importance and Applicability of Pre-Training for Federated LearningInternational Conference on Learning Representations (ICLR), 2022 Hong-You Chen Cheng-Hao Tu Zi-hua Li Hang Shen Wei-Lun Chao FedML 288 103 0 23 Jun 2022
Collaborative Semantic Aggregation and Calibration for Federated Domain Generalization Junkun Yuan Xu Ma Defang Chen Leilei Gan Lanfen Lin Kun Kuang FedML 344 32 0 13 Oct 2021