v1v2v3 (latest)

Pretraining Federated Text Models for Next Word Prediction

11 May 2020

Papers citing "Pretraining Federated Text Models for Next Word Prediction"

22 / 22 papers shown

Title
FedSEA-LLaMA: A Secure, Efficient and Adaptive Federated Splitting Framework for Large Language Models Zishuai Zhang Hainan Zhang JiaYing Zheng Ziwei Wang Jin Dong Yongxin Tong Zhiming Zheng FedML 236 0 0 21 May 2025
Analysis of Privacy Leakage in Federated Large Language Models Minh Nhat Vu Truc D. T. Nguyen Tre' R. Jeter My T. Thai 156 9 0 02 Mar 2024
Mutual Enhancement of Large and Small Language Models with Cross-Silo Knowledge Transfer Yongheng Deng Ziqing Qiao Ju Ren Yang Liu Yaoxue Zhang 147 15 0 10 Dec 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models Zihao Lin Yan Sun Yifan Shi Xueqian Wang Lifu Huang Li Shen Dacheng Tao 172 13 0 04 Oct 2023
Project Florida: Federated Learning Made Easy Daniel Madrigal Diaz Andre Manoel Jia-Lve Chen Nalin Singal Robert Sim 101 4 0 21 Jul 2023
FedBIAD: Communication-Efficient and Accuracy-Guaranteed Federated Learning with Bayesian Inference-Based Adaptive DropoutIEEE International Parallel and Distributed Processing Symposium (IPDPS), 2023 Jingjing Xue Min Liu Sheng Sun Yuwei Wang Hui Jiang Xue Jiang 200 8 0 14 Jul 2023
Enhancing Older Adults' Gesture Typing Experience Using the T9 Keyboard on Small Touchscreen DevicesInternational Conference on Human Factors in Computing Systems (CHI), 2023 Emily Kuang Ruihuan Chen Mingming Fan 159 3 0 07 Mar 2023
On the Efficacy of Differentially Private Few-shot Image Classification Marlon Tobaben Aliaksandra Shysheya J. Bronskill Andrew Paverd Shruti Tople Santiago Zanella Béguelin Richard Turner Antti Honkela 284 15 0 02 Feb 2023
SPARTAN: Sparse Hierarchical Memory for Parameter-Efficient Transformers Ameet Deshpande Md Arafat Sultan Anthony Ferritto Ashwin Kalyan Karthik Narasimhan Avirup Sil MoE 130 1 0 29 Nov 2022
Federated Multilingual Models for Medical Transcript AnalysisACM Conference on Health, Inference, and Learning (ACM CHIL), 2022 Andre Manoel Mirian Hipolito Garcia Tal Baumel Shize Su Jialei Chen Dan Miller D. Karmon Robert Sim Dimitrios Dimitriadis 99 15 0 04 Nov 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated LearningInternational Conference on Learning Representations (ICLR), 2022 John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 171 92 0 14 Oct 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 148 21 0 30 Jun 2022
On the Importance and Applicability of Pre-Training for Federated LearningInternational Conference on Learning Representations (ICLR), 2022 Hong-You Chen Cheng-Hao Tu Zi-hua Li Hang Shen Wei-Lun Chao FedML 252 99 0 23 Jun 2022
Pretrained Models for Multilingual Federated LearningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Orion Weller Marc Marone Vladimir Braverman Dawn J Lawrie Benjamin Van Durme VLM FedML AI4CE 119 45 0 06 Jun 2022
FedAdapter: Efficient Federated Learning for Modern NLP Dongqi Cai Yaozong Wu Shangguang Wang F. Lin Mengwei Xu FedML AI4CE 136 33 0 20 May 2022
Training Mixed-Domain Translation Models via Federated LearningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Peyman Passban Tanya Roosta Rahul Gupta Ankit R. Chadha Clement Chung FedML AI4CE 159 19 0 03 May 2022
Scaling Language Model Size in Cross-Device Federated Learning Jae Hun Ro Theresa Breiner Lara McConnaughey Mingqing Chen A. Suresh Shankar Kumar Rajiv Mathews FedML 124 33 0 31 Mar 2022
Federated Named Entity Recognition Joel Mathew Dimitris Stripelis J. Ambite FedML 132 2 0 28 Mar 2022
Federated Natural Language Generation for Personalized Dialogue System Yujie Lu Chao-Wei Huang Huanli Zhan Yong Zhuang FedML 204 9 0 13 Oct 2021
Federated Learning Meets Natural Language Processing: A Survey Ming Liu Stella Ho Mengqi Wang Longxiang Gao Yuan Jin Heng Zhang FedML 98 83 0 27 Jul 2021
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks Bill Yuchen Lin Chaoyang He ZiHang Zeng Hulin Wang Yufen Huang Christophe Dupuy Rahul Gupta Mahdi Soltanolkotabi Xiang Ren Salman Avestimehr FedML 140 136 0 18 Apr 2021
One-Shot Federated Learning with Neuromorphic Processors Kenneth Stewart Yanqi Gu FedML 113 2 0 01 Nov 2020