Federated pretraining and fine tuning of BERT using clinical notes from multiple silos

20 February 2020

Papers citing "Federated pretraining and fine tuning of BERT using clinical notes from multiple silos"

19 / 19 papers shown

Title
FedGlu: A personalized federated learning-based glucose forecasting algorithm for improved performance in glycemic excursion regions Darpit Dave Kathan Vyas Jagadish K. Jayagopal Alfredo Garcia M. Erraguntla Mark Lawley FedML 23 0 0 25 Aug 2024
An In-Depth Evaluation of Federated Learning on Biomedical Natural Language Processing Le Peng Gaoxiang Luo Sicheng Zhou Jiandong Chen Rui Zhang Zi-Cheng Xu Ju Sun 15 2 0 20 Jul 2023
FDAPT: Federated Domain-adaptive Pre-training for Language Models Lekang Jiang F. Svoboda Nicholas D. Lane FedML AI4CE 69 4 0 12 Jul 2023
A Federated Approach for Hate Speech Detection Jay Gala Deep Gandhi Jash Mehta Zeerak Talat 13 4 0 18 Feb 2023
Contrast with Major Classifier Vectors for Federated Medical Relation Extraction with Heterogeneous Label Distribution Chunhui Du Hao He Yaohui Jin 8 2 0 13 Jan 2023
Federated Multilingual Models for Medical Transcript Analysis Andre Manoel Mirian Hipolito Garcia Tal Baumel Shize Su Jialei Chen Dan Miller D. Karmon Robert Sim Dimitrios Dimitriadis 22 13 0 04 Nov 2022
Pretrained Models for Multilingual Federated Learning Orion Weller Marc Marone Vladimir Braverman Dawn J Lawrie Benjamin Van Durme VLM FedML AI4CE 33 42 0 06 Jun 2022
Federated Split BERT for Heterogeneous Text Classification Zhengyang Li Shijing Si Jianzong Wang Jing Xiao FedML 25 21 0 26 May 2022
Recovering Private Text in Federated Learning of Language Models Samyak Gupta Yangsibo Huang Zexuan Zhong Tianyu Gao Kai Li Danqi Chen FedML 25 74 0 17 May 2022
Training Mixed-Domain Translation Models via Federated Learning Peyman Passban Tanya Roosta Rahul Gupta Ankit R. Chadha Clement Chung FedML AI4CE 21 18 0 03 May 2022
Scaling Language Model Size in Cross-Device Federated Learning Jae Hun Ro Theresa Breiner Lara McConnaughey Mingqing Chen A. Suresh Shankar Kumar Rajiv Mathews FedML 21 24 0 31 Mar 2022
BERT WEAVER: Using WEight AVERaging to enable lifelong learning for transformer-based models in biomedical semantic search engines Lisa Langnickel Alexander Schulz Barbara Hammer Juliane Fluck CLL MedIm 14 3 0 21 Feb 2022
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks Rishabh Bhardwaj Tushar Vaidya Soujanya Poria OT FedML 57 7 0 06 Oct 2021
Federated Learning Meets Natural Language Processing: A Survey Ming Liu Stella Ho Mengqi Wang Longxiang Gao Yuan Jin Heng Zhang FedML 20 67 0 27 Jul 2021
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks Bill Yuchen Lin Chaoyang He ZiHang Zeng Hulin Wang Yufen Huang Christophe Dupuy Rahul Gupta Mahdi Soltanolkotabi Xiang Ren Salman Avestimehr FedML 19 108 0 18 Apr 2021
Scaling Federated Learning for Fine-tuning of Large Language Models Agrin Hilmkil Sebastian Callh Matteo Barbieri L. R. Sütfeld Edvin Listo Zec Olof Mogren FedML 14 47 0 01 Feb 2021
Bidirectional Representation Learning from Transformers using Multimodal Electronic Health Record Data to Predict Depression Yiwen Meng W. Speier Michael K. Ong C. Arnold 16 0 0 26 Sep 2020
Distantly Supervised Relation Extraction in Federated Settings Dianbo Sui Yubo Chen Kang Liu Jun Zhao FedML 15 10 0 12 Aug 2020
FedML: A Research Library and Benchmark for Federated Machine Learning Chaoyang He Songze Li Jinhyun So Xiao Zeng Mi Zhang ... Yang Liu Ramesh Raskar Qiang Yang M. Annavaram Salman Avestimehr FedML 168 564 0 27 Jul 2020