ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2002.08562
  4. Cited By
Federated pretraining and fine tuning of BERT using clinical notes from
  multiple silos

Federated pretraining and fine tuning of BERT using clinical notes from multiple silos

20 February 2020
Dianbo Liu
Timothy A. Miller
    AI4MH
ArXiv (abs)PDFHTML

Papers citing "Federated pretraining and fine tuning of BERT using clinical notes from multiple silos"

19 / 19 papers shown
FedGlu: A personalized federated learning-based glucose forecasting
  algorithm for improved performance in glycemic excursion regions
FedGlu: A personalized federated learning-based glucose forecasting algorithm for improved performance in glycemic excursion regions
Darpit Dave
Kathan Vyas
Jagadish K. Jayagopal
Alfredo Garcia
M. Erraguntla
Mark Lawley
FedML
325
4
0
25 Aug 2024
An In-Depth Evaluation of Federated Learning on Biomedical Natural
  Language Processing
An In-Depth Evaluation of Federated Learning on Biomedical Natural Language ProcessingmedRxiv (medRxiv), 2023
Le Peng
Gaoxiang Luo
Sicheng Zhou
Jiandong Chen
Rui Zhang
Zi-Cheng Xu
Ju Sun
320
4
0
20 Jul 2023
FDAPT: Federated Domain-adaptive Pre-training for Language Models
FDAPT: Federated Domain-adaptive Pre-training for Language Models
Lekang Jiang
F. Svoboda
Nicholas D. Lane
FedMLAI4CE
345
5
0
12 Jul 2023
A Federated Approach for Hate Speech Detection
A Federated Approach for Hate Speech DetectionConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Jay Gala
Deep Gandhi
Jash Mehta
Zeerak Talat
193
6
0
18 Feb 2023
Contrast with Major Classifier Vectors for Federated Medical Relation
  Extraction with Heterogeneous Label Distribution
Contrast with Major Classifier Vectors for Federated Medical Relation Extraction with Heterogeneous Label Distribution
Chunhui Du
Hao He
Yaohui Jin
140
2
0
13 Jan 2023
Federated Multilingual Models for Medical Transcript Analysis
Federated Multilingual Models for Medical Transcript AnalysisACM Conference on Health, Inference, and Learning (ACM CHIL), 2022
Andre Manoel
Mirian Hipolito Garcia
Tal Baumel
Shize Su
Jialei Chen
Dan Miller
D. Karmon
Robert Sim
Dimitrios Dimitriadis
176
17
0
04 Nov 2022
Pretrained Models for Multilingual Federated Learning
Pretrained Models for Multilingual Federated LearningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022
Orion Weller
Marc Marone
Vladimir Braverman
Dawn J Lawrie
Benjamin Van Durme
VLMFedMLAI4CE
178
49
0
06 Jun 2022
Federated Split BERT for Heterogeneous Text Classification
Federated Split BERT for Heterogeneous Text ClassificationIEEE International Joint Conference on Neural Network (IJCNN), 2022
Zhengyang Li
Shijing Si
Jianzong Wang
Jing Xiao
FedML
162
25
0
26 May 2022
Recovering Private Text in Federated Learning of Language Models
Recovering Private Text in Federated Learning of Language ModelsNeural Information Processing Systems (NeurIPS), 2022
Samyak Gupta
Yangsibo Huang
Zexuan Zhong
Tianyu Gao
Kai Li
Danqi Chen
FedML
372
104
0
17 May 2022
Training Mixed-Domain Translation Models via Federated Learning
Training Mixed-Domain Translation Models via Federated LearningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022
Peyman Passban
Tanya Roosta
Rahul Gupta
Ankit R. Chadha
Clement Chung
FedMLAI4CE
302
20
0
03 May 2022
Scaling Language Model Size in Cross-Device Federated Learning
Scaling Language Model Size in Cross-Device Federated Learning
Jae Hun Ro
Theresa Breiner
Lara McConnaughey
Mingqing Chen
A. Suresh
Shankar Kumar
Rajiv Mathews
FedML
180
35
0
31 Mar 2022
BERT WEAVER: Using WEight AVERaging to enable lifelong learning for
  transformer-based models in biomedical semantic search engines
BERT WEAVER: Using WEight AVERaging to enable lifelong learning for transformer-based models in biomedical semantic search engines
Lisa Langnickel
Alexander Schulz
Barbara Hammer
Juliane Fluck
CLLMedIm
355
3
0
21 Feb 2022
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP
  Tasks
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
Rishabh Bhardwaj
Tushar Vaidya
Soujanya Poria
OTFedML
393
10
0
06 Oct 2021
Federated Learning Meets Natural Language Processing: A Survey
Federated Learning Meets Natural Language Processing: A Survey
Ming Liu
Stella Ho
Mengqi Wang
Longxiang Gao
Yuan Jin
Heng Zhang
FedML
286
87
0
27 Jul 2021
FedNLP: Benchmarking Federated Learning Methods for Natural Language
  Processing Tasks
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks
Bill Yuchen Lin
Chaoyang He
ZiHang Zeng
Hulin Wang
Yufen Huang
Christophe Dupuy
Rahul Gupta
Mahdi Soltanolkotabi
Xiang Ren
Salman Avestimehr
FedML
333
154
0
18 Apr 2021
Scaling Federated Learning for Fine-tuning of Large Language Models
Scaling Federated Learning for Fine-tuning of Large Language ModelsInternational Conference on Applications of Natural Language to Data Bases (NLDB), 2021
Agrin Hilmkil
Sebastian Callh
Matteo Barbieri
L. R. Sütfeld
Edvin Listo Zec
Olof Mogren
FedML
128
61
0
01 Feb 2021
Bidirectional Representation Learning from Transformers using Multimodal
  Electronic Health Record Data to Predict Depression
Bidirectional Representation Learning from Transformers using Multimodal Electronic Health Record Data to Predict Depression
Yiwen Meng
W. Speier
Michael K. Ong
C. Arnold
230
0
0
26 Sep 2020
Distantly Supervised Relation Extraction in Federated Settings
Distantly Supervised Relation Extraction in Federated SettingsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Dianbo Sui
Yubo Chen
Kang Liu
Jun Zhao
FedML
234
11
0
12 Aug 2020
FedML: A Research Library and Benchmark for Federated Machine Learning
FedML: A Research Library and Benchmark for Federated Machine Learning
Chaoyang He
Songze Li
Jinhyun So
Xiao Zeng
Mi Zhang
...
Yang Liu
Ramesh Raskar
Qiang Yang
M. Annavaram
Salman Avestimehr
FedML
778
683
0
27 Jul 2020
1
Page 1 of 1