Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction

22 May 2020

Papers citing "Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction"

50 / 63 papers shown

Title
The Multimodal Paradox: How Added and Missing Modalities Shape Bias and Performance in Multimodal AI Kishore Sampath Pratheesh Ayaazuddin Mohammad Resmi Ramachandranpillai 26 0 0 05 May 2025
Multimodal Large Language Models for Medicine: A Comprehensive Survey Jiarui Ye Hao Tang LM&MA 86 0 0 29 Apr 2025
Revisiting the MIMIC-IV Benchmark: Experiments Using Language Models for Electronic Health Records Jesus Lovon Thouria Ben-Haddi Jules Di Scala José G. Moreno L. Tamine 60 2 0 29 Apr 2025
Leveraging Machine Learning Models to Predict the Outcome of Digital Medical Triage Interviews Sofia Krylova Fabian Schmidt Vladimir Vlassov 34 0 0 16 Apr 2025
Self-Explaining Hypergraph Neural Networks for Diagnosis Prediction Leisheng Yu Yanxiao Cai Minxing Zhang Xia Hu FAtt 136 0 0 15 Feb 2025
Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Data Luoting Zhuang Stephen H. Park Steven J. Skates Ashley E. Prosper Denise R. Aberle William Hsu 117 0 0 11 Feb 2025
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Erik Cambria LM&MA AILaw 93 153 0 28 Jan 2025
Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goals Qingyang Wu Ying Xu Tingsong Xiao Yunze Xiao Yitong Li ... Yichi Zhang Shanghai Zhong Yuwei Zhang Wei Lu Yifan Yang 73 1 0 17 Jan 2025
Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRs Michael Wornow Suhana Bedi Miguel Angel Fuentes Hernandez E. Steinberg Jason Alan Fries Christopher Ré Sanmi Koyejo N. Shah 95 4 0 09 Dec 2024
Electrocardiogram-Language Model for Few-Shot Question Answering with Meta Learning Jialu Tang Tong Xia Yuan Lu Cecilia Mascolo Aaqib Saeed AI4MH 52 2 0 18 Oct 2024
DSG-KD: Knowledge Distillation from Domain-Specific to General Language Models Sangyeon Cho Jangyeong Jeon Dongjoon Lee Changhee Lee Junyeong Kim 19 1 0 23 Sep 2024
SynSUM -- Synthetic Benchmark with Structured and Unstructured Medical Records Paloma Rabaey Henri Arno Stefan Heytens Thomas Demeester 31 1 0 13 Sep 2024
CC-SAM: SAM with Cross-feature Attention and Context for Ultrasound Image Segmentation Shreyank N. Gowda David A. Clifton MedIm 31 1 0 31 Jul 2024
Nonlinear time-series embedding by monotone variational inequality Jonathan Y. Zhou Yao Xie AI4TS 36 0 0 11 Jun 2024
Enhancing Antibiotic Stewardship using a Natural Language Approach for Better Feature Representation Simon A. Lee Trevor Brokowski Jeffrey N. Chiang 29 8 0 30 May 2024
Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey Xi Fang Weijie Xu Fiona Anting Tan Jiani Zhang Ziqing Hu Yanjun Qi Scott Nickleach Diego Socolinsky Srinivasan H. Sengamedu Christos Faloutsos LMTD ALM 37 65 0 27 Feb 2024
RelayAttention for Efficient Large Language Model Serving with Long System Prompts Lei Zhu Xinjiang Wang Wayne Zhang Rynson W. H. Lau 28 4 0 22 Feb 2024
Robust Knowledge Extraction from Large Language Models using Social Choice Theory Nico Potyka Yuqicheng Zhu Yunjie He Evgeny Kharlamov Steffen Staab 24 3 0 22 Dec 2023
A Rank Stabilization Scaling Factor for Fine-Tuning with LoRA Damjan Kalajdzievski ALM 22 77 0 28 Nov 2023
Prompt Cache: Modular Attention Reuse for Low-Latency Inference In Gim Guojun Chen Seung-seob Lee Nikhil Sarda Anurag Khandelwal Lin Zhong 34 71 0 07 Nov 2023
Multi-domain improves out-of-distribution and data-limited scenarios for medical image analysis Ece Ozkan Xavier Boix OOD 22 0 0 10 Oct 2023
CPLLM: Clinical Prediction with Large Language Models Ofir Ben Shoham Nadav Rappoport LM&MA 26 24 0 20 Sep 2023
Multimodal Foundation Models For Echocardiogram Interpretation M. Christensen Milos Vukadinovic N. Yuan David Ouyang MedIm 21 7 0 29 Aug 2023
UMLS-KGI-BERT: Data-Centric Knowledge Integration in Transformers for Biomedical Entity Recognition Aidan Mannion Thierry Chevalier D. Schwab Lorraine Goeuriot MedIm 49 3 0 20 Jul 2023
Event Stream GPT: A Data Pre-processing and Modeling Library for Generative, Pre-trained Transformers over Continuous-time Sequences of Complex Events Matthew B. A. McDermott Bret A. Nestor Peniel Argaw I. Kohane AI4TS 24 21 0 20 Jun 2023
Toward Cohort Intelligence: A Universal Cohort Representation Learning Framework for Electronic Health Record Analysis Changshuo Liu Wenqiao Zhang Beng Chin Ooi J. Yip Lingze Zeng Kaiping Zheng 6 1 0 10 Apr 2023
Lay Text Summarisation Using Natural Language Processing: A Narrative Literature Review Oliver Vinzelberg M. Jenkins Gordon Morison David McMinn Z. Tieges 27 6 0 24 Mar 2023
The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRs Michael Wornow Yizhe Xu Rahul Thapa Birju S. Patel E. Steinberg Scott L. Fleming M. Pfeffer Jason Alan Fries N. Shah LM&MA 23 32 0 22 Mar 2023
Transformadores: Fundamentos teoricos y Aplicaciones J. D. L. Torre 72 0 0 18 Feb 2023
Auditing large language models: a three-layered approach Jakob Mokander Jonas Schuett Hannah Rose Kirk Luciano Floridi AILaw MLAU 39 194 0 16 Feb 2023
Cross-lingual German Biomedical Information Extraction: from Zero-shot to Human-in-the-Loop Siting Liang Mareike Hartmann Daniel Sonntag 13 3 0 24 Jan 2023
AI vs. Human -- Differentiation Analysis of Scientific Content Generation Yongqiang Ma Jiawei Liu Fan Yi Qikai Cheng Yong Huang Wei Lu Xiaozhong Liu DeLMO 4 56 0 24 Jan 2023
Foundation models in brief: A historical, socio-technical focus Johannes Schneider VLM 23 9 0 17 Dec 2022
Semantic Decomposition Improves Learning of Large Language Models on EHR Data David A. Bloore R. Gauriau Anna Decker Jacob Oppenheim 21 1 0 14 Nov 2022
AD-BERT: Using Pre-trained contextualized embeddings to Predict the Progression from Mild Cognitive Impairment to Alzheimer's Disease Chengsheng Mao Jie Xu Luke Rasmussen Yikuan Li P. Adekkanattu ... R. Vassar Guoqian Jiang Fei Wang Jyotishman Pathak Yuan Luo 6 6 0 07 Nov 2022
Dynamic Survival Transformers for Causal Inference with Electronic Health Records P. Chatha Yixin Wang Zhenke Wu Jeffrey Regier CML 28 1 0 25 Oct 2022
On the Transformation of Latent Space in Fine-Tuned NLP Models Nadir Durrani Hassan Sajjad Fahim Dalvi Firoj Alam 29 18 0 23 Oct 2022
Knowledge-Driven New Drug Recommendation Zhenbang Wu Huaxiu Yao Zhe Su David M. Liebovitz Lucas Glass James Y. Zou Chelsea Finn Jimeng Sun 18 4 0 11 Oct 2022
KG-MTT-BERT: Knowledge Graph Enhanced BERT for Multi-Type Medical Text Classification Yong He Cheng Wang Shun Zhang Na Li Zhao Li Zhenyu Zeng AI4MH 33 10 0 08 Oct 2022
A Systematic Evaluation of Node Embedding Robustness Alexandru Mara Jefrey Lijffijt Stephan Günnemann T. D. Bie AAML 11 0 0 16 Sep 2022
A Multifaceted Benchmarking of Synthetic Electronic Health Record Generation Models Chao Yan Yao Yan Zhiyu Wan Ziqi Zhang L. Omberg J. Guinney S. Mooney B. Malin SyDa 23 65 0 02 Aug 2022
Debiasing Deep Chest X-Ray Classifiers using Intra- and Post-processing Methods Ricards Marcinkevics Ece Ozkan Julia E. Vogt 14 18 0 26 Jul 2022
Unsupervised pre-training of graph transformers on patient population graphs Chantal Pellegrini Nassir Navab Anees Kazi MedIm AI4CE 42 11 0 21 Jul 2022
GERNERMED++: Transfer Learning in German Medical NLP Johann Frei Ludwig Frei-Stuber Frank Kramer MedIm 31 8 0 29 Jun 2022
Multimodal Learning with Transformers: A Survey P. Xu Xiatian Zhu David A. Clifton ViT 47 525 0 13 Jun 2022
AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury Chengsheng Mao Liang Yao Yuan Luo 13 1 0 07 May 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 16 9 0 29 Apr 2022
Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations Robert Wolfe Aylin Caliskan VLM 21 13 0 14 Mar 2022
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences Yikuan Li R. M. Wehbe F. Ahmad Hanyin Wang Yuan Luo VLM MedIm 137 84 0 27 Jan 2022
Multimodal data matters: language model pre-training over structured and unstructured electronic health records Sicen Liu Xiaolong Wang Yongshuai Hou Ge Li Hui Wang Huiqin Xu Yang Xiang Buzhou Tang 52 30 0 25 Jan 2022