Pre-trained Language Models in Biomedical Domain: A Systematic Survey

11 October 2021

Papers citing "Pre-trained Language Models in Biomedical Domain: A Systematic Survey"

34 / 34 papers shown

Title
Uncertainty-Aware Large Language Models for Explainable Disease Diagnosis Shuang Zhou Jiashuo Wang Zidu Xu Song Wang David Brauer ... Zaifu Zhan Yu Hou Mingquan Lin Genevieve B. Melton Rui Zhang 38 0 0 06 May 2025
Heterogeneous bimodal attention fusion for speech emotion recognition Jiachen Luo Huy Phan Lin Wang Joshua Reiss 42 0 0 09 Mar 2025
Can linguists better understand DNA? Wang Liang 79 1 0 20 Jan 2025
Libra: Leveraging Temporal Images for Biomedical Radiology Analysis Xi Zhang Zaiqiao Meng Jake Lever Edmond S. L. Ho MedIm 94 0 0 28 Nov 2024
MedINST: Meta Dataset of Biomedical Instructions Wenhan Han Meng Fang Zihan Zhang Yu Yin Zirui Song Ling-Hao Chen Mykola Pechenizkiy Qingyu Chen LM&MA 23 1 0 17 Oct 2024
Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards Haoxiang Wang Yong Lin Wei Xiong Rui Yang Shizhe Diao Shuang Qiu Han Zhao Tong Zhang 31 70 0 28 Feb 2024
Autocompletion of Chief Complaints in the Electronic Health Records using Large Language Models K. M. S. Islam A. S. Nipu Praveen Madiraju Priya Deshpande LM&MA 29 6 0 11 Jan 2024
HuatuoGPT-II, One-stage Training for Medical Adaption of LLMs Junying Chen Xidong Wang Anningzhe Gao Feng Jiang Shunian Chen ... Chuyi Kong Jianquan Li Xiang Wan Haizhou Li Benyou Wang LM&MA 24 61 0 16 Nov 2023
Extensive Evaluation of Transformer-based Architectures for Adverse Drug Events Extraction Simone Scaboro Beatrice Portelli Emmanuele Chersoni Enrico Santus Giuseppe Serra 11 8 0 08 Jun 2023
Huatuo-26M, a Large-scale Chinese Medical QA Dataset Jianquan Li Xidong Wang Xiangbo Wu Zhiyi Zhang Xiaolong Xu Jie Fu Prayag Tiwari Xiang Wan Benyou Wang LM&MA 63 40 0 02 May 2023
Applying unsupervised keyphrase methods on concepts extracted from discharge sheets Hoda Memarzadeh Nasser Ghadiri Matthias Samwald Maryam Lotfi Shahreza 29 0 0 15 Mar 2023
FactReranker: Fact-guided Reranker for Faithful Radiology Report Summarization Qianqian Xie Jiayu Zhou Yifan Peng Fei Wang HILM MedIm 34 10 0 15 Mar 2023
Matching-based Term Semantics Pre-training for Spoken Patient Query Understanding Zefa Hu Xiuyi Chen Hao Wu Minglun Han Ziyi Ni Jing Shi Shuang Xu Bo Xu 38 4 0 02 Mar 2023
Readability Controllable Biomedical Document Summarization Zheheng Luo Qianqian Xie Sophia Ananiadou 38 36 0 10 Oct 2022
Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge Zhihong Chen Guanbin Li Xiang Wan 110 65 0 15 Sep 2022
Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Training Zhihong Chen Yu Du Jinpeng Hu Yang Liu Guanbin Li Xiang Wan Tsung-Hui Chang 63 107 0 15 Sep 2022
LViT: Language meets Vision Transformer in Medical Image Segmentation Zihan Li Yunxiang Li Qingde Li Puyang Wang Dazhou Guo Le Lu D. Jin You Zhang Qingqi Hong VLM MedIm 54 128 0 29 Jun 2022
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences Yikuan Li R. M. Wehbe F. Ahmad Hanyin Wang Yuan Luo VLM MedIm 135 82 0 27 Jan 2022
Joint Learning of Localized Representations from Medical Images and Reports Philipp Muller Georgios Kaissis Cong Zou Daniel Munich 129 79 0 06 Dec 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,337 0 11 Nov 2021
Improving BERT Model Using Contrastive Learning for Biomedical Relation Extraction P. Su Yifan Peng K. Vijay-Shanker SSL 10 26 0 28 Apr 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,735 0 24 Feb 2021
BinaryBERT: Pushing the Limit of BERT Quantization Haoli Bai Wei Zhang Lu Hou Lifeng Shang Jing Jin Xin Jiang Qun Liu Michael Lyu Irwin King MQ 138 183 0 31 Dec 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 249 1,982 0 28 Jul 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 229 1,444 0 18 Mar 2020
A Survey on Contextual Embeddings Qi Liu Matt J. Kusner Phil Blunsom 206 132 0 16 Mar 2020
Clinical XLNet: Modeling Sequential Clinical Notes and Predicting Prolonged Mechanical Ventilation Kexin Huang Abhishek Singh Sitong Chen E. Moseley Chih-ying Deng Naomi George C. Lindvall 59 57 0 27 Dec 2019
PubMedQA: A Dataset for Biomedical Research Question Answering Qiao Jin Bhuwan Dhingra Zhengping Liu William W. Cohen Xinghua Lu 199 791 0 13 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 396 2,576 0 03 Sep 2019
A Survey on Bias and Fairness in Machine Learning Ninareh Mehrabi Fred Morstatter N. Saxena Kristina Lerman Aram Galstyan SyDa FaML 286 4,143 0 23 Aug 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,435 0 26 Sep 2016
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 238 13,283 0 25 Aug 2014
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 228 29,632 0 16 Jan 2013