Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain

6 July 2023

Papers citing "Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain"

29 / 29 papers shown

Title
Aligning Large Language Models with Healthcare Stakeholders: A Pathway to Trustworthy AI Integration Kexin Ding Mu Zhou Akshay Chaudhari Shaoting Zhang Dimitris N. Metaxas LM&MA 31 0 0 02 May 2025
Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Report Paul Kassianik Baturay Saglam Alexander Chen Blaine Nelson Anu Vellore ... Hyrum Anderson Kojin Oshiba Omar Santos Yaron Singer Amin Karbasi PILM 53 0 0 28 Apr 2025
MSPLoRA: A Multi-Scale Pyramid Low-Rank Adaptation for Efficient Model Fine-Tuning Jiancheng Zhao Xingda Yu Zhen Yang MoE 48 1 0 27 Mar 2025
ELMTEX: Fine-Tuning Large Language Models for Structured Clinical Information Extraction. A Case Study on Clinical Reports Aynur Guluzade Naguib Heiba Zeyd Boukhers Florim Hamiti Jahid Hasan Polash Yehya Mohamad Carlos A Velasco LM&MA 42 1 0 08 Feb 2025
A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine Hanguang Xiao Feizhong Zhou X. Liu Tianqi Liu Zhipeng Li Xin Liu Xiaoxuan Huang AILaw LM&MA LRM 59 17 0 31 Dec 2024
DeLLiriuM: A large language model for delirium prediction in the ICU using structured EHR Miguel Contreras Sumit Kapoor Jiaqing Zhang Andrea Davidson Yuanfang Ren Ziyuan Guan T. Ozrazgat-Baslanti Subhash Nerella A. Bihorac Parisa Rashidi 19 1 0 22 Oct 2024
RoQLlama: A Lightweight Romanian Adapted Language Model George-Andrei Dima Andrei-Marius Avram Cristian-George Crăciun Dumitru-Clementin Cercel 19 2 0 05 Oct 2024
Towards Efficient Large Language Models for Scientific Text: A Review H. To Ming Liu Guangyan Huang 35 1 0 20 Aug 2024
A Comparative Study on Patient Language across Therapeutic Domains for Effective Patient Voice Classification in Online Health Discussions Giorgos Lysandrou Roma English Owen Vanja Popovic Grant Le Brun Aryo Pradipta Gema Beatrice Alex E. Fairley 18 0 0 23 Jul 2024
A Survey on LoRA of Large Language Models Yuren Mao Yuhang Ge Yijiang Fan Wenyi Xu Yu Mi Zhonghao Hu Yunjun Gao ALM 52 22 0 08 Jul 2024
Edinburgh Clinical NLP at MEDIQA-CORR 2024: Guiding Large Language Models with Hints Aryo Pradipta Gema Chaeeun Lee Pasquale Minervini Luke Daines T. I. Simpson Beatrice Alex 21 1 0 28 May 2024
Worldwide Federated Training of Language Models Alexandru Iacob Lorenzo Sani Bill Marino Preslav Aleksandrov William F. Shen Nicholas D. Lane FedML 30 1 0 23 May 2024
MedAdapter: Efficient Test-Time Adaptation of Large Language Models towards Medical Reasoning Wenqi Shi Ran Xu Yuchen Zhuang Yue Yu Hang Wu Carl Yang M. D. Wang MedIm LM&MA 33 18 0 05 May 2024
Fusion of Domain-Adapted Vision and Language Models for Medical Visual Question Answering Cuong Nhat Ha Shima Asaadi Sanjeev Kumar Karn Oladimeji Farri Tobias Heimann Thomas Runkler 21 3 0 24 Apr 2024
Query Performance Prediction using Relevance Judgments Generated by Large Language Models Chuan Meng Negar Arabzadeh Arian Askari Mohammad Aliannejadi Maarten de Rijke LRM 19 11 0 01 Apr 2024
Edinburgh Clinical NLP at SemEval-2024 Task 2: Fine-tune your model unless you have access to GPT-4 Aryo Pradipta Gema Giwon Hong Pasquale Minervini Luke Daines Beatrice Alex 25 4 0 30 Mar 2024
JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capability Junda Wang Zhichao Yang Zonghai Yao Hong-ye Yu BDL AI4MH LRM 22 29 0 27 Feb 2024
Me LLaMA: Foundation Large Language Models for Medical Applications Qianqian Xie Qingyu Chen Aokun Chen C.A.I. Peng Yan Hu ... Huan He Lucila Ohno-Machido Yonghui Wu Hua Xu Jiang Bian LM&MA AI4MH 70 3 0 20 Feb 2024
Efficiency at Scale: Investigating the Performance of Diminutive Language Models in Clinical Tasks Niall Taylor U. Ghose Omid Rohanian Mohammadmahdi Nouriborji Andrey Kormilitzin David A. Clifton A. Nevado-Holgado LM&MA ALM 15 6 0 16 Feb 2024
Efficient Language Adaptive Pre-training: Extending State-of-the-Art Large Language Models for Polish Szymon Ruciñski 28 5 0 15 Feb 2024
Assertion Detection Large Language Model In-context Learning LoRA Fine-tuning Yuelyu Ji Zeshui Yu Yanshan Wang 14 0 0 31 Jan 2024
The Right Model for the Job: An Evaluation of Legal Multi-Label Classification Baselines Martina Forster Claudia Schulz Prudhvi Nokku Melicaalsadat Mirsafian Jaykumar Kasundra Stavroula Skylaki AILaw ELM 8 1 0 22 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Dequan Wang AI4CE 21 20 0 04 Jan 2024
LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition Chengsong Huang Qian Liu Bill Yuchen Lin Tianyu Pang Chao Du Min-Bin Lin MoMe 18 182 0 25 Jul 2023
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences Yikuan Li R. M. Wehbe F. Ahmad Hanyin Wang Yuan Luo VLM MedIm 135 82 0 27 Jan 2022
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 234 780 0 14 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 275 3,784 0 18 Apr 2021
Clinical XLNet: Modeling Sequential Clinical Notes and Predicting Prolonged Mechanical Ventilation Kexin Huang Abhishek Singh Sitong Chen E. Moseley Chih-ying Deng Naomi George C. Lindvall 59 57 0 27 Dec 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018