Med-Flamingo: a Multimodal Medical Few-shot Learner

27 July 2023

Papers citing "Med-Flamingo: a Multimodal Medical Few-shot Learner"

50 / 147 papers shown

Title
ERVQA: A Dataset to Benchmark the Readiness of Large Vision Language Models in Hospital Environments Sourjyadip Ray Kushal Gupta Soumi Kundu Payal Arvind Kasat Somak Aditya Pawan Goyal 18 1 0 08 Oct 2024
RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction Yuwei Zhang Tong Xia Aaqib Saeed Cecilia Mascolo LM&MA 24 3 0 07 Oct 2024
MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integration Lai Wei Wenkai Wang Xiaoyu Shen Yu Xie Zhihao Fan Xiaojin Zhang Zhongyu Wei Wei Chen 21 4 0 06 Oct 2024
An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generation Ahmed Abdulaal Hugo Fry Nina Montaña-Brown Ayodeji Ijishakin Jack Gao Stephanie L. Hyland Daniel C. Alexander Daniel Coelho De Castro MedIm 31 7 0 04 Oct 2024
LoGra-Med: Long Context Multi-Graph Alignment for Medical Vision-Language Model Duy M. H. Nguyen N. T. Diep Trung Q. Nguyen Hoang-Bao Le Tai Nguyen ... Pengtao Xie Roger Wattenhofer James Zhou Daniel Sonntag Mathias Niepert VLM 49 1 0 03 Oct 2024
Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks Junlin Hou Sicen Liu Yequan Bie Hongmei Wang Andong Tan Luyang Luo Hao Chen XAI 20 3 0 03 Oct 2024
Mitigating Downstream Model Risks via Model Provenance Keyu Wang Abdullah Norozi Iranzad Scott Schaffter Doina Precup Jonathan Lebensold 13 1 0 03 Oct 2024
Enhancing Explainability in Multimodal Large Language Models Using Ontological Context Jihen Amara B. König-Ries Sheeba Samuel 14 1 0 27 Sep 2024
Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Review Emma Croxford Yanjun Gao Nicholas Pellegrino Karen K. Wong Graham Wills Elliot First Frank J. Liao Cherodeep Goswami Brian Patterson Majid Afshar HILM ELM LM&MA 32 1 0 26 Sep 2024
ZALM3: Zero-Shot Enhancement of Vision-Language Alignment via In-Context Information in Multi-Turn Multimodal Medical Dialogue Zhangpu Li Changhong Zou Suxue Ma Zhicheng Yang Chen Du ... Xingzhi Sun Jing Xiao Kai Zhang Mei Han Mei Han LM&MA 46 1 0 26 Sep 2024
Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE Xun Zhu Ying Hu Fanbin Mo Miao Li Ji Wu 44 8 0 26 Sep 2024
Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation Xiaohong Liu Guoxing Yang Yulin Luo Jiaji Mao Xiang Zhang Ming Gao Shanghang Zhang Jun Shen Guangyu Wang VLM LM&MA MedIm 23 1 0 24 Sep 2024
MediConfusion: Can you trust your AI radiologist? Probing the reliability of multimodal medical foundation models Mohammad Shahab Sepehri Zalan Fabian Maryam Soltanolkotabi Mahdi Soltanolkotabi MedIm 30 3 0 23 Sep 2024
ReXErr: Synthesizing Clinically Meaningful Errors in Diagnostic Radiology Reports Vishwanatha M. Rao Serena Zhang J. N. Acosta Subathra Adithan Pranav Rajpurkar MedIm 24 1 0 17 Sep 2024
From Text to Multimodality: Exploring the Evolution and Impact of Large Language Models in Medical Practice Qian Niu Keyu Chen Ming Li Pohsun Feng Ziqian Bi ... Junyu Liu Benji Peng Tianyang Wang Yunze Wang Silin Chen LM&MA 22 2 0 14 Sep 2024
Blocks as Probes: Dissecting Categorization Ability of Large Multimodal Models Bin Fu Qiyang Wan Jialin Li Ruiping Wang Xilin Chen 32 0 0 03 Sep 2024
Democratizing MLLMs in Healthcare: TinyLLaVA-Med for Efficient Healthcare Diagnostics in Resource-Constrained Settings Aya El Mir Lukelo Thadei Luoga Boyuan Chen Muhammad Abdullah Hanif Muhammad Shafique 27 2 0 02 Sep 2024
Membership Inference Attacks Against In-Context Learning Rui Wen Z. Li Michael Backes Yang Zhang 21 6 0 02 Sep 2024
OrthoDoc: Multimodal Large Language Model for Assisting Diagnosis in Computed Tomography Youzhu Jin Yichen Zhang LM&MA 36 1 0 30 Aug 2024
LLaVA-Chef: A Multi-modal Generative Model for Food Recipes Fnu Mohbat Mohammed J. Zaki 19 7 0 29 Aug 2024
Pixels to Prose: Understanding the art of Image Captioning Hrishikesh Singh Aarti Sharma Millie Pant 3DV VLM 25 0 0 28 Aug 2024
Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey Qika Lin Yifan Zhu Xin Mei Ling Huang Jingying Ma Kai He Zhen Peng Erik Cambria Mengling Feng 26 16 0 23 Aug 2024
Beyond the Hype: A dispassionate look at vision-language models in medical scenario Yang Nan Huichi Zhou Xiaodan Xing Guang Yang 46 3 0 16 Aug 2024
MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine Yunfei Xie Ce Zhou Lang Gao Juncheng Wu Xianhang Li ... Sheng Liu Lei Xing James Zou Cihang Xie Yuyin Zhou LM&MA MedIm 64 23 0 06 Aug 2024
Quality Control for Radiology Report Generation Models via Auxiliary Auditing Components Hermione Warr Yasin Ibrahim Daniel R. McGowan Konstantinos Kamnitsas 31 0 0 31 Jul 2024
The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies Feng He Tianqing Zhu Dayong Ye Bo Liu Wanlei Zhou Philip S. Yu PILM LLMAG ELM 68 22 0 28 Jul 2024
GP-VLS: A general-purpose vision language model for surgery Samuel Schmidgall Joseph Cho C. Zakka W. Hiesinger LM&MA 44 3 0 27 Jul 2024
Cost-effective Instruction Learning for Pathology Vision and Language Analysis Kaitao Chen Mianxin Liu Fang Yan Lei Ma Xiaoming Shi ... Xiaosong Wang Lifeng Zhu Zhe Wang Mu Zhou Shaoting Zhang 30 3 0 25 Jul 2024
Improving Representation of High-frequency Components for Medical Visual Foundation Models Yuetan Chu Yilan Zhang Zhongyi Han Changchun Yang Longxi Zhou Gongning Luo Chao Huang Xin Gao MedIm 24 1 0 19 Jul 2024
LiteGPT: Large Vision-Language Model for Joint Chest X-ray Localization and Classification Task Khai Le-Duc Ryan Zhang Ngoc Son Nguyen Tan-Hanh Pham Anh Dao Ba Hung Ngo Anh Totti Nguyen Truong Son-Hy MedIm LM&MA 22 3 0 16 Jul 2024
RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models Peng Xia Kangyu Zhu Haoran Li Hongtu Zhu Yun-Qing Li Gang Li Linjun Zhang Huaxiu Yao MedIm 30 26 0 06 Jul 2024
MiniGPT-Med: Large Language Model as a General Interface for Radiology Diagnosis Asma Alkhaldi Raneem Alnajim Layan Alabdullatef Rawan Alyahya Jun Chen Deyao Zhu Ahmed Z. Alsinan Mohamed Elhoseiny LM&MA MedIm 45 1 0 04 Jul 2024
MMedAgent: Learning to Use Medical Tools with Multi-modal Agent Binxu Li Tiankai Yan Yuanting Pan Zhe Xu Jie Luo Ruiyang Ji Shilong Liu Haoyu Dong Zihao Lin Yixin Wang LM&MA 31 24 0 02 Jul 2024
STLLaVA-Med: Self-Training Large Language and Vision Assistant for Medical Guohao Sun Can Qin Huazhu Fu Linwei Wang Zhiqiang Tao LM&MA 32 3 0 28 Jun 2024
HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale Junying Chen Ruyi Ouyang Anningzhe Gao Shunian Chen Guiming Hardy Chen ... Zhenyang Cai Ke Ji Guangjun Yu Xiang Wan Benyou Wang MedIm LM&MA 43 29 0 27 Jun 2024
Evaluation of Language Models in the Medical Context Under Resource-Constrained Settings Andrea Posada Daniel Rueckert Felix Meissen Philip Muller LM&MA ELM 29 0 0 24 Jun 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Bowen Jin Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 40 17 0 16 Jun 2024
Merlin: A Vision Language Foundation Model for 3D Computed Tomography Louis Blankemeier Joseph Paul Cohen Ashwin Kumar Dave Van Veen Syed Jamal Safdar Gardezi ... Andrew L. Wentland C. Langlotz Jason Hom S. Gatidis Akshay S. Chaudhari LM&MA MedIm 38 29 0 10 Jun 2024
CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models Peng Xia Ze Chen Juanxi Tian Yangrui Gong Ruibo Hou ... Jimeng Sun Zongyuan Ge Gang Li James Zou Huaxiu Yao MU VLM 58 30 0 10 Jun 2024
A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directions Lei Liu Xiaoyan Yang Junchi Lei Xiaoyang Liu Yue Shen ... Peng Wei Jinjie Gu Zhixuan Chu Zhan Qin Kui Ren LM&MA AILaw 34 14 0 06 Jun 2024
Dragonfly: Multi-Resolution Zoom Supercharges Large Visual-Language Model Kezhen Chen Rahul Thapa Rahul Chalamala Ben Athiwaratkun S. Song James Y. Zou VLM 48 5 0 03 Jun 2024
Dr-LLaVA: Visual Instruction Tuning with Symbolic Clinical Grounding Shenghuan Sun Gregory M. Goldgof Alexander Schubert Zhiqing Sun Thomas Hartvigsen A. Butte Ahmed Alaa LM&MA 27 4 0 29 May 2024
CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formats Pierre J. Chambon Jean-Benoit Delbrouck Thomas Sounack Shih-Cheng Huang Zhihong Chen Maya Varma Steven QH Truong Chu The Chuong Curtis P. Langlotz LM&MA 30 11 0 29 May 2024
BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments Yusuf Roohani Jian Vora Qian Huang Zach Steinhart Alex Marson Percy Liang J. Leskovec Percy Liang Jure Leskovec LLMAG LM&Ro 39 13 0 27 May 2024
RET-CLIP: A Retinal Image Foundation Model Pre-trained with Clinical Diagnostic Reports Jiawei Du Jia Guo Weihang Zhang Shengzhu Yang Hanruo Liu Huiqi Li Ningli Wang MedIm VLM 24 4 0 23 May 2024
ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Dataset Johannes Ruckert Louise Bloch Raphael Brüngel Ahmad Idrissi-Yaghir Henning Schafer ... A. G. S. D. Herrera Henning Müller Peter A. Horn F. Nensa Christoph M. Friedrich 29 24 0 16 May 2024
A Generalist Learner for Multifaceted Medical Image Interpretation Hong-Yu Zhou Subathra Adithan J. N. Acosta E. Topol Pranav Rajpurkar MedIm 25 23 0 13 May 2024
XAI4LLM. Let Machine Learning Models and LLMs Collaborate for Enhanced In-Context Learning in Healthcare Fatemeh Nazary Yashar Deldjoo T. D. Noia E. Sciascio LM&MA 31 1 0 10 May 2024
Almanac Copilot: Towards Autonomous Electronic Health Record Navigation C. Zakka Joseph Cho Gracia Fahed R. Shad Michael Moor ... Vishnu Ravi Oliver Aalami Roxana Daneshjou Akshay Chaudhari W. Hiesinger 19 0 0 30 Apr 2024
Simplifying Multimodality: Unimodal Approach to Multimodal Challenges in Radiology with General-Domain Large Language Model Seonhee Cho Choonghan Kim Jiho Lee Chetan Chilkunda Sujin Choi Joo Heung Yoon 39 0 0 29 Apr 2024