Med-Flamingo: a Multimodal Medical Few-shot Learner

27 July 2023

Papers citing "Med-Flamingo: a Multimodal Medical Few-shot Learner"

47 / 147 papers shown

Title
RadGenome-Chest CT: A Grounded Vision-Language Dataset for Chest CT Analysis Xiaoman Zhang Chaoyi Wu Ziheng Zhao Jiayu Lei Ya-Qin Zhang Yanfeng Wang Weidi Xie 23 16 0 25 Apr 2024
Fusion of Domain-Adapted Vision and Language Models for Medical Visual Question Answering Cuong Nhat Ha Shima Asaadi Sanjeev Kumar Karn Oladimeji Farri Tobias Heimann Thomas Runkler 24 3 0 24 Apr 2024
SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models Bo Lin Yingjing Xu Xuanwen Bao Zhou Zhao Zuyong Zhang Zhouyang Wang 48 2 0 23 Apr 2024
MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale Xiaotang Gai Chenyi Zhou Jiaxiang Liu Yang Feng Jian Wu Zuo-Qiang Liu MedIm 36 6 0 18 Apr 2024
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models Songtao Jiang Tuo Zheng Yan Zhang Yeying Jin Li Yuan Zuozhu Liu MoE 24 12 0 16 Apr 2024
M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models Fan Bai Yuxin Du Tiejun Huang Max Q.-H. Meng Bo-Lu Zhao 18 33 0 31 Mar 2024
Cross-domain Multi-modal Few-shot Object Detection via Rich Text Zeyu Shangguan Daniel Seita Mohammad Rostami ObjD 39 1 0 24 Mar 2024
Improving Medical Multi-modal Contrastive Learning with Expert Annotations Yogesh Kumar Pekka Marttinen MedIm VLM 23 9 0 15 Mar 2024
Semi-Supervised Multimodal Multi-Instance Learning for Aortic Stenosis Diagnosis Zhe Huang Xiaowei Yu B. Wessler Michael C. Hughes 19 2 0 09 Mar 2024
Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B People Xidong Wang Nuo Chen Junying Chen Yan Hu Yidong Wang Xiangbo Wu Anningzhe Gao Xiang Wan Haizhou Li Benyou Wang LM&MA 30 25 0 06 Mar 2024
Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review Iryna Hartsock Ghulam Rasool 38 60 0 04 Mar 2024
RegionGPT: Towards Region Understanding Vision Language Model Qiushan Guo Shalini De Mello Hongxu Yin Wonmin Byeon Ka Chun Cheung Yizhou Yu Ping Luo Sifei Liu VLM 36 35 0 04 Mar 2024
Recent Advances, Applications, and Open Challenges in Machine Learning for Health: Reflections from Research Roundtables at ML4H 2023 Symposium Hyewon Jeong Sarah Jabbour Yuzhe Yang Rahul Thapta Hussein Mozannar ... Linying Zhang Harvineet Singh Tom Hartvigsen Helen Zhou Chinasa T. Okolo VLM AI4TS OOD 35 2 0 03 Mar 2024
Towards Building Multilingual Language Model for Medicine Pengcheng Qiu Chaoyi Wu Xiaoman Zhang Weixiong Lin Haicheng Wang Ya-Qin Zhang Yanfeng Wang Weidi Xie LM&MA ELM 25 64 0 21 Feb 2024
Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directions Akash Ghosh Arkadeep Acharya Sriparna Saha Vinija Jain Aman Chadha VLM 41 23 0 20 Feb 2024
OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM Yutao Hu Tian-Xin Li Quanfeng Lu Wenqi Shao Junjun He Yu Qiao Ping Luo ELM LM&MA 21 50 0 14 Feb 2024
Pretraining Vision-Language Model for Difference Visual Question Answering in Longitudinal Chest X-rays Yeongjae Cho Taehee Kim Heejun Shin Sungzoon Cho Dongmyung Shin 11 1 0 14 Feb 2024
Exploring scalable medical image encoders beyond text supervision Fernando Pérez-García Harshita Sharma Sam Bond-Taylor Kenza Bouzid Valentina Salvatelli ... Maria T. A. Wetscherek Noel Codella Stephanie L. Hyland Javier Alvarez-Valle Ozan Oktay LM&MA MedIm 35 9 0 19 Jan 2024
Developing ChatGPT for Biology and Medicine: A Complete Review of Biomedical Question Answering Qing Li Lei Li Yu Li LM&MA AI4MH 22 6 0 15 Jan 2024
Generalizing Visual Question Answering from Synthetic to Human-Written Questions via a Chain of QA with a Large Language Model Taehee Kim Yeongjae Cho Heejun Shin Yohan Jo Dongmyung Shin 32 3 0 12 Jan 2024
Low-resource finetuning of foundation models beats state-of-the-art in histopathology Benedikt Roth Valentin Koch S. J. Wagner Julia A. Schnabel Carsten Marr Tingying Peng MedIm 13 5 0 09 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Dequan Wang AI4CE 21 20 0 04 Jan 2024
Large-scale Long-tailed Disease Diagnosis on Radiology Images Qiaoyu Zheng Weike Zhao Chaoyi Wu Xiaoman Zhang Lisong Dai Hengyu Guan Yuehua Li Ya-Qin Zhang Yanfeng Wang Weidi Xie LM&MA MedIm 30 5 0 26 Dec 2023
A Foundational Multimodal Vision Language AI Assistant for Human Pathology Ming Y. Lu Bowen Chen Drew F. K. Williamson Richard J. Chen Kenji Ikamura ... Ivy Liang L. Le Tong Ding Anil V. Parwani Faisal Mahmood MedIm LM&MA 13 19 0 13 Dec 2023
CLIP in Medical Imaging: A Comprehensive Survey Zihao Zhao Yuxiao Liu Han Wu Yonghao Li Sheng Wang L. Teng Disheng Liu Zhiming Cui Qian Wang Dinggang Shen CLIP MedIm LM&MA VLM 21 43 0 12 Dec 2023
Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos M. S. Seyfioglu Wisdom O. Ikezogwo Fatemeh Ghezloo Ranjay Krishna Linda G. Shapiro 22 31 0 07 Dec 2023
Breast Ultrasound Report Generation using LangChain Jaeyoung Huh HyunWook Park Jong Chul Ye 11 5 0 05 Dec 2023
Dolphins: Multimodal Language Model for Driving Yingzi Ma Yulong Cao Jiachen Sun Marco Pavone Chaowei Xiao MLLM 21 49 0 01 Dec 2023
Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generation Ryutaro Tanno D. G. Barrett Andrew Sellergren Sumedh Ghaisas Sumanth Dathathri ... S. Shetty Pushmeet Kohli Po-Sen Huang Alan Karthikesalingam Ira Ktena MedIm 12 11 0 30 Nov 2023
RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance Chantal Pellegrini Ege Ozsoy Benjamin Busam Nassir Navab Matthias Keicher MedIm LM&MA 39 0 0 30 Nov 2023
From Text to Image: Exploring GPT-4Vision's Potential in Advanced Radiological Analysis across Subspecialties Felix Busch T. Han Marcus R. Makowski Daniel Truhn Keno Bressem Lisa Christine Adams MedIm LM&MA 19 1 0 24 Nov 2023
MAIRA-1: A specialised large multimodal model for radiology report generation Stephanie L. Hyland Shruthi Bannur Kenza Bouzid Daniel Coelho De Castro M. Ranjit ... Noel Codella M. Lungren Maria T. A. Wetscherek Ozan Oktay Javier Alvarez-Valle 27 45 0 22 Nov 2023
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge Hongjian Zhou Fenglin Liu Boyang Gu Xinyu Zou Jinfa Huang ... Yefeng Zheng Lei A. Clifton Zheng Li Fenglin Liu David A. Clifton LM&MA 31 102 0 09 Nov 2023
Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review Mingze Yuan Peng Bao Jiajia Yuan Yunhao Shen Zi Chen ... Jie Zhao Yang Chen Li Zhang Lin Shen Bin Dong ELM LM&MA 41 13 0 03 Nov 2023
Foundational Models in Medical Imaging: A Comprehensive Survey and Future Vision Bobby Azad Reza Azad Sania Eskandari Afshin Bozorgpour A. Kazerouni I. Rekik Dorit Merhof VLM MedIm 90 57 0 28 Oct 2023
Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcare Junling Liu Ziming Wang Qichen Ye Dading Chong Peilin Zhou Yining Hua VLM LM&MA 13 47 0 27 Oct 2023
Towards long-tailed, multi-label disease classification from chest X-ray: Overview of the CXR-LT challenge G. Holste Yiliang Zhou Song Wang Ajay Jaiswal Mingquan Lin ... Zhiyong Lu Ronald M. Summers George Shih Zhangyang Wang Yifan Peng 16 13 0 24 Oct 2023
A Comprehensive Evaluation of Large Language Models on Benchmark Biomedical Text Processing Tasks Fangshuo Liao Md Tahmid Rahman Laskar Cruz Barnum Jimmy X. Huang AI4MH LM&MA 19 67 0 06 Oct 2023
Large Language Models as Analogical Reasoners Michihiro Yasunaga Xinyun Chen Yujia Li Panupong Pasupat J. Leskovec Percy Liang Ed H. Chi Denny Zhou ReLM LRM 13 73 0 03 Oct 2023
A Survey on Image-text Multimodal Models Ruifeng Guo Jingxuan Wei Linzhuang Sun Khai Le-Duc Guiyong Chang Dawei Liu Sibo Zhang Zhengbing Yao Mingjun Xu Liping Bu VLM 21 5 0 23 Sep 2023
Tiny LVLM-eHub: Early Multimodal Experiments with Bard Wenqi Shao Yutao Hu Peng Gao Meng Lei Kaipeng Zhang ... Peng-Tao Xu Siyuan Huang Hongsheng Li Yuning Qiao Ping Luo VLM MLLM 22 2 0 07 Aug 2023
Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Data Chaoyi Wu Xiaoman Zhang Ya-Qin Zhang Yanfeng Wang Weidi Xie MedIm LM&MA 19 140 0 04 Aug 2023
ELIXR: Towards a general purpose X-ray artificial intelligence system through alignment of large language models and radiology vision encoders Shawn Xu L. Yang Christopher J. Kelly M. Sieniek Timo Kohlberger ... Shruthi Prabhakara Daniel Golden Rory Pilgrim Krish Eswaran Andrew Sellergren LM&MA MedIm 23 49 0 02 Aug 2023
A Survey on Multimodal Large Language Models Shukang Yin Chaoyou Fu Sirui Zhao Ke Li Xing Sun Tong Bill Xu Enhong Chen MLLM LRM 33 515 0 23 Jun 2023
LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation Suhyeon Lee Won Jun Kim Jinho Chang Jong Chul Ye MedIm 26 46 0 19 May 2023
PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering Xiaoman Zhang Chaoyi Wu Ziheng Zhao Weixiong Lin Ya-Qin Zhang Yanfeng Wang Weidi Xie LM&MA 24 151 0 17 May 2023
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,735 0 24 Feb 2021