SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answering

18 February 2021

Xiao-Ming Wu

Papers citing "SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answering"

50 / 145 papers shown

Title
ERVQA: A Dataset to Benchmark the Readiness of Large Vision Language Models in Hospital Environments Sourjyadip Ray Kushal Gupta Soumi Kundu Payal Arvind Kasat Somak Aditya Pawan Goyal 21 1 0 08 Oct 2024
MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integration Lai Wei Wenkai Wang Xiaoyu Shen Yu Xie Zhihao Fan Xiaojin Zhang Zhongyu Wei Wei Chen 32 4 0 06 Oct 2024
LoGra-Med: Long Context Multi-Graph Alignment for Medical Vision-Language Model Duy M. H. Nguyen N. T. Diep Trung Q. Nguyen Hoang-Bao Le Tai Nguyen ... Pengtao Xie Roger Wattenhofer James Zhou Daniel Sonntag Mathias Niepert VLM 55 3 0 03 Oct 2024
Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks Junlin Hou Sicen Liu Yequan Bie Hongmei Wang Andong Tan Luyang Luo Hao Chen XAI 25 3 0 03 Oct 2024
FMBench: Benchmarking Fairness in Multimodal Large Language Models on Medical Tasks Peiran Wu Che Liu C. L. P. Chen Jun Li Cosmin I. Bercea Rossella Arcucci 35 3 0 01 Oct 2024
ZALM3: Zero-Shot Enhancement of Vision-Language Alignment via In-Context Information in Multi-Turn Multimodal Medical Dialogue Zhangpu Li Changhong Zou Suxue Ma Zhicheng Yang Chen Du ... Xingzhi Sun Jing Xiao Kai Zhang Mei Han Mei Han LM&MA 46 1 0 26 Sep 2024
Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE Xun Zhu Ying Hu Fanbin Mo Miao Li Ji Wu 44 8 0 26 Sep 2024
Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation Xiaohong Liu Guoxing Yang Yulin Luo Jiaji Mao Xiang Zhang Ming Gao Shanghang Zhang Jun Shen Guangyu Wang VLM LM&MA MedIm 26 1 0 24 Sep 2024
Democratizing MLLMs in Healthcare: TinyLLaVA-Med for Efficient Healthcare Diagnostics in Resource-Constrained Settings Aya El Mir Lukelo Thadei Luoga Boyuan Chen Muhammad Abdullah Hanif Muhammad Shafique 40 2 0 02 Sep 2024
A Survey for Large Language Models in Biomedicine Chong Wang Mengyao Li Junjun He Zhongruo Wang Erfan Darzi ... Yi Yu Pietro Liò Tianyun Wang Yu Guang Wang Yiqing Shen LM&MA 34 9 0 29 Aug 2024
M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretation Jonggwon Park Soobum Kim Byungmu Yoon Jihun Hyun Kyoyun Choi LM&MA 25 4 0 29 Aug 2024
Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey Qika Lin Yifan Zhu Xin Mei Ling Huang Jingying Ma Kai He Zhen Peng Erik Cambria Mengling Feng 39 17 0 23 Aug 2024
FEDMEKI: A Benchmark for Scaling Medical Foundation Models via Federated Knowledge Injection Jiaqi Wang Xiaochen Wang Lingjuan Lyu Jinghui Chen Fenglong Ma 76 5 0 17 Aug 2024
FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models Xiaochen Wang Jiaqi Wang Houping Xiao J. Chen Fenglong Ma MedIm 61 7 0 17 Aug 2024
Med-PMC: Medical Personalized Multi-modal Consultation with a Proactive Ask-First-Observe-Next Paradigm Hongcheng Liu Yusheng Liao Siqv Ou Yuhao Wang Heyang Liu Yanfeng Wang Yu Wang LM&MA 17 0 0 16 Aug 2024
Beyond the Hype: A dispassionate look at vision-language models in medical scenario Yang Nan Huichi Zhou Xiaodan Xing Guang Yang 48 3 0 16 Aug 2024
MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine Yunfei Xie Ce Zhou Lang Gao Juncheng Wu Xianhang Li ... Sheng Liu Lei Xing James Zou Cihang Xie Yuyin Zhou LM&MA MedIm 74 23 0 06 Aug 2024
Prompting Medical Large Vision-Language Models to Diagnose Pathologies by Visual Question Answering Danfeng Guo Sumitaka Honji LRM 62 0 0 31 Jul 2024
LiteGPT: Large Vision-Language Model for Joint Chest X-ray Localization and Classification Task Khai Le-Duc Ryan Zhang Ngoc Son Nguyen Tan-Hanh Pham Anh Dao Ba Hung Ngo Anh Totti Nguyen Truong Son-Hy MedIm LM&MA 40 3 0 16 Jul 2024
A Survey on Trustworthiness in Foundation Models for Medical Image Analysis Congzhen Shi Ryan Rezai Jiaxi Yang Qi Dou Xiaoxiao Li MedIm 29 4 0 03 Jul 2024
HEMM: Holistic Evaluation of Multimodal Foundation Models Paul Pu Liang Akshay Goindani Talha Chafekar Leena Mathur Haofei Yu Ruslan Salakhutdinov Louis-Philippe Morency 41 10 0 03 Jul 2024
MedVH: Towards Systematic Evaluation of Hallucination for Large Vision Language Models in the Medical Context Zishan Gu Changchang Yin Fenglin Liu Ping Zhang VLM 26 3 0 03 Jul 2024
MedPix 2.0: A Comprehensive Multimodal Biomedical Data set for Advanced AI Applications Irene Siragusa Salvatore Contino Massimo La Ciura Rosario Alicata Roberto Pirrone 52 3 0 03 Jul 2024
Light-weight Fine-tuning Method for Defending Adversarial Noise in Pre-trained Medical Vision-Language Models Xu Han Linghao Jin Xuezhe Ma Xiaofeng Liu AAML 36 3 0 02 Jul 2024
D-Rax: Domain-specific Radiologic assistant leveraging multi-modal data and eXpert model predictions Hareem Nisar Syed Muhammad Anwar Zhifan Jiang Abhijeet Parida Ramon Sanchez-Jacob Vishwesh Nath Holger R. Roth M. Linguraru LM&MA 29 5 0 02 Jul 2024
MMedAgent: Learning to Use Medical Tools with Multi-modal Agent Binxu Li Tiankai Yan Yuanting Pan Zhe Xu Jie Luo Ruiyang Ji Shilong Liu Haoyu Dong Zihao Lin Yixin Wang LM&MA 36 24 0 02 Jul 2024
From Introspection to Best Practices: Principled Analysis of Demonstrations in Multimodal In-Context Learning Nan Xu Fei Wang Sheng Zhang Hoifung Poon Muhao Chen 34 6 0 01 Jul 2024
STLLaVA-Med: Self-Training Large Language and Vision Assistant for Medical Guohao Sun Can Qin Huazhu Fu Linwei Wang Zhiqiang Tao LM&MA 32 3 0 28 Jun 2024
HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale Junying Chen Ruyi Ouyang Anningzhe Gao Shunian Chen Guiming Hardy Chen ... Zhenyang Cai Ke Ji Guangjun Yu Xiang Wan Benyou Wang MedIm LM&MA 43 30 0 27 Jun 2024
Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis Lin Fan Xun Gong Cenyang Zheng Yafei Ou 20 0 0 21 Jun 2024
Biomedical Visual Instruction Tuning with Clinician Preference Alignment Hejie Cui Lingjun Mao Xin Liang Jieyu Zhang Hui Ren Quanzheng Li Xiang Li Carl Yang LM&MA 59 6 0 19 Jun 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Bowen Jin Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 44 27 0 16 Jun 2024
Detecting and Evaluating Medical Hallucinations in Large Vision Language Models Jiawei Chen Dingkang Yang Tong Wu Yue Jiang Xiaolu Hou Mingcheng Li Shunli Wang Dongling Xiao Ke Li Lihua Zhang LM&MA VLM 36 18 0 14 Jun 2024
Advancing High Resolution Vision-Language Models in Biomedicine Zekai Chen Arda Pekis Kevin Brown MedIm LM&MA 18 4 0 12 Jun 2024
CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models Peng Xia Ze Chen Juanxi Tian Yangrui Gong Ruibo Hou ... Jimeng Sun Zongyuan Ge Gang Li James Zou Huaxiu Yao MU VLM 61 31 0 10 Jun 2024
Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA Qianqi Yan Xuehai He Xiang Yue Xin Eric Wang LM&MA 28 10 0 30 May 2024
ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Dataset Johannes Ruckert Louise Bloch Raphael Brüngel Ahmad Idrissi-Yaghir Henning Schafer ... A. G. S. D. Herrera Henning Müller Peter A. Horn F. Nensa Christoph M. Friedrich 37 26 0 16 May 2024
Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Models Jiawei Chen Dingkang Yang Yue Jiang Mingcheng Li Jinjie Wei Xiaolu Hou Lihua Zhang 48 6 0 25 Apr 2024
Fusion of Domain-Adapted Vision and Language Models for Medical Visual Question Answering Cuong Nhat Ha Shima Asaadi Sanjeev Kumar Karn Oladimeji Farri Tobias Heimann Thomas Runkler 29 3 0 24 Apr 2024
MoVA: Adapting Mixture of Vision Experts to Multimodal Context Zhuofan Zong Bingqi Ma Dazhong Shen Guanglu Song Hao Shao Dongzhi Jiang Hongsheng Li Yu Liu MoE 40 40 0 19 Apr 2024
LaPA: Latent Prompt Assist Model For Medical Visual Question Answering Tiancheng Gu Kaicheng Yang Dongnan Liu Weidong Cai MedIm 31 2 0 19 Apr 2024
MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale Xiaotang Gai Chenyi Zhou Jiaxiang Liu Yang Feng Jian Wu Zuo-Qiang Liu MedIm 36 6 0 18 Apr 2024
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models Songtao Jiang Tuo Zheng Yan Zhang Yeying Jin Li Yuan Zuozhu Liu MoE 29 12 0 16 Apr 2024
Unified Multi-modal Diagnostic Framework with Reconstruction Pre-training and Heterogeneity-combat Tuning Yupei Zhang Li Pan Qiushi Yang Tan Li Zhen Chen 28 1 0 09 Apr 2024
FairCLIP: Harnessing Fairness in Vision-Language Learning Yan Luo Minfei Shi Muhammad Osama Khan Muhammad Muneeb Afzal Hao Huang ... Luo Song Ava Kouhana T. Elze Yi Fang Mengyu Wang VLM 38 30 0 29 Mar 2024
Can LLMs' Tuning Methods Work in Medical Multimodal Domain? Jiawei Chen Yue Jiang Dingkang Yang Mingcheng Li Jinjie Wei Ziyun Qian Lihua Zhang LM&MA 27 9 0 11 Mar 2024
Enhancing Generalization in Medical Visual Question Answering Tasks via Gradient-Guided Model Perturbation Gang Liu Hongyang Li Zerui He Shenjun Zhong MedIm 17 0 0 05 Mar 2024
Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review Iryna Hartsock Ghulam Rasool 40 62 0 04 Mar 2024
RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning Congyun Jin Ming Zhang Xiaowei Ma Yujiao Li Yingbo Wang ... Chenfei Chi Xiangguo Lv Fangzhou Li Wei Xue Yiran Huang LM&MA 27 2 0 19 Feb 2024
Prompt-based Personalized Federated Learning for Medical Visual Question Answering He Zhu Ren Togo Takahiro Ogawa Miki Haseyama MedIm 21 5 0 15 Feb 2024