MedCLIP: Contrastive Learning from Unpaired Medical Images and Text

18 October 2022

Jimeng Sun

Papers citing "MedCLIP: Contrastive Learning from Unpaired Medical Images and Text"

50 / 236 papers shown

Title
LQ-Adapter: ViT-Adapter with Learnable Queries for Gallbladder Cancer Detection from Ultrasound Image Chetan Madan Mayuna Gupta Soumen Basu Pankaj Gupta Chetan Arora 78 0 0 30 Nov 2024
DoubleCCA: Improving Foundation Model Group Robustness with Random Sentence Embeddings Hong Liu Yitong Lu 68 0 0 25 Nov 2024
MulModSeg: Enhancing Unpaired Multi-Modal Medical Image Segmentation with Modality-Conditioned Text Embedding and Alternating Training Chengyin Li Hui Zhu Rafi Ibn Sultan H. Bagher-Ebadian Prashant Khanduri Chetty Indrin Kundan Thind Dongxiao Zhu MedIm 70 1 0 23 Nov 2024
TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models Xin Wang Kai-xiang Chen Jiaming Zhang Jingjing Chen Xingjun Ma AAML VPVLM VLM 83 1 0 20 Nov 2024
A Multimodal Approach Combining Structural and Cross-domain Textual Guidance for Weakly Supervised OCT Segmentation Jiaqi Yang Nitish Mehta Xiaoling Hu C. L. P. Chen Chia-Ling Tsai 59 0 0 19 Nov 2024
Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model Yiming Shi Xun Zhu Ying Hu Chenyi Guo Miao Li Ji Wu 71 1 0 19 Nov 2024
Transmission Line Defect Detection Based on UAV Patrol Images and Vision-language Pretraining Ke Zhang Zhaoye Zheng Yurong Guo Jiacun Wang Jiyuan Yang Yangjie Xiao VLM 77 0 0 18 Nov 2024
D-Cube: Exploiting Hyper-Features of Diffusion Model for Robust Medical Classification Minhee Jang Juheon Son Thanaporn Viriyasaranon Junho Kim Jang-Hwan Choi MedIm 23 0 0 17 Nov 2024
HIST-AID: Leveraging Historical Patient Reports for Enhanced Multi-Modal Automatic Diagnosis Haoxu Huang Cem M. Deniz K. Cho S. Chopra Divyam Madaan 16 1 0 16 Nov 2024
Multilingual Vision-Language Pre-training for the Remote Sensing Domain João Daniel Silva João Magalhães D. Tuia Bruno Martins CLIP VLM 30 1 0 30 Oct 2024
BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays Yang Zhou Tan Li Hui Faith Yanyu Xu Sicong Leng Xinxing Xu Yong Liu Rick Siow Mong Goh SSL VLM LM&MA MedIm 27 0 0 29 Oct 2024
A Perspective for Adapting Generalist AI to Specialized Medical AI Applications and Their Challenges Z. Wang Hanyin Wang Benjamin P. Danek Ying Li Christina Mack Hoifung Poon Y. Wang Pranav Rajpurkar J. Sun LM&MA 30 1 0 28 Oct 2024
Image-aware Evaluation of Generated Medical Reports Gefen Dawidowicz Elad Hirsch A. Tal 27 1 0 22 Oct 2024
Resource-Efficient Medical Report Generation using Large Language Models Abdullah Ameer Hamza Seong Tae Kim LM&MA MedIm 14 0 0 21 Oct 2024
Deep Generative Models Unveil Patterns in Medical Images Through Vision-Language Conditioning Xiaodan Xing Junzhi Ning Yang Nan Guang Yang MedIm 22 0 0 17 Oct 2024
Data Adaptive Few-shot Multi Label Segmentation with Foundation Model Gurunath Reddy D. Shanbhag Deepa Anand 16 0 0 13 Oct 2024
VoxelPrompt: A Vision-Language Agent for Grounded Medical Image Analysis Andrew Hoopes V. Butoi John Guttag Adrian V. Dalca MedIm LM&MA 32 1 0 10 Oct 2024
LLaVA Needs More Knowledge: Retrieval Augmented Natural Language Generation with Knowledge Graph for Explaining Thoracic Pathologies Ameer Hamza Abdullah Yong Hyun Ahn Sungyoung Lee Seong Tae Kim 16 2 0 07 Oct 2024
UlcerGPT: A Multimodal Approach Leveraging Large Language and Vision Models for Diabetic Foot Ulcer Image Transcription Reza Basiri Ali Abedi Chau Nguyen Milos R. Popovic Shehroz S. Khan LM&MA MedIm 31 1 0 02 Oct 2024
Segment as You Wish -- Free-Form Language-Based Segmentation for Medical Images Longchao Da Rui Wang Xiaojian Xu Parminder Bhatia Taha A. Kass-Hout Hua Wei Cao Xiao VLM MedIm 25 0 0 02 Oct 2024
AgriCLIP: Adapting CLIP for Agriculture and Livestock via Domain-Specialized Cross-Model Alignment Umair Nawaz Muhammad Awais Hanan Gani Muzammal Naseer Fahad Khan Salman Khan Rao Muhammad Anwer VLM CLIP 26 2 0 02 Oct 2024
Universal Medical Image Representation Learning with Compositional Decoders Kaini Wang Ling Yang Siping Zhou Guangquan Zhou Wentao Zhang Bin Cui Shuo Li SSL MedIm 28 0 0 30 Sep 2024
See Detail Say Clear: Towards Brain CT Report Generation via Pathological Clue-driven Representation Learning Chengxin Zheng Junzhong Ji Yanzhao Shi Xiaodan Zhang Liangqiong Qu 3DV MedIm 16 3 0 29 Sep 2024
MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentation Taha Koleilat Hojat Asgariandehkordi H. Rivaz Yiming Xiao MedIm VLM 33 6 0 28 Sep 2024
Multi-modal Medical Image Fusion For Non-Small Cell Lung Cancer Classification Salma Hassan Hamad Al Hammadi Ibrahim Mohammed Muhammad Haris Khan 32 0 0 27 Sep 2024
ZALM3: Zero-Shot Enhancement of Vision-Language Alignment via In-Context Information in Multi-Turn Multimodal Medical Dialogue Zhangpu Li Changhong Zou Suxue Ma Zhicheng Yang Chen Du ... Xingzhi Sun Jing Xiao Kai Zhang Mei Han Mei Han LM&MA 46 1 0 26 Sep 2024
Multi-View and Multi-Scale Alignment for Contrastive Language-Image Pre-training in Mammography Yuexi Du John Onofrey Nicha Dvornek VLM 35 0 0 26 Sep 2024
Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modification Ming Li J. Zhong Chenxin Li Liuzhuozheng Li Nie Lin Masashi Sugiyama CLIP VLM 18 2 0 25 Sep 2024
CLSP: High-Fidelity Contrastive Language-State Pre-training for Agent State Representation Fuxian Huang Qi Zhang Shaopeng Zhai Jie Wang Tianyi Zhang Haoran Zhang Ming Zhou Yu Liu Yu Qiao CLIP AI4TS 34 0 0 24 Sep 2024
ViKL: A Mammography Interpretation Framework via Multimodal Aggregation of Visual-knowledge-linguistic Features Xin Wei Yaling Tao Changde Du Gangming Zhao Yizhou Yu Jinpeng Li 26 0 0 24 Sep 2024
SEE: Semantically Aligned EEG-to-Text Translation Yitian Tao Yan Liang Luoyu Wang Yongqing Li Qing Yang Han Zhang 26 1 0 14 Sep 2024
Evaluating Pre-trained Convolutional Neural Networks and Foundation Models as Feature Extractors for Content-based Medical Image Retrieval A. Mahbod Nematollah Saeidi Sepideh Hatamikia Ramona Woitek VLM MedIm 20 1 0 14 Sep 2024
Do Vision Foundation Models Enhance Domain Generalization in Medical Image Segmentation? Kerem Cekmeceli Meva Himmetoglu G. I. Tombak A. Susmelj Ertunc Erdil E. Konukoglu MedIm 22 2 0 12 Sep 2024
Sam2Rad: A Segmentation Model for Medical Images with Learnable Prompts Assefa Seyoum Wahd B. Felfeliyan Yuyue Zhou Shrimanti Ghosh Adam McArthur Jiechen Zhang Jacob L. Jaremko A. Hareendranathan VLM MedIm 33 1 0 10 Sep 2024
MAGDA: Multi-agent guideline-driven diagnostic assistance D. Bani-Harouni Nassir Navab Matthias Keicher LM&MA 26 2 1 10 Sep 2024
Exploring Foundation Models for Synthetic Medical Imaging: A Study on Chest X-Rays and Fine-Tuning Techniques Davide Clode da Silva Marina Musse Bernardes Nathalia Giacomini Ceretta Gabriel Vaz de Souza Gabriel Fonseca Silva Rafael Heitor Bordini S. Musse MedIm LM&MA 21 0 0 06 Sep 2024
Few-shot Adaptation of Medical Vision-Language Models Fereshteh Shakeri Yunshi Huang Julio Silva-Rodríguez Houda Bahig An Tang Jose Dolz Ismail Ben Ayed VLM 31 2 0 05 Sep 2024
PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning Noor Hussein Fahad Shamshad Muzammal Naseer Karthik Nandakumar AAML 44 3 0 29 Aug 2024
Text-guided Foundation Model Adaptation for Long-Tailed Medical Image Classification Sirui Li Li Lin Yijin Huang Pujin Cheng Xiaoying Tang MedIm 32 1 0 27 Aug 2024
Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey Qika Lin Yifan Zhu Xin Mei Ling Huang Jingying Ma Kai He Zhen Peng Erik Cambria Mengling Feng 29 16 0 23 Aug 2024
XDT-CXR: Investigating Cross-Disease Transferability in Zero-Shot Binary Classification of Chest X-Rays Umaima Rahman Abhishek Basu Muhammad Uzair Khattak Aniq Ur Rahman MedIm 31 0 0 21 Aug 2024
BAPLe: Backdoor Attacks on Medical Foundational Models using Prompt Learning Asif Hanif Fahad Shamshad Muhammad Awais Muzammal Naseer F. Khan Karthik Nandakumar Salman Khan Rao Muhammad Anwer MedIm AAML 27 2 0 14 Aug 2024
Can Rule-Based Insights Enhance LLMs for Radiology Report Classification? Introducing the RadPrompt Methodology Panagiotis Fytas Anna Breger Ian Selby Simon Baker Shahab Shahipasand Anna Korhonen 18 0 0 07 Aug 2024
Prompting Medical Large Vision-Language Models to Diagnose Pathologies by Visual Question Answering Danfeng Guo Sumitaka Honji LRM 53 0 0 31 Jul 2024
CLEFT: Language-Image Contrastive Learning with Efficient Large Language Model and Prompt Fine-Tuning Yuexi Du Brian Chang Nicha Dvornek MedIm VLM 19 2 0 30 Jul 2024
Assessing Graphical Perception of Image Embedding Models using Channel Effectiveness S. Lee Minsuk Chang Seokhyeon Park Jinwook Seo 21 2 0 30 Jul 2024
MMCLIP: Cross-modal Attention Masked Modelling for Medical Language-Image Pre-Training Biao Wu Yutong Xie Zeyu Zhang Minh Hieu Phan Qi Chen Ling-Hao Chen Qi Wu LM&MA 22 0 0 28 Jul 2024
HERGen: Elevating Radiology Report Generation with Longitudinal Data Fuying Wang Shenghui Du Lequan Yu MedIm 32 5 0 21 Jul 2024
Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generation Liwen Sun James Zhao Megan Han Chenyan Xiong MedIm 35 7 0 21 Jul 2024
DiffuX2CT: Diffusion Learning to Reconstruct CT Images from Biplanar X-Rays Xuhui Liu Zhi Qiao Runkun Liu Hong Li Juan Zhang Xiantong Zhen Zhen Qian Baochang Zhang MedIm 32 2 0 18 Jul 2024