MedCLIP: Contrastive Learning from Unpaired Medical Images and Text

18 October 2022

Jimeng Sun

Papers citing "MedCLIP: Contrastive Learning from Unpaired Medical Images and Text"

50 / 236 papers shown

Title
Mask-Free Neuron Concept Annotation for Interpreting Neural Networks in Medical Domain Hyeon Bae Kim Yong Hyun Ahn Seong Tae Kim 32 1 0 16 Jul 2024
Leveraging Task-Specific Knowledge from LLM for Semi-Supervised 3D Medical Image Segmentation Suruchi Kumari Aryan Das S. K. Roy Indu Joshi Pravendra Singh 16 2 0 06 Jul 2024
A Survey on Trustworthiness in Foundation Models for Medical Image Analysis Congzhen Shi Ryan Rezai Jiaxi Yang Qi Dou Xiaoxiao Li MedIm 26 4 0 03 Jul 2024
FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Models Ruinan Jin Zikang Xu Yuan Zhong Qiongsong Yao Qi Dou S. Kevin Zhou Xiaoxiao Li VLM 19 9 0 01 Jul 2024
PathGen-1.6M: 1.6 Million Pathology Image-text Pairs Generation through Multi-agent Collaboration Yuxuan Sun Yunlong Zhang Yixuan Si Chenglu Zhu Zhongyi Shui Kai Zhang Jingxiong Li Xingheng Lyu Tao Lin Lin Yang LM&MA VLM MedIm 23 10 0 28 Jun 2024
A Refer-and-Ground Multimodal Large Language Model for Biomedicine Xiaoshuang Huang Haifeng Huang Lingdong Shen Yehui Yang Fangxin Shang Junwei Liu Jia Liu LM&MA 47 6 0 26 Jun 2024
MolFusion: Multimodal Fusion Learning for Molecular Representations via Multi-granularity Views Muzhen Cai Sendong Zhao Haochun Wang Yanrui Du Zewen Qiang Bing Qin Ting Liu 22 0 0 26 Jun 2024
X-ray Made Simple: Lay Radiology Report Generation and Robust Evaluation Kun Zhao Chenghao Xiao Chen Tang Bohao Yang Kai Ye Noura Al Moubayed Liang Zhan Chenghua Lin 37 0 0 25 Jun 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Bowen Jin Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 40 17 0 16 Jun 2024
Merlin: A Vision Language Foundation Model for 3D Computed Tomography Louis Blankemeier Joseph Paul Cohen Ashwin Kumar Dave Van Veen Syed Jamal Safdar Gardezi ... Andrew L. Wentland C. Langlotz Jason Hom S. Gatidis Akshay S. Chaudhari LM&MA MedIm 41 29 0 10 Jun 2024
Gentle-CLIP: Exploring Aligned Semantic In Low-Quality Multimodal Data With Soft Alignment Zijia Song Z. Zang Yelin Wang Guozheng Yang Jiangbin Zheng Kaicheng Yu Wanyu Chen Stan Z. Li 28 0 0 09 Jun 2024
Quality Sentinel: Estimating Label Quality and Errors in Medical Segmentation Datasets Yixiong Chen Zongwei Zhou Alan L. Yuille 22 1 0 01 Jun 2024
Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-training Jinxia Yang Bing-Huang Su Wayne Xin Zhao Ji-Rong Wen 27 2 0 30 May 2024
I Bet You Did Not Mean That: Testing Semantic Importance via Betting Jacopo Teneggi Jeremias Sulam FAtt 18 0 0 29 May 2024
Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomography Jie Liu Yixiao Zhang Kang Wang Mehmet Can Yavuz Xiaoxi Chen ... Haoliang Li Yang Yang Alan L. Yuille Yucheng Tang Zongwei Zhou MedIm VLM 33 15 0 28 May 2024
TokenUnify: Scalable Autoregressive Visual Pre-training with Mixture Token Prediction Yinda Chen Haoyuan Shi Xiaoyu Liu Te Shi Ruobing Zhang Dong Liu Zhiwei Xiong Feng Wu 34 9 0 27 May 2024
Composed Image Retrieval for Remote Sensing Bill Psomas Ioannis Kakogeorgiou Nikos Efthymiadis Giorgos Tolias Ondřej Chum Yannis Avrithis Konstantinos Karantzalos 37 4 0 24 May 2024
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis Yue Yang Mona Gandhi Yufei Wang Yifan Wu Michael S. Yao Christopher Callison-Burch James C. Gee Mark Yatskar 35 3 0 23 May 2024
Boosting Medical Image-based Cancer Detection via Text-guided Supervision from Reports Guangyu Guo Jiawen Yao Yingda Xia Tony C. W. Mok Zhilin Zheng Junwei Han Le Lu Dingwen Zhang Jian Zhou Ling Zhang 27 1 0 23 May 2024
RET-CLIP: A Retinal Image Foundation Model Pre-trained with Clinical Diagnostic Reports Jiawei Du Jia Guo Weihang Zhang Shengzhu Yang Hanruo Liu Huiqi Li Ningli Wang MedIm VLM 24 4 0 23 May 2024
Mammo-CLIP: A Vision Language Foundation Model to Enhance Data Efficiency and Robustness in Mammography Shantanu Ghosh Clare B. Poynton Shyam Visweswaran Kayhan Batmanghelich VLM 26 6 0 20 May 2024
Transcriptomics-guided Slide Representation Learning in Computational Pathology Guillaume Jaume Lukas Oldenburg Anurag J. Vaidya Richard J. Chen Drew F. K. Williamson Thomas Peeters Andrew H. Song Faisal Mahmood 37 21 0 19 May 2024
MediCLIP: Adapting CLIP for Few-shot Medical Image Anomaly Detection Ximiao Zhang Min Xu Dehui Qiu Ruixin Yan Ning Lang Xiuzhuang Zhou VLM MedIm 16 6 0 18 May 2024
MoVL:Exploring Fusion Strategies for the Domain-Adaptive Application of Pretrained Models in Medical Imaging Tasks Haijiang Tian Jingkun Yue Xiaohong Liu Guoxing Yang Zeyu Jiang Guangyu Wang VLM MedIm 27 0 0 13 May 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare Xingyu Li Lu Peng Yuping Wang Weihua Zhang AI4CE MedIm LM&MA 63 5 0 10 May 2024
Pseudo-Prompt Generating in Pre-trained Vision-Language Models for Multi-Label Medical Image Classification Yaoqin Ye Junjie Zhang Hongwei Shi MedIm VLM 30 0 0 10 May 2024
ChEX: Interactive Localization and Region Description in Chest X-rays Philip Muller Georgios Kaissis Daniel Rueckert 20 5 0 24 Apr 2024
CT-GLIP: 3D Grounded Language-Image Pretraining with CT Scans and Radiology Reports for Full-Body Scenarios Jingyang Lin Yingda Xia Jianpeng Zhang Ke Yan Le Lu Jiebo Luo Ling Zhang VLM LM&MA MedIm 30 3 0 23 Apr 2024
A Large-scale Medical Visual Task Adaptation Benchmark Shentong Mo Xufang Luo Yansen Wang Dongsheng Li MedIm 19 0 0 19 Apr 2024
Global Contrastive Training for Multimodal Electronic Health Records with Language Supervision Yingbo Ma Suraj Kolla Zhenhong Hu Dhruv Kaliraman Victoria Nolan ... Jeremy A. Balch Tyler J. Loftus Parisa Rashidi A. Bihorac B. Shickel AI4TS 17 1 0 10 Apr 2024
Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentation Sidra Aleem Fangyijie Wang Mayug Maniparambil Eric Arazo J. Dietlmeier Guénolé Silvestre Kathleen M. Curran Noel E. O'Connor Suzanne Little VLM MedIm 19 10 0 09 Apr 2024
Transductive Zero-Shot and Few-Shot CLIP Ségolène Martin Yunshi Huang Fereshteh Shakeri J. Pesquet Ismail Ben Ayed BDL VLM 18 13 0 08 Apr 2024
PairAug: What Can Augmented Image-Text Pairs Do for Radiology? Yutong Xie Qi Chen Sinuo Wang Minh Nguyen Nhat To Iris Lee Ee Win Khoo Kerolos Hendy Daniel Koh Yong-quan Xia Qi Wu MedIm LM&MA 20 5 0 07 Apr 2024
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models Weiwei Cao Jianpeng Zhang Yingda Xia Tony C. W. Mok Zi Li X. Ye Le Lu Jian Zheng Yuxing Tang Ling Zhang 22 1 0 07 Apr 2024
Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directions Yuting He Fuxiang Huang Xinrui Jiang Yuxiang Nie Minghao Wang Jiguang Wang Hao Chen LM&MA AI4CE 71 26 0 04 Apr 2024
Fashion Style Editing with Generative Human Prior Chaerin Kong Seungyong Lee Soohyeok Im Wonsuk Yang 36 0 0 02 Apr 2024
Memory-based Cross-modal Semantic Alignment Network for Radiology Report Generation Yitian Tao Liyan Ma Jing Yu Han Zhang MedIm 18 5 0 31 Mar 2024
Design as Desired: Utilizing Visual Question Answering for Multimodal Pre-training Tongkun Su Jun Li Xi Zhang Haibo Jin Hao Chen Qiong Wang Faqin Lv Baoliang Zhao Yin Hu 24 0 0 30 Mar 2024
Revolutionizing Disease Diagnosis with simultaneous functional PET/MR and Deeply Integrated Brain Metabolic, Hemodynamic, and Perfusion Networks Luoyu Wang Yitian Tao Qing Yang Yan Liang Siwei Liu Hongcheng Shi Dinggang Shen Han Zhang MedIm 19 0 0 29 Mar 2024
FairCLIP: Harnessing Fairness in Vision-Language Learning Yan Luo Minfei Shi Muhammad Osama Khan Muhammad Muneeb Afzal Hao Huang ... Luo Song Ava Kouhana T. Elze Yi Fang Mengyu Wang VLM 32 30 0 29 Mar 2024
Envisioning MedCLIP: A Deep Dive into Explainability for Medical Vision-Language Models Anees Ur Rehman Hashmi Dwarikanath Mahapatra Mohammad Yaqub VLM MedIm 21 2 0 27 Mar 2024
BIMCV-R: A Landmark Dataset for 3D CT Text-Image Retrieval Yinda Chen Che Liu Xiaoyu Liu Rossella Arcucci Zhiwei Xiong 53 14 0 24 Mar 2024
Hierarchical Text-to-Vision Self Supervised Alignment for Improved Histopathology Representation Learning Hasindri Watawana Kanchana Ranasinghe Tariq Mahmood Muzammal Naseer Salman Khan Fahad Shahbaz Khan SSL 30 3 0 21 Mar 2024
C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersion Hee Suk Yoon Eunseop Yoon Joshua Tian Jin Tee M. Hasegawa-Johnson Yingzhen Li C. Yoo VLM 45 23 0 21 Mar 2024
Enhancing Gait Video Analysis in Neurodegenerative Diseases by Knowledge Augmentation in Vision Language Model Diwei Wang Kun Yuan Candice Müller Frédéric Blanc N. Padoy Hyewon Seo 31 2 0 20 Mar 2024
MEDBind: Unifying Language and Multimodal Medical Data Embeddings Yuan Gao Sangwook Kim David E Austin Chris McIntosh 21 2 0 19 Mar 2024
Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images Chaoqin Huang Aofan Jiang Jinghao Feng Ya-Qin Zhang Xinchao Wang Yanfeng Wang MedIm 20 24 0 19 Mar 2024
Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning Chong Ma Hanqi Jiang Wenting Chen Yiwei Li Zihao Wu ... Dajiang Zhu Tuo Zhang Dinggang Shen Tianming Liu Xiang Li 11 0 0 19 Mar 2024
Improving Medical Multi-modal Contrastive Learning with Expert Annotations Yogesh Kumar Pekka Marttinen MedIm VLM 23 9 0 15 Mar 2024
RadCLIP: Enhancing Radiologic Image Analysis through Contrastive Language-Image Pre-training Zhixiu Lu Hailong Li Lili He VLM MedIm 19 0 0 15 Mar 2024