Contrastive Learning of Medical Visual Representations from Paired Images and Text

2 October 2020

Yuhao Zhang

Hang Jiang

Yasuhide Miura

Christopher D. Manning

C. Langlotz

MedIm

ArXiv PDF HTML

Papers citing "Contrastive Learning of Medical Visual Representations from Paired Images and Text"

31 / 131 papers shown

Title
Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation Wenliang Dai Lu Hou Lifeng Shang Xin Jiang Qun Liu Pascale Fung VLM 22 90 0 12 Mar 2022
Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance Zhuoning Yuan Yuexin Wu Zi-qi Qiu Xianzhi Du Lijun Zhang Denny Zhou Tianbao Yang 32 26 0 24 Feb 2022
GroupViT: Semantic Segmentation Emerges from Text Supervision Jiarui Xu Shalini De Mello Sifei Liu Wonmin Byeon Thomas Breuel Jan Kautz X. Wang ViT VLM 189 499 0 22 Feb 2022
A Survey on Visual Transfer Learning using Knowledge Graphs Sebastian Monka Lavdim Halilaj Achim Rettinger 19 23 0 27 Jan 2022
Contrastive and Selective Hidden Embeddings for Medical Image Segmentation Zhuowei Li Zihao Liu Zhiqiang Hu Qing Xia Ruiqin Xiong Shaoting Zhang Dimitris N. Metaxas Tingting Jiang SSL 27 8 0 21 Jan 2022
TriCoLo: Trimodal Contrastive Loss for Text to Shape Retrieval Yue Ruan Han-Hung Lee Yiming Zhang Ke Zhang Angel X. Chang 27 22 0 19 Jan 2022
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound Rowan Zellers Jiasen Lu Ximing Lu Youngjae Yu Yanpeng Zhao Mohammadreza Salehi Aditya Kusupati Jack Hessel Ali Farhadi Yejin Choi 26 207 0 07 Jan 2022
C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender System Yuanhang Zhou Kun Zhou Wayne Xin Zhao Cheng Wang Peng Jiang He Hu 25 52 0 04 Jan 2022
A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision Ajinkya Tejankar Maziar Sanjabi Bichen Wu Saining Xie Madian Khabsa Hamed Pirsiavash Hamed Firooz VLM 21 17 0 27 Dec 2021
Extending CLIP for Category-to-image Retrieval in E-commerce Mariya Hendriksen Maurits J. R. Bleeker Svitlana Vakulenko N. V. Noord E. Kuiper Maarten de Rijke VLM 11 30 0 21 Dec 2021
Joint Learning of Localized Representations from Medical Images and Reports Philipp Muller Georgios Kaissis Cong Zou Daniel Munich 132 81 0 06 Dec 2021
Overcoming the Domain Gap in Neural Action Representations Semih Günel Florian Aymanns S. Honari Pavan Ramdya Pascal Fua 22 3 0 02 Dec 2021
Sound-Guided Semantic Image Manipulation Seung Hyun Lee Wonseok Roh Wonmin Byeon Sang Ho Yoon Chanyoung Kim Jinkyu Kim Sangpil Kim DiffM 21 43 0 30 Nov 2021
LAFITE: Towards Language-Free Training for Text-to-Image Generation Yufan Zhou Ruiyi Zhang Changyou Chen Chunyuan Li Chris Tensmeyer Tong Yu Jiuxiang Gu Jinhui Xu Tong Sun VLM 21 162 0 27 Nov 2021
Deep AUC Maximization for Medical Image Classification: Challenges and Opportunities Tianbao Yang 16 3 0 01 Nov 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 23 688 0 04 Sep 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 325 2,263 0 02 Sep 2021
Challenges for machine learning in clinical translation of big data imaging studies Nicola K. Dinsdale Emma Bluemke V. Sundaresan M. Jenkinson Stephen Smith Ana I. L. Namburete AI4CE 32 41 0 07 Jul 2021
Poisoning and Backdooring Contrastive Learning Nicholas Carlini Andreas Terzis 8 156 0 17 Jun 2021
Recent advances and clinical applications of deep learning in medical image analysis Xuxin Chen Ximing Wang Kecheng Zhang K. Fung T. Thai K. Moore Robert S. Mannel Hong Liu B. Zheng Y. Qiu OOD 18 569 0 27 May 2021
Data-Efficient Language-Supervised Zero-Shot Learning with Self-Distillation Rui Cheng Bichen Wu Peizhao Zhang Peter Vajda Joseph E. Gonzalez CLIP VLM 21 31 0 18 Apr 2021
Exploring Visual Engagement Signals for Representation Learning Menglin Jia Zuxuan Wu A. Reiter Claire Cardie Serge J. Belongie Ser-Nam Lim 19 13 0 15 Apr 2021
Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classification A. Perakis A. Gorji Samriddhi Jain K. Chaitanya Simone Rizza E. Konukoglu SSL 21 33 0 30 Mar 2021
Multimodal Representation Learning via Maximization of Local Mutual Information Ruizhi Liao Daniel Moyer Miriam Cha Keegan Quigley Seth Berkowitz Steven Horng Polina Golland W. Wells SSL 11 41 0 08 Mar 2021
Predicting post-operative right ventricular failure using video-based deep learning R. Shad Nicolas Quach R. Fong P. Kasinpila C. Bowles ... Y. Woo J. Teuteberg John P. Cunningham C. Langlotz W. Hiesinger 20 40 0 28 Feb 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 98 27,632 0 26 Feb 2021
MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretation Yen Nhi Truong Vu Richard Wang N. Balachandar Can Liu A. Ng Pranav Rajpurkar 11 81 0 21 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 295 3,693 0 11 Feb 2021
Pneumonia Detection on Chest X-ray using Radiomic Features and Contrastive Learning Yan Han Chongyan Chen Ahmed H. Tewfik Ying Ding Yifan Peng LM&MA 30 39 0 12 Jan 2021
Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation Yasuhide Miura Yuhao Zhang Emily Bao Tsai C. Langlotz Dan Jurafsky MedIm 149 156 0 20 Oct 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 261 3,369 0 09 Mar 2020