Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2103.04537
Cited By
v1
v2
v3
v4
v5 (latest)
Multimodal Representation Learning via Maximization of Local Mutual Information
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2021
8 March 2021
Ruizhi Liao
Daniel Moyer
Miriam Cha
Keegan Quigley
Seth Berkowitz
Steven Horng
Polina Golland
W. Wells
SSL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Multimodal Representation Learning via Maximization of Local Mutual Information"
27 / 27 papers shown
Alignment, Mining and Fusion: Representation Alignment with Hard Negative Mining and Selective Knowledge Fusion for Medical Visual Question Answering
Computer Vision and Pattern Recognition (CVPR), 2025
Yuanhao Zou
Zhaozheng Yin
MedIm
258
7
0
09 Oct 2025
AGA: An adaptive group alignment framework for structured medical cross-modal representation learning
Knowledge-Based Systems (KBS), 2025
Wei Li
Xun Gong
Jiao Li
Xiaobin Sun
AI4TS
238
0
0
31 Jul 2025
CROSSAN: Towards Efficient and Effective Adaptation of Multiple Multimodal Foundation Models for Sequential Recommendation
Junchen Fu
Yongxin Ni
J. Jose
Ioannis Arapakis
Kaiwen Zheng
You Li
Xuri Ge
420
4
0
14 Apr 2025
Anatomy-Aware Conditional Image-Text Retrieval
Meng Zheng
Jiajin Zhang
Benjamin Planche
Zhongpai Gao
Terrence Chen
Ziyan Wu
MedIm
293
0
0
10 Mar 2025
DADM: Dual Alignment of Domain and Modality for Face Anti-spoofing
Jingyi Yang
Xun Lin
Zitong Yu
Li Zhang
Xianglong Liu
Hui Li
Xiaochen Yuan
Simeng Qin
CVBM
425
2
0
01 Mar 2025
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
Sheng Zhang
Yanbo Xu
Naoto Usuyama
Hanwen Xu
J. Bagga
...
Carlo Bifulco
M. Lungren
Tristan Naumann
Sheng Wang
Hoifung Poon
LM&MA
MedIm
990
530
0
10 Jan 2025
Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions
Artificial Intelligence in Medicine (AIM), 2024
Kai Sun
Siyan Xue
F. Sun
Haoran Sun
Yu-Juan Luo
...
Xinzhou Wang
Lei Yang
Shuo Jin
Jun Yan
Jiahong Dong
AI4CE
382
32
0
03 Dec 2024
ChEX: Interactive Localization and Region Description in Chest X-rays
Philip Muller
Georgios Kaissis
Daniel Rueckert
361
18
0
24 Apr 2024
CLIP in Medical Imaging: A Comprehensive Survey
Medical Image Analysis (MIA), 2023
Zihao Zhao
Yuxiao Liu
Han Wu
Yonghao Li
Sheng Wang
L. Teng
Disheng Liu
Zhiming Cui
Qian Wang
Hongtu Zhu
CLIP
MedIm
LM&MA
VLM
663
43
0
12 Dec 2023
Medical Vision Language Pretraining: A survey
Prashant Shrestha
Sanskar Amgain
Bidur Khanal
Cristian A. Linte
Binod Bhattarai
VLM
374
30
0
11 Dec 2023
Multimodal Variational Auto-encoder based Audio-Visual Segmentation
IEEE International Conference on Computer Vision (ICCV), 2023
Yuxin Mao
Jing Zhang
Mochu Xiang
Yiran Zhong
Yuchao Dai
212
57
0
12 Oct 2023
Improving Face Recognition from Caption Supervision with Multi-Granular Contextual Feature Aggregation
Md Golam Moula Mehedi Hasan
Nasser M. Nasrabadi
CVBM
136
2
0
13 Aug 2023
A scoping review on multimodal deep learning in biomedical images and texts
Journal of Biomedical Informatics (JBI), 2023
Zhaoyi Sun
Mingquan Lin
Qingqing Zhu
Qianqian Xie
Haiwei Yang
Zhiyong Lu
Yifan Peng
355
48
0
14 Jul 2023
S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captions
Neural Information Processing Systems (NeurIPS), 2023
Sangwoo Mo
Minkyu Kim
Kyungmin Lee
Jinwoo Shin
VLM
CLIP
481
44
0
23 May 2023
Sample-Specific Debiasing for Better Image-Text Models
Machine Learning in Health Care (MLHC), 2023
Peiqi Wang
Yingcheng Liu
Ching-Yun Ko
W. Wells
Seth Berkowitz
Steven Horng
Polina Golland
SSL
MedIm
404
1
0
25 Apr 2023
Vision-Language Modelling For Radiological Imaging and Reports In The Low Data Regime
International Conference on Medical Imaging with Deep Learning (MIDL), 2023
Rhydian Windsor
A. Jamaludin
T. Kadir
Andrew Zisserman
VLM
339
16
0
30 Mar 2023
Advancing Radiograph Representation Learning with Masked Record Modeling
International Conference on Learning Representations (ICLR), 2023
Hong-Yu Zhou
Chenyu Lian
Lian-cheng Wang
Yizhou Yu
MedIm
375
94
0
30 Jan 2023
Using Multiple Instance Learning to Build Multimodal Representations
Information Processing in Medical Imaging (IPMI), 2022
Peiqi Wang
W. Wells
Seth Berkowitz
Steven Horng
Polina Golland
SSL
293
9
0
11 Dec 2022
The Role of Local Alignment and Uniformity in Image-Text Contrastive Learning on Medical Images
Philip Muller
Georgios Kaissis
Daniel Rueckert
MedIm
294
10
0
14 Nov 2022
That's the Wrong Lung! Evaluating and Improving the Interpretability of Unsupervised Multimodal Encoders for Medical Data
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Denis Jered McInerney
Geoffrey S. Young
Jan-Willem van de Meent
Byron C. Wallace
257
0
0
12 Oct 2022
RadTex: Learning Efficient Radiograph Representations from Text Reports
Keegan Quigley
Miriam Cha
Ruizhi Liao
Geeticka Chauhan
Steven Horng
Seth Berkowitz
Polina Golland
MedIm
192
3
0
05 Aug 2022
Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processing
Ahsan Adeel
Mario Franco
Mohsin Raza
K. Ahmed
345
9
0
15 Jul 2022
Making the Most of Text Semantics to Improve Biomedical Vision--Language Processing
European Conference on Computer Vision (ECCV), 2022
Benedikt Boecking
Naoto Usuyama
Shruthi Bannur
Daniel Coelho De Castro
Anton Schwaighofer
...
Tristan Naumann
A. Nori
Javier Alvarez-Valle
Hoifung Poon
Ozan Oktay
666
412
0
21 Apr 2022
FlexR: Few-shot Classification with Language Embeddings for Structured Reporting of Chest X-rays
International Conference on Medical Imaging with Deep Learning (MIDL), 2022
Matthias Keicher
Kamilia Zaripova
Tobias Czempiel
Kristina Mach
Ashkan Khakzar
Nassir Navab
MedIm
282
16
0
29 Mar 2022
Joint Learning of Localized Representations from Medical Images and Reports
European Conference on Computer Vision (ECCV), 2021
Philipp Muller
Georgios Kaissis
Cong Zou
Daniel Munich
504
119
0
06 Dec 2021
Pre-trained Language Models in Biomedical Domain: A Systematic Survey
ACM Computing Surveys (CSUR), 2021
Benyou Wang
Qianqian Xie
Jiahuan Pei
Zhihong Chen
Prayag Tiwari
Zhao Li
Jie Fu
LM&MA
AI4CE
551
225
0
11 Oct 2021
Contrastive Learning of Medical Visual Representations from Paired Images and Text
Machine Learning in Health Care (MLHC), 2020
Yuhao Zhang
Hang Jiang
Yasuhide Miura
Christopher D. Manning
C. Langlotz
MedIm
870
1,032
0
02 Oct 2020
1
Page 1 of 1
