SMIL: Multimodal Learning with Severely Missing Modality

9 March 2021

Papers citing "SMIL: Multimodal Learning with Severely Missing Modality"

50 / 124 papers shown

Title
Exploring Missing Modality in Multimodal Egocentric Datasets Merey Ramazanova Alejandro Pardo Humam Alwassel Bernard Ghanem EgoV 18 4 0 21 Jan 2024
Toward Robust Multimodal Learning using Multimodal Foundational Models Xianbing Zhao Soujanya Poria Xuejiao Li Yixin Chen Buzhou Tang VLM 32 2 0 20 Jan 2024
MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition Zheng Lian Licai Sun Yong Ren Hao Gu Haiyang Sun Lan Chen Bin Liu Jianhua Tao 11 12 0 07 Jan 2024
Multimodal Informative ViT: Information Aggregation and Distribution for Hyperspectral and LiDAR Classification Jiaqing Zhang Jie Lei Weiying Xie Geng Yang Daixun Li Yunsong Li 24 2 0 06 Jan 2024
Multi-modal Learning with Missing Modality in Predicting Axillary Lymph Node Metastasis Shichuan Zhang Sunyi Zheng Zhongyi Shui Honglin Li Lin Yang 13 5 0 03 Jan 2024
Modality-Collaborative Transformer with Hybrid Feature Reconstruction for Robust Emotion Recognition Chengxin Chen Pengyuan Zhang 26 5 0 26 Dec 2023
Multimodal Federated Learning with Missing Modality via Prototype Mask and Contrast Guangyin Bao Qi Zhang Duoqian Miao Zixuan Gong Liang Hu Ke Liu Yang Liu Chongyang Shi 29 7 0 21 Dec 2023
RedCore: Relative Advantage Aware Cross-modal Representation Learning for Missing Modalities with Imbalanced Missing Rates Junyang Sun Xinxin Zhang Shoukang Han Yunjie Ruan Taihao Li 25 4 0 16 Dec 2023
3FM: Multi-modal Meta-learning for Federated Tasks Minh Tran Roochi Shah Zejun Gong 16 1 0 15 Dec 2023
Segment Beyond View: Handling Partially Missing Modality for Audio-Visual Semantic Segmentation Renjie Wu Hu Wang Feras Dayoub Hsiang-Ting Chen 17 5 0 14 Dec 2023
Improving Multimodal Sentiment Analysis: Supervised Angular Margin-based Contrastive Learning for Enhanced Fusion Representation Cong-Duy Nguyen Thong Nguyen Duc Anh Vu Anh Tuan Luu 14 13 0 04 Dec 2023
Single-Model and Any-Modality for Video Object Tracking Zongwei Wu Jilai Zheng Xiangxuan Ren Florin-Alexandru Vasluianu Chao Ma D. Paudel Luc Van Gool Radu Timofte 46 33 0 27 Nov 2023
Efficient Domain Adaptation via Generative Prior for 3D Infant Pose Estimation Zhuoran Zhou Zhongyu Jiang Wenhao Chai Cheng-Yen Yang Lei Li Jenq-Neng Hwang 22 7 0 17 Nov 2023
Multimodal Representation Learning by Alternating Unimodal Adaptation Xiaohui Zhang Jaehong Yoon Mohit Bansal Huaxiu Yao 24 20 0 17 Nov 2023
Fuse It or Lose It: Deep Fusion for Multimodal Simulation-Based Inference Marvin Schmitt Stefan T. Radev Paul-Christian Burkner 40 5 0 17 Nov 2023
MOSEL: Inference Serving Using Dynamic Modality Selection Bodun Hu Le Xu Jeongyoon Moon N. Yadwadkar Aditya Akella 11 3 0 27 Oct 2023
Multimodal Variational Auto-encoder based Audio-Visual Segmentation Yuxin Mao Jing Zhang Mochu Xiang Yiran Zhong Yuchao Dai 25 33 0 12 Oct 2023
What Makes for Robust Multi-Modal Models in the Face of Missing Modalities? Siting Li Chenzhuang Du Yue Zhao Yu Huang Hang Zhao 19 4 0 10 Oct 2023
Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation Md Kaykobad Reza Ashley Prater-Bennette M. Salman Asif 16 4 0 06 Oct 2023
RegBN: Batch Normalization of Multimodal Data with Regularization Morteza Ghahremani Christian Wachinger 28 6 0 01 Oct 2023
A Survey on Image-text Multimodal Models Ruifeng Guo Jingxuan Wei Linzhuang Sun Khai Le-Duc Guiyong Chang Dawei Liu Sibo Zhang Zhengbing Yao Mingjun Xu Liping Bu VLM 21 5 0 23 Sep 2023
GAME: Generalized deep learning model towards multimodal data integration for early screening of adolescent mental disorders Zhicheng Du Chenyao Jiang Xi Yuan Shiyao Zhai Zhengyang Lei ... Chufan Xiao Qiming Huang Ming Xu Dongmei Yu Peiwu Qin 27 0 0 18 Sep 2023
Learning from Semantic Alignment between Unpaired Multiviews for Egocentric Video Recognition Qitong Wang Long Zhao Liangzhe Yuan Ting Liu Xi Peng 28 11 0 22 Aug 2023
Causal Intersectionality and Dual Form of Gradient Descent for Multimodal Analysis: a Case Study on Hateful Memes Yosuke Miyanishi M. Nguyen 24 2 0 19 Aug 2023
A Unified Framework for Modality-Agnostic Deepfakes Detection Cai Yu Peng-Wen Chen Jiahe Tian Jin Liu Jiao Dai Xi Wang Yesheng Chai Shan Jia Siwei Lyu Jizhong Han 13 0 0 26 Jul 2023
Multi-modal Learning with Missing Modality via Shared-Specific Feature Modelling Hu Wang Yuanhong Chen Congbo Ma Jodie Avery Louise Hull G. Carneiro 14 76 0 26 Jul 2023
Audio-Enhanced Text-to-Video Retrieval using Text-Conditioned Feature Alignment Sarah Ibrahimi Xiaohang Sun Pichao Wang Amanmeet Garg Ashutosh Sanan Mohamed Omar 44 12 0 24 Jul 2023
Learning Unseen Modality Interaction Yunhua Zhang Hazel Doughty Cees G. M. Snoek 14 3 0 22 Jun 2023
Enhanced Multimodal Representation Learning with Cross-modal KD Mengxi Chen Linyu Xing Yu Wang Ya-Qin Zhang 20 11 0 13 Jun 2023
Modality Influence in Multimodal Machine Learning Abdelhamid Haouhat Slimane Bellaouar A. Nehar H. Cherroun 16 1 0 10 Jun 2023
VILAS: Exploring the Effects of Vision and Language Context in Automatic Speech Recognition Ziyi Ni Minglun Han Feilong Chen Linghui Meng Jing Shi Shuang Xu Bo Xu 26 0 0 31 May 2023
FRAMM: Fair Ranking with Missing Modalities for Clinical Trial Site Selection B. Theodorou Lucas Glass Cao Xiao Jimeng Sun 22 7 0 30 May 2023
Training Transitive and Commutative Multimodal Transformers with LoReTTa Manuel Tran Yashin Dicente Cid Amal Lahiani Fabian J. Theis Tingying Peng Eldad Klaiman 13 2 0 23 May 2023
MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognition Xinyu Gong S. Mohan Naina Dhingra Jean-Charles Bazin Yilei Li Zhangyang Wang Rakesh Ranjan EgoV 54 17 0 12 May 2023
Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data Sources Suraj Rajendran Weishen Pan M. Sabuncu Yong Chen Jiayu Zhou Fei Wang 49 14 0 10 May 2023
Robust Multi-agent Communication via Multi-view Message Certification Lei Yuan T. Jiang Lihe Li F. Chen Zongzhang Zhang Yang Yu 25 2 0 07 May 2023
Learning Missing Modal Electronic Health Records with Unified Multi-modal Data Embedding and Modality-Aware Attention Kwanhyung Lee Soojeong Lee Sangchul Hahn Heejung Hyun E. Choi Byungeun Ahn Joohyung Lee 49 15 0 04 May 2023
Fusion for Visual-Infrared Person ReID in Real-World Surveillance Using Corrupted Multimodal Data Arthur Josi Mahdi Alehdaghi Rafael M. O. Cruz Eric Granger 16 2 0 29 Apr 2023
Towards Unified AI Drug Discovery with Multiple Knowledge Modalities Yi Luo Xing Yi Liu Kai Yang Kui Huang Massimo Hong Jiahuan Zhang Yushuai Wu Zaiqing Nie OffRL 32 4 0 17 Apr 2023
CoReFusion: Contrastive Regularized Fusion for Guided Thermal Super-Resolution Aditya Kasliwal Pratinav Seth Sriya Rallabandi Sanchit Singhal 20 10 0 03 Apr 2023
Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognition Yujin Wu Mohamed Daoudi A. Amad 23 33 0 29 Mar 2023
Are Data-driven Explanations Robust against Out-of-distribution Data? Tang Li Fengchun Qiao Mengmeng Ma Xiangkai Peng OODD OOD 28 10 0 29 Mar 2023
Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review Asim Waqas Aakash Tripathi Ravichandran Ramachandran Paul Stewart Ghulam Rasool AI4CE 32 29 0 11 Mar 2023
Multimodal Prompting with Missing Modalities for Visual Recognition Yi-Lun Lee Yi-Hsuan Tsai Wei-Chen Chiu Chen-Yu Lee VPVLM 22 91 0 06 Mar 2023
Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data Ryumei Nakada Halil Ibrahim Gulluk Zhun Deng Wenlong Ji James Y. Zou Linjun Zhang SSL VLM 37 34 0 13 Feb 2023
Enhancing Modality-Agnostic Representations via Meta-Learning for Brain Tumor Segmentation Aishik Konwer Xiaoling Hu Joseph Bae Xuanang Xu Chaoyu Chen Prateek Prasanna 24 16 0 08 Feb 2023
Generalizing Multimodal Variational Methods to Sets Jinzhao Zhou Yiqun Duan Zhihong Chen Yu-Cheng Chang Chin-Teng Lin DRL 37 0 0 19 Dec 2022
What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memes Shivam Sharma Siddhant Agarwal Tharun Suresh Preslav Nakov Md. Shad Akhtar Tanmoy Charkraborty VLM 12 18 0 01 Dec 2022
Towards Good Practices for Missing Modality Robust Action Recognition Sangmin Woo Sumin Lee Yeonju Park Muhammad Adi Nugroho Changick Kim 22 42 0 25 Nov 2022
M $^3$ Care: Learning with Missing Modalities in Multimodal Healthcare Data Chaohe Zhang Xu Chu Liantao Ma Yinghao Zhu Yasha Wang Jiangtao Wang Junfeng Zhao 15 75 0 28 Oct 2022