Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1808.07275
Cited By
CentralNet: a Multilayer Approach for Multimodal Fusion
22 August 2018
Valentin Vielzeuf
Alexis Lechervy
S. Pateux
F. Jurie
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"CentralNet: a Multilayer Approach for Multimodal Fusion"
50 / 83 papers shown
The More, the Merrier: Contrastive Fusion for Higher-Order Multimodal Alignment
Stefanos Koutoupis
Michaela Areti Zervou
Konstantinos Kontras
M. D. Vos
Panagiotis Tsakalides
Grigorios Tsagatakis
84
0
0
26 Nov 2025
Vulnerability-Aware Robust Multimodal Adversarial Training
Junrui Zhang
Xinyu Zhao
Jie Peng
Chenjie Wang
Jianmin Ji
Tianlong Chen
AAML
128
0
0
22 Nov 2025
Mitigating Modality Imbalance in Multi-modal Learning via Multi-objective Optimization
Heshan Devaka Fernando
Parikshit Ram
Yi Zhou
Soham Dan
Horst Samulowitz
Nathalie Baracaldo
Tianyi Chen
231
0
0
10 Nov 2025
Modality-Aware SAM: Sharpness-Aware-Minimization Driven Gradient Modulation for Harmonized Multimodal Learning
Hossein R. Nowdeh
Jie Ji
Xiaolong Ma
Fatemeh Afghah
141
0
0
28 Oct 2025
MCE: Towards a General Framework for Handling Missing Modalities under Imbalanced Missing Rates
Pattern Recognition (Pattern Recogn.), 2025
Binyu Zhao
Wei Zhang
Zhaonian Zou
157
0
0
12 Oct 2025
Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributions
Wenyuan Zhao
Adithya Balachandran
Chao Tian
Paul Pu Liang
169
0
0
06 Oct 2025
Distributed Information Bottleneck Theory for Multi-Modal Task-Aware Semantic Communication
Yujie Zhou
Yiwei Liao
Cheng Peng
Yong Xiao
Yong Xiao
Yingyu Li
Guangming Shi
258
0
0
05 Oct 2025
Preserving Cross-Modal Stability for Visual Unlearning in Multimodal Scenarios
Jinghan Xu Yuyang Zhang Qixuan Cai Jiancheng Chen Keqiu Li
MU
97
0
0
28 Sep 2025
Graph Coloring for Multi-Task Learning
Santosh Patapati
264
0
0
21 Sep 2025
Music4All A+A: A Multimodal Dataset for Music Information Retrieval Tasks
Jonas Geiger
Marta Moscati
Shah Nawaz
Markus Schedl
VLM
98
0
0
18 Sep 2025
SimMLM: A Simple Framework for Multi-modal Learning with Missing Modality
Sijie Li
Chen Chen
Jungong Han
195
4
0
25 Jul 2025
G
2
^{2}
2
D: Boosting Multimodal Learning with Gradient-Guided Distillation
Mohammed Rakib
A. Bagavathi
270
0
0
26 Jun 2025
Improving Multimodal Learning Balance and Sufficiency through Data Remixing
Xiaoyu Ma
Hao Chen
Yongjian Deng
259
4
0
13 Jun 2025
A Closer Look at Multimodal Representation Collapse
Abhra Chaudhuri
Anjan Dutta
Tu Bui
Serban Georgescu
249
8
0
28 May 2025
Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Data
Zhiqiang Tang
Zihan Zhong
Tong He
Gerald Friedland
384
4
0
19 Dec 2024
Balancing Multimodal Training Through Game-Theoretic Regularization
Konstantinos Kontras
Thomas Strypsteen
Christos Chatzichristos
Paul P. Liang
Matthew Blaschko
M. D. Vos
403
3
0
11 Nov 2024
Classifier-guided Gradient Modulation for Enhanced Multimodal Learning
Neural Information Processing Systems (NeurIPS), 2024
Zirun Guo
Tao Jin
Jingyuan Chen
Zhou Zhao
238
24
0
03 Nov 2024
On-the-fly Modulation for Balanced Multimodal Learning
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
Yake Wei
D. Hu
Henghui Du
Ji-Rong Wen
240
28
0
15 Oct 2024
Unraveling Movie Genres through Cross-Attention Fusion of Bi-Modal Synergy of Poster
Utsav Nareti
Chandranath Adak
S. Chattopadhyay
Pichao Wang
211
0
0
12 Oct 2024
Harnessing Shared Relations via Multimodal Mixup Contrastive Learning for Multimodal Classification
Raja Kumar
Raghav Singhal
Pranamya Kulkarni
Deval Mehta
Kshitij S. Jadhav
462
3
0
26 Sep 2024
Abnormal Event Detection In Videos Using Deep Embedding
Darshan Venkatrayappa
266
1
0
15 Sep 2024
Modality Invariant Multimodal Learning to Handle Missing Modalities: A Single-Branch Approach
Muhammad Saad Saeed
Shah Nawaz
Muhammad Zaigham Zaheer
Muhammad Haris Khan
Karthik Nandakumar
Muhammad Haroon Yousaf
Hassan Sajjad
Tom De Schepper
Markus Schedl
300
3
0
14 Aug 2024
Chameleon: Images Are What You Need For Multimodal Learning Robust To Missing Modalities
Muhammad Irzam Liaqat
Shah Nawaz
Muhammad Zaigham Zaheer
M. S. Saeed
Hassan Sajjad
Tom De Schepper
Karthik Nandakumar
Muhammad Haris Khan
319
1
0
23 Jul 2024
MDA: An Interpretable Multi-Modal Fusion with Missing Modalities and Intrinsic Noise
Lin Fan
Yafei Ou
Cenyang Zheng
Pengyu Dai
Tamotsu Kamishima
Masayuki Ikebe
Kenji Suzuki
Xun Gong
184
0
0
15 Jun 2024
Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Model
Wenbing Li
Hang Zhou
Junqing Yu
Zikai Song
Wei Yang
Mamba
249
29
0
28 May 2024
Improving Multimodal Learning with Multi-Loss Gradient Modulation
British Machine Vision Conference (BMVC), 2024
Konstantinos Kontras
Christos Chatzichristos
Matthew Blaschko
M. D. Vos
211
10
0
13 May 2024
Interpretable Tensor Fusion
Saurabh Varshneya
Antoine Ledent
Philipp Liznerski
Andriy Balinskyy
Purvanshi Mehta
Waleed Mustafa
Matthias Kirchler
165
3
0
07 May 2024
Learning to Rebalance Multi-Modal Optimization by Adaptively Masking Subnetworks
Yang Yang
Hongpeng Pan
Qingjun Jiang
Yi Tian Xu
Jinghui Tang
191
20
0
12 Apr 2024
Guided Masked Self-Distillation Modeling for Distributed Multimedia Sensor Event Analysis
Masahiro Yasuda
Noboru Harada
Yasunori Ohishi
Shoichiro Saito
Akira Nakayama
Nobutaka Ono
273
6
0
12 Apr 2024
Credibility-Aware Multi-Modal Fusion Using Probabilistic Circuits
Sahil Sidheekh
Pranuthi Tenali
Saurabh Mathur
Erik Blasch
Kristian Kersting
S. Natarajan
232
4
0
05 Mar 2024
Few-Shot Relation Extraction with Hybrid Visual Evidence
Jiaying Gong
Hoda Eldardiry
289
2
0
01 Mar 2024
Memory-Inspired Temporal Prompt Interaction for Text-Image Classification
Xinyao Yu
Hao Sun
Ziwei Niu
Rui Qin
Zhenjia Bai
Yen-Wei Chen
Lanfen Lin
VLM
255
2
0
26 Jan 2024
CrisisKAN: Knowledge-infused and Explainable Multimodal Attention Network for Crisis Event Classification
European Conference on Information Retrieval (ECIR), 2024
Shubham Gupta
Nandini Saini
Suman Kundu
Debasis Das
269
10
0
11 Jan 2024
VaQuitA: Enhancing Alignment in LLM-Assisted Video Understanding
Yizhou Wang
Ruiyi Zhang
Haoliang Wang
Uttaran Bhattacharya
Yun Fu
Gang Wu
MLLM
240
19
0
04 Dec 2023
Semantic-Aware Frame-Event Fusion based Pattern Recognition via Large Vision-Language Models
Dong Li
Jiandong Jin
Yuhao Zhang
Yanlin Zhong
Yaoyang Wu
Lan Chen
Tianlin Li
Bin Luo
243
8
0
30 Nov 2023
Multimodal deep representation learning for quantum cross-platform verification
Physical Review Letters (PRL), 2023
Yan Qian
Yuxuan Du
Zhenliang He
Min-hsiu Hsieh
Dacheng Tao
203
17
0
07 Nov 2023
MOSEL: Inference Serving Using Dynamic Modality Selection
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Bodun Hu
Le Xu
Jeongyoon Moon
N. Yadwadkar
Aditya Akella
300
5
0
27 Oct 2023
Incorporating Domain Knowledge Graph into Multimodal Movie Genre Classification with Self-Supervised Attention and Contrastive Learning
ACM Multimedia (ACM MM), 2023
Jiaqi Li
Guilin Qi
Chuanyi Zhang
Yongrui Chen
Yiming Tan
Chenlong Xia
Ye Tian
207
6
0
12 Oct 2023
What Makes for Robust Multi-Modal Models in the Face of Missing Modalities?
Siting Li
Chenzhuang Du
Yue Zhao
Yu Huang
Hang Zhao
203
6
0
10 Oct 2023
Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices
Asian Conference on Machine Learning (ACML), 2023
Mohamed Imed Eddine Ghebriout
Halima Bouzidi
Smail Niar
Hamza Ouarnoughi
323
8
0
12 Sep 2023
Enhancing multimodal cooperation via sample-level modality valuation
Computer Vision and Pattern Recognition (CVPR), 2023
Yake Wei
Ruoxuan Feng
Zihe Wang
Di Hu
476
51
0
12 Sep 2023
Boosting Multi-modal Model Performance with Adaptive Gradient Modulation
IEEE International Conference on Computer Vision (ICCV), 2023
Hong Li
Xingyu Li
Pengbo Hu
Yinuo Lei
Chunxiao Li
Yi Zhou
251
65
0
15 Aug 2023
Multi-modal Learning with Missing Modality via Shared-Specific Feature Modelling
Computer Vision and Pattern Recognition (CVPR), 2023
Hu Wang
Yuanhong Chen
Congbo Ma
Jodie Avery
Louise Hull
G. Carneiro
249
171
0
26 Jul 2023
Deep Equilibrium Multimodal Fusion
Jinhong Ni
Yalong Bai
Wei Zhang
Ting Yao
Tao Mei
273
8
0
29 Jun 2023
MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learning
Paul Pu Liang
Yiwei Lyu
Xiang Fan
Arav Agarwal
Yun Cheng
Louis-Philippe Morency
Ruslan Salakhutdinov
VLM
202
10
0
28 Jun 2023
Multi-modal Machine Learning for Vehicle Rating Predictions Using Image, Text, and Parametric Data
Conference on Computability in Europe (CiE), 2023
Hanqi Su
Binyang Song
Faez Ahmed
219
9
0
24 May 2023
Tucker Bilinear Attention Network for Multi-scale Remote Sensing Object Detection
IEEE Geoscience and Remote Sensing Letters (GRSL), 2023
Tao Chen
Ruirui Li
Jiafeng Fu
Daguang Jiang
190
2
0
09 Mar 2023
Multi-modal Machine Learning in Engineering Design: A Review and Future Directions
Journal of Computing and Information Science in Engineering (JCISE), 2023
Binyang Song
Ruilin Zhou
Faez Ahmed
AI4CE
356
64
0
14 Feb 2023
Common Practices and Taxonomy in Deep Multi-view Fusion for Remote Sensing Applications
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (IEEE JSTARS), 2022
Francisco Mena
Diego Arenas
Marlon Nuske
Andreas Dengel
228
14
0
20 Dec 2022
Multimodal Learning for Multi-Omics: A Survey
Sina Tabakhi
M. N. I. Suvon
Pegah Ahadian
Haiping Lu
257
15
0
29 Nov 2022
1
2
Next
Page 1 of 2
