ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2109.00412
  4. Cited By
Improving Multimodal Fusion with Hierarchical Mutual Information
  Maximization for Multimodal Sentiment Analysis

Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis

1 September 2021
Wei Han
Hui Chen
Soujanya Poria
ArXivPDFHTML

Papers citing "Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis"

50 / 79 papers shown
Title
Multimodal Transformers are Hierarchical Modal-wise Heterogeneous Graphs
Multimodal Transformers are Hierarchical Modal-wise Heterogeneous Graphs
Yijie Jin
Junjie Peng
Xuanchao Lin
Haochen Yuan
Lan Wang
Cangzhi Zheng
25
0
0
02 May 2025
Can Large Language Models Help Multimodal Language Analysis? MMLA: A Comprehensive Benchmark
Can Large Language Models Help Multimodal Language Analysis? MMLA: A Comprehensive Benchmark
Hanlei Zhang
Zhuohang Li
Yeshuang Zhu
Hua Xu
Peiwu Wang
Haige Zhu
Jie Zhou
Jinchao Zhang
20
0
0
23 Apr 2025
Towards Explainable Fusion and Balanced Learning in Multimodal Sentiment Analysis
Towards Explainable Fusion and Balanced Learning in Multimodal Sentiment Analysis
Miaosen Luo
Yuncheng Jiang
Sijie Mai
36
0
0
16 Apr 2025
DeepMLF: Multimodal language model with learnable tokens for deep fusion in sentiment analysis
DeepMLF: Multimodal language model with learnable tokens for deep fusion in sentiment analysis
Efthymios Georgiou
V. Katsouros
Yannis Avrithis
Alexandros Potamianos
14
0
0
15 Apr 2025
Hierarchical Adaptive Expert for Multimodal Sentiment Analysis
Hierarchical Adaptive Expert for Multimodal Sentiment Analysis
Jiahao Qin
Feng Liu
Lu Zong
27
0
0
25 Mar 2025
Efficient Prompting for Continual Adaptation to Missing Modalities
Zirun Guo
Shulei Wang
Wang Lin
Weicai Yan
Yangyang Wu
Tao Jin
CLL
VLM
47
2
0
01 Mar 2025
Omni-SILA: Towards Omni-scene Driven Visual Sentiment Identifying, Locating and Attributing in Videos
Jiamin Luo
Jingjing Wang
Junxiao Ma
Yujie Jin
Shoushan Li
Guodong Zhou
26
0
0
26 Feb 2025
Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross Attention
Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross Attention
Joe Dhanith
Shravan Venkatraman
Modigari Narendra
Vigya Sharma
Santhosh Malarvannan
59
0
0
20 Feb 2025
"Yeah Right!" -- Do LLMs Exhibit Multimodal Feature Transfer?
"Yeah Right!" -- Do LLMs Exhibit Multimodal Feature Transfer?
Benjamin Z. Reichman
Kartik Talamadupula
30
0
0
07 Jan 2025
AlignMamba: Enhancing Multimodal Mamba with Local and Global Cross-modal
  Alignment
AlignMamba: Enhancing Multimodal Mamba with Local and Global Cross-modal Alignment
Yan Li
Yifei Xing
X. Lan
X. Li
Haifeng Chen
D. Jiang
Mamba
63
0
0
01 Dec 2024
Smile upon the Face but Sadness in the Eyes: Emotion Recognition based
  on Facial Expressions and Eye Behaviors
Smile upon the Face but Sadness in the Eyes: Emotion Recognition based on Facial Expressions and Eye Behaviors
Yuanyuan Liu
Lin Wei
Kejun Liu
Yibing Zhan
Zijing Chen
Zhe Chen
Shiguang Shan
16
0
0
08 Nov 2024
Toward Robust Incomplete Multimodal Sentiment Analysis via Hierarchical
  Representation Learning
Toward Robust Incomplete Multimodal Sentiment Analysis via Hierarchical Representation Learning
M. Li
Dingkang Yang
Y. Liu
Shunli Wang
Jiawei Chen
...
Xiaolu Hou
Mingyang Sun
Ziyun Qian
Dongliang Kou
L. Zhang
19
1
0
05 Nov 2024
Knowledge-Guided Dynamic Modality Attention Fusion Framework for
  Multimodal Sentiment Analysis
Knowledge-Guided Dynamic Modality Attention Fusion Framework for Multimodal Sentiment Analysis
Xinyu Feng
Yuming Lin
Lihua He
You Li
Liang Chang
Ya Zhou
16
0
0
06 Oct 2024
Towards Robust Multimodal Sentiment Analysis with Incomplete Data
Towards Robust Multimodal Sentiment Analysis with Incomplete Data
Haoyu Zhang
Wenbin Wang
Tianshu Yu
22
0
0
30 Sep 2024
DRIM: Learning Disentangled Representations from Incomplete Multimodal
  Healthcare Data
DRIM: Learning Disentangled Representations from Incomplete Multimodal Healthcare Data
Lucas Robinet
Ahmad Berjaoui
Ziad Kheil
Elizabeth Cohen-Jonathan Moyal
AI4TS
13
1
0
25 Sep 2024
Recent Trends of Multimodal Affective Computing: A Survey from NLP
  Perspective
Recent Trends of Multimodal Affective Computing: A Survey from NLP Perspective
Guimin Hu
Yi Xin
Weimin Lyu
Haojian Huang
Chang Sun
Z. Zhu
Lin Gui
Ruichu Cai
Erik Cambria
Hasti Seifi
23
2
0
11 Sep 2024
Meta-Learn Unimodal Signals with Weak Supervision for Multimodal
  Sentiment Analysis
Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysis
Sijie Mai
Yu Zhao
Ying Zeng
Jianhua Yao
Haifeng Hu
20
1
0
28 Aug 2024
End-to-end Semantic-centric Video-based Multimodal Affective Computing
End-to-end Semantic-centric Video-based Multimodal Affective Computing
Ronghao Lin
Ying Zeng
Sijie Mai
Haifeng Hu
VGen
25
0
0
14 Aug 2024
Hierarchical Multi-modal Transformer for Cross-modal Long Document
  Classification
Hierarchical Multi-modal Transformer for Cross-modal Long Document Classification
Tengfei Liu
Yongli Hu
Junbin Gao
Yanfeng Sun
Baocai Yin
20
0
0
14 Jul 2024
CorMulT: A Semi-supervised Modality Correlation-aware Multimodal
  Transformer for Sentiment Analysis
CorMulT: A Semi-supervised Modality Correlation-aware Multimodal Transformer for Sentiment Analysis
Yangmin Li
Ruiqi Zhu
Wengen Li
24
1
0
09 Jul 2024
Multimodal Prompt Learning with Missing Modalities for Sentiment
  Analysis and Emotion Recognition
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition
Zirun Guo
Tao Jin
Zhou Zhao
26
0
0
07 Jul 2024
Asynchronous Multimodal Video Sequence Fusion via Learning
  Modality-Exclusive and -Agnostic Representations
Asynchronous Multimodal Video Sequence Fusion via Learning Modality-Exclusive and -Agnostic Representations
Dingkang Yang
Mingcheng Li
Linhao Qu
Kun Yang
Peng Zhai
Song Wang
Lihua Zhang
27
0
0
06 Jul 2024
Evaluation of data inconsistency for multi-modal sentiment analysis
Evaluation of data inconsistency for multi-modal sentiment analysis
Yufei Wang
Mengyue Wu
19
1
0
05 Jun 2024
Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal
  Utterances
Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterances
Hanlei Zhang
Hua Xu
Fei Long
Xin Wang
Kai Gao
25
3
0
21 May 2024
Infer Induced Sentiment of Comment Response to Video: A New Task,
  Dataset and Baseline
Infer Induced Sentiment of Comment Response to Video: A New Task, Dataset and Baseline
Qi Jia
Baoyu Fan
Cong Xu
Lu Liu
Liang Jin
Guoguang Du
Zhenhua Guo
Yaqian Zhao
Xuanjing Huang
Rengang Li
26
0
0
15 May 2024
Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment
  Analysis with Incomplete Modalities
Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities
Mingcheng Li
Dingkang Yang
Xiao Zhao
Shuai Wang
Yan Wang
Kun Yang
Mingyang Sun
Dongliang Kou
Ziyun Qian
Lihua Zhang
25
3
0
25 Apr 2024
Neuro-Inspired Information-Theoretic Hierarchical Perception for
  Multimodal Learning
Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learning
Xiongye Xiao
Gengshuo Liu
Gaurav Gupta
De-An Cao
Shixuan Li
Yaxing Li
Tianqing Fang
Mingxi Cheng
Paul Bogdan
30
1
0
15 Apr 2024
Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal
  Sentiment Space
Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space
Zhuyang Xie
Yan Yang
Jie Wang
Xiaorong Liu
Xiaofan Li
19
0
0
13 Apr 2024
UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion
  Cause
UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Cause
Guimin Hu
Zhihong Zhu
Daniel Hershcovich
Hasti Seifi
Jiayuan Xie
16
6
0
30 Mar 2024
MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent
  Recognition and Out-of-scope Detection in Conversations
MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversations
Hanlei Zhang
Xin Wang
Hua Xu
Qianrui Zhou
Kai Gao
Jianhua Su
jinyue Zhao
Wenrui Li
Yanting Chen
18
1
0
16 Mar 2024
Multimodal Infusion Tuning for Large Models
Multimodal Infusion Tuning for Large Models
Hao Sun
Yu Song
Xinyao Yu
Jiaqing Liu
Yen-Wei Chen
Lanfen Lin
VLM
19
0
0
08 Mar 2024
Towards Multimodal Sentiment Analysis Debiasing via Bias Purification
Towards Multimodal Sentiment Analysis Debiasing via Bias Purification
Dingkang Yang
Mingcheng Li
Dongling Xiao
Yang Liu
Kun Yang
Zhaoyu Chen
Yuzheng Wang
Peng Zhai
Ke Li
Lihua Zhang
22
7
0
08 Mar 2024
Towards Robust Instruction Tuning on Multimodal Large Language Models
Towards Robust Instruction Tuning on Multimodal Large Language Models
Wei Han
Hui Chen
Soujanya Poria
MLLM
36
0
0
22 Feb 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion
Xing Han
Huy Nguyen
Carl Harris
Nhat Ho
S. Saria
MoE
36
16
0
05 Feb 2024
Triple Disentangled Representation Learning for Multimodal Affective
  Analysis
Triple Disentangled Representation Learning for Multimodal Affective Analysis
Ying Zhou
Xuefeng Liang
Han Chen
Yin Zhao
Xin Chen
Lida Yu
35
3
0
29 Jan 2024
Toward Robust Multimodal Learning using Multimodal Foundational Models
Toward Robust Multimodal Learning using Multimodal Foundational Models
Xianbing Zhao
Soujanya Poria
Xuejiao Li
Yixin Chen
Buzhou Tang
VLM
26
0
0
20 Jan 2024
WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual
  World Knowledge
WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledge
Wenbin Wang
Liang Ding
Li Shen
Yong Luo
Han Hu
Dacheng Tao
24
11
0
12 Jan 2024
MERBench: A Unified Evaluation Benchmark for Multimodal Emotion
  Recognition
MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition
Zheng Lian
Licai Sun
Yong Ren
Hao Gu
Haiyang Sun
Lan Chen
Bin Liu
Jianhua Tao
11
12
0
07 Jan 2024
Prototypical Information Bottlenecking and Disentangling for Multimodal
  Cancer Survival Prediction
Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Prediction
Yilan Zhang
Yingxue Xu
Jianqi Chen
Fengying Xie
Hao Chen
20
25
0
03 Jan 2024
Token-Level Contrastive Learning with Modality-Aware Prompting for
  Multimodal Intent Recognition
Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognition
Qianrui Zhou
Hua Xu
Hao Li
Hanlei Zhang
Xiaohan Zhang
Yifan Wang
Kai Gao
20
11
0
22 Dec 2023
PowMix: A Versatile Regularizer for Multimodal Sentiment Analysis
PowMix: A Versatile Regularizer for Multimodal Sentiment Analysis
Efthymios Georgiou
Yannis Avrithis
Alexandros Potamianos
20
1
0
19 Dec 2023
READ-PVLA: Recurrent Adapter with Partial Video-Language Alignment for
  Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modeling
READ-PVLA: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modeling
Thong Nguyen
Xiaobao Wu
Xinshuai Dong
Khoi M. Le
Zhiyuan Hu
Cong-Duy Nguyen
See-Kiong Ng
Anh Tuan Luu
14
2
0
12 Dec 2023
GPT-4V with Emotion: A Zero-shot Benchmark for Generalized Emotion
  Recognition
GPT-4V with Emotion: A Zero-shot Benchmark for Generalized Emotion Recognition
Zheng Lian
Licai Sun
Haiyang Sun
Kang Chen
Zhuofan Wen
Hao Gu
Bin Liu
Jianhua Tao
10
8
0
07 Dec 2023
Improving Multimodal Sentiment Analysis: Supervised Angular Margin-based
  Contrastive Learning for Enhanced Fusion Representation
Improving Multimodal Sentiment Analysis: Supervised Angular Margin-based Contrastive Learning for Enhanced Fusion Representation
Cong-Duy Nguyen
Thong Nguyen
Duc Anh Vu
Anh Tuan Luu
6
13
0
04 Dec 2023
Joyful: Joint Modality Fusion and Graph Contrastive Learning for
  Multimodal Emotion Recognition
Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition
Dongyuan Li
Yusong Wang
Kotaro Funakoshi
Manabu Okumura
18
12
0
18 Nov 2023
Modality-invariant and Specific Prompting for Multimodal Human
  Perception Understanding
Modality-invariant and Specific Prompting for Multimodal Human Perception Understanding
Hao Sun
Ziwei Niu
Xinyao Yu
Jiaqing Liu
Yen-Wei Chen
Lanfen Lin
16
0
0
17 Nov 2023
Self-MI: Efficient Multimodal Fusion via Self-Supervised Multi-Task
  Learning with Auxiliary Mutual Information Maximization
Self-MI: Efficient Multimodal Fusion via Self-Supervised Multi-Task Learning with Auxiliary Mutual Information Maximization
Cam-Van Thi Nguyen
Ngoc-Hoa Thi Nguyen
Duc-Trong Le
Quang-Thuy Ha
SSL
19
0
0
07 Nov 2023
MM-BigBench: Evaluating Multimodal Models on Multimodal Content
  Comprehension Tasks
MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks
Xiaocui Yang
Wenfang Wu
Shi Feng
Ming Wang
Daling Wang
Yang Li
Qi Sun
Yifei Zhang
Xiaoming Fu
Soujanya Poria
LRM
ELM
17
10
0
13 Oct 2023
Multimodal Variational Auto-encoder based Audio-Visual Segmentation
Multimodal Variational Auto-encoder based Audio-Visual Segmentation
Yuxin Mao
Jing Zhang
Mochu Xiang
Yiran Zhong
Yuchao Dai
17
33
0
12 Oct 2023
Learning Language-guided Adaptive Hyper-modality Representation for
  Multimodal Sentiment Analysis
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis
Haoyu Zhang
Yu Wang
Guanghao Yin
Kejun Liu
Yuanyuan Liu
Tianshu Yu
11
30
0
09 Oct 2023
12
Next