Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis

1 September 2021

Papers citing "Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis"

29 / 79 papers shown

Title
Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversation Shihao Zou Xianying Huang Xudong Shen 8 2 0 04 Oct 2023
VideoAdviser: Video Knowledge Distillation for Multimodal Transfer Learning Yanan Wang Donghuo Zeng Shinya Wada Satoshi Kurihara 12 6 0 27 Sep 2023
Neuro-Inspired Hierarchical Multimodal Learning Xiongye Xiao Gengshuo Liu Gaurav Gupta Benjamin Cho Shixuan Li Yaxing Li Tianqing Fang M. Erez Michael Orshansky 19 1 0 27 Sep 2023
Hierarchical Audio-Visual Information Fusion with Multi-label Joint Decoding for MER 2023 Haotian Wang Yuxuan Xi Hang Chen Jun Du Yan Song ... Pengfei Hu Ya Jiang Shi Cheng Jie M. Zhang Yuzhe Weng 37 4 0 11 Sep 2023
Exchanging-based Multimodal Fusion with Transformer Renyu Zhu Chengcheng Han Yong Qian Qiushi Sun Xiang Li Ming Gao Xuezhi Cao Yunsen Xian 10 2 0 05 Sep 2023
Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition Bobo Li Hao Fei Lizi Liao Yu Zhao Chong Teng Tat-Seng Chua Donghong Ji Fei Li 17 30 0 08 Aug 2023
Multimodal Multi-loss Fusion Network for Sentiment Analysis Zehui Wu Ziwei Gong Jaywon Koo Julia Hirschberg 20 2 0 01 Aug 2023
ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis Yu Mingjun Zhao Shiguang Qi Feiran Sun Baoxun Wang Weidong Guo Xiaoli Wang Lei Yang Di Niu 11 10 0 27 Jun 2023
Enhanced Multimodal Representation Learning with Cross-modal KD Mengxi Chen Linyu Xing Yu Wang Ya-Qin Zhang 12 6 0 13 Jun 2023
Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion Shao-Yu Wu Damai Dai Ziwei Qin Tianyu Liu Binghuai Lin Yunbo Cao Zhifang Sui 19 4 0 24 May 2023
TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Models M. Hasan Md. Saiful Islam Sangwu Lee Wasifur Rahman Iftekhar Naim Mohammed Ibrahim Khan E. Hoque VLM 12 2 0 27 Mar 2023
InterMulti:Multi-view Multimodal Interactions with Text-dominated Hierarchical High-order Fusion for Emotion Analysis Feng Qiu Wanzeng Kong Yu-qiong Ding 21 2 0 20 Dec 2022
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition Guimin Hu Ting-En Lin Yi Zhao Guangming Lu Yuchuan Wu Yongbin Li 17 60 0 21 Nov 2022
Multimodal Contrastive Learning via Uni-Modal Coding and Cross-Modal Prediction for Multimodal Sentiment Analysis Ronghao Lin Haifeng Hu SSL 14 11 0 26 Oct 2022
MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences Wei Han Hui Chen MingSung Kan Soujanya Poria 19 7 0 23 Oct 2022
Missing Modality meets Meta Sampling (M3S): An Efficient Universal Approach for Multimodal Sentiment Analysis with Missing Modality Haozhe Chi Minghua Yang Junhao Zhu Guanhong Wang Gaoang Wang 25 3 0 07 Oct 2022
SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning Wei Han Hui Chen Zhen Hai Soujanya Poria Lidong Bing 28 12 0 12 Sep 2022
Progressive Fusion for Multimodal Integration Shiv Shankar Laure Thompson M. Fiterau 17 2 0 01 Sep 2022
Video-based Cross-modal Auxiliary Network for Multimodal Sentiment Analysis Rongfei Chen Wenju Zhou Yang Li Huiyu Zhou 11 11 0 30 Aug 2022
Flexible Vertical Federated Learning with Heterogeneous Parties Timothy Castiglia Shiqiang Wang S. Patterson FedML 9 21 0 26 Aug 2022
Interpretable Multimodal Emotion Recognition using Hybrid Fusion of Speech and Image Data Puneet Kumar Sarthak Malik Balasubramanian Raman CVBM 17 13 0 25 Aug 2022
Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module Yih-Ling Liu Ziqi Yuan Huisheng Mao Zhiyun Liang Wanqiuyue Yang Yuanzhe Qiu Tie Cheng Xiaoteng Li Hua Xu Kai Gao 15 26 0 22 Aug 2022
Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis Licai Sun Zheng Lian B. Liu Jianhua Tao 15 27 0 16 Aug 2022
Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Data Timothy Castiglia Anirban Das Shiqiang Wang S. Patterson FedML 6 48 0 16 Jun 2022
Analyzing Modality Robustness in Multimodal Sentiment Analysis Devamanyu Hazarika Yingting Li Bo Cheng Shuai Zhao Roger Zimmermann Soujanya Poria 21 21 0 30 May 2022
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis Huisheng Mao Ziqi Yuan Hua Xu Wenmeng Yu Yihe Liu Kai Gao 9 29 0 23 Mar 2022
Multimodal Representations Learning Based on Mutual Information Maximization and Minimization and Identity Embedding for Multimodal Sentiment Analysis Jiahao Zheng Sen Zhang Xiaoping Wang Zhigang Zeng 4 7 0 10 Jan 2022
StreaMulT: Streaming Multimodal Transformer for Heterogeneous and Arbitrary Long Sequential Data Victor Pellegrain Myriam Tami M. Batteux C´eline Hudelot AI4TS 9 2 0 15 Oct 2021
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis Wenmeng Yu Hua Xu Ziqi Yuan Jiele Wu SSL 39 430 0 09 Feb 2021