Title
Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuning Ashutosh Chaubey Xulang Guan Mohammad Soleymani CVBM MLLM VLM 66 0 0 09 Apr 2025
Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens X. Wang Mingqi Jiang Z. Ma Ziyu Zhang S. Liu ... Zhifei Li Xie Chen Lei Xie Y. Guo Wei Xue 70 9 0 03 Mar 2025
OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia Xuelong Geng Kun Wei Qijie Shao Shuiyun Liu Zhennan Lin ... Yuhang Dai Xinfa Zhu Yue Li Li Zhang Lei Xie 62 3 0 23 Jan 2025
Enhancing Multimodal Sentiment Analysis for Missing Modality through Self-Distillation and Unified Modality Cross-Attention Yuzhe Weng Haotian Wang Tian Gao Kewei Li Shutong Niu Jun Du 28 0 0 19 Oct 2024
Open-vocabulary Multimodal Emotion Recognition: Dataset, Metric, and Benchmark Zheng Lian Haiyang Sun Licai Sun Lan Chen Haoyu Chen ... Rui Liu Shan Liang Ya Li Jiangyan Yi Jianhua Tao VLM 23 0 0 02 Oct 2024
Early Joint Learning of Emotion Information Makes MultiModal Model Understand You Better Mengying Ge Mingyang Li Dongkai Tang Pengbo Li Kuo Liu Shuhao Deng Songbai Pu L. Liu Yang Song Tao Zhang 18 0 0 12 Sep 2024
Audio-Guided Fusion Techniques for Multimodal Emotion Analysis Pujin Shi Fei Gao 22 1 0 08 Sep 2024
Leveraging Contrastive Learning and Self-Training for Multimodal Emotion Recognition with Limited Labeled Samples Qi Fan Yutong Li Yi Xin Xinyu Cheng Guanglai Gao Miao Ma 36 4 0 23 Aug 2024
SZTU-CMU at MER2024: Improving Emotion-LLaMA with Conv-Attention for Multimodal Emotion Recognition Zebang Cheng Shuyuan Tu Dawei Huang Minghan Li Xiaojiang Peng Zhi-Qi Cheng Alexander G. Hauptmann 43 2 0 20 Aug 2024
Emotion and Intent Joint Understanding in Multimodal Conversation: A Benchmarking Dataset Rui Liu Haolin Zuo Zheng Lian Xiaofen Xing Björn W. Schuller Haizhou Li 32 4 0 03 Jul 2024
Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning Zebang Cheng Zhi-Qi Cheng Jun-Yan He Jingdong Sun Kai Wang Yuxiang Lin Zheng Lian Xiaojiang Peng Alexander G. Hauptmann MLLM 29 14 0 17 Jun 2024
Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey Hao-Yu Yang Yanyan Zhao Yang Wu Shilong Wang Tian Zheng Hongbo Zhang Zongyang Ma Wanxiang Che Bing Qin 28 8 0 12 Jun 2024
EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark Ziyang Ma Mingjie Chen Hezhao Zhang Zhisheng Zheng Wenxi Chen Xiquan Li Jiaxin Ye Xie Chen Thomas Hain 25 12 0 11 Jun 2024
Evaluation of data inconsistency for multi-modal sentiment analysis Yufei Wang Mengyue Wu 27 1 0 05 Jun 2024
MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognition Zheng Lian Haiyang Sun Licai Sun Zhuofan Wen Siyuan Zhang ... Bin Liu Erik Cambria Guoying Zhao Björn W. Schuller Jianhua Tao VLM 31 11 0 26 Apr 2024
HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition Licai Sun Zheng Lian Bin Liu Jianhua Tao 43 29 0 11 Jan 2024
GPT-4V with Emotion: A Zero-shot Benchmark for Generalized Emotion Recognition Zheng Lian Licai Sun Haiyang Sun Kang Chen Zhuofan Wen Hao Gu Bin Liu Jianhua Tao 23 27 0 07 Dec 2023
Explainable Multimodal Emotion Recognition Zheng Lian Haiyang Sun Licai Sun Hao Gu Zhuofan Wen ... Shan Liang Ya Li Jiangyan Yi B. Liu Jianhua Tao MLLM 8 6 0 27 Jun 2023
VISTANet: VIsual Spoken Textual Additive Net for Interpretable Multimodal Emotion Recognition Puneet Kumar Sarthak Malik Balasubramanian Raman Xiaobai Li 13 2 0 24 Aug 2022
Analyzing Modality Robustness in Multimodal Sentiment Analysis Devamanyu Hazarika Yingting Li Bo Cheng Shuai Zhao Roger Zimmermann Soujanya Poria 29 32 0 30 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,337 0 11 Nov 2021
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 229 1,281 0 18 Mar 2020
EmoNets: Multimodal deep learning approaches for emotion recognition in video Samira Ebrahimi Kahou Xavier Bouthillier Pascal Lamblin Çağlar Gülçehre Vincent Michalski ... Aaron Courville Pascal Vincent Roland Memisevic C. Pal Yoshua Bengio 119 400 0 05 Mar 2015