UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition

21 November 2022

Ting-En Lin

Papers citing "UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition"

46 / 46 papers shown

Title
Can Large Language Models Help Multimodal Language Analysis? MMLA: A Comprehensive Benchmark Hanlei Zhang Zhuohang Li Yeshuang Zhu Hua Xu Peiwu Wang Haige Zhu Jie Zhou Jinchao Zhang 25 0 0 23 Apr 2025
Hybrid Emotion Recognition: Enhancing Customer Interactions Through Acoustic and Textual Analysis Sahan Hewage Wewelwala T.G.D.K. Sumanathilaka 29 0 0 27 Mar 2025
Hierarchical Adaptive Expert for Multimodal Sentiment Analysis Jiahao Qin Feng Liu Lu Zong 29 0 0 25 Mar 2025
Omni-SILA: Towards Omni-scene Driven Visual Sentiment Identifying, Locating and Attributing in Videos Jiamin Luo Jingjing Wang Junxiao Ma Yujie Jin Shoushan Li Guodong Zhou 28 0 0 26 Feb 2025
LLM supervised Pre-training for Multimodal Emotion Recognition in Conversations Soumya Dutta Sriram Ganapathy 29 2 0 20 Jan 2025
A Heterogeneous Multimodal Graph Learning Framework for Recognizing User Emotions in Social Networks Sree Bhattacharyya Shuhua Yang James Z. Wang 36 0 0 13 Jan 2025
Spatio-Temporal Fuzzy-oriented Multi-Modal Meta-Learning for Fine-grained Emotion Recognition Jingyao Wang Yuxuan Yang Wenwen Qiang Changwen Zheng 66 0 0 18 Dec 2024
RCLMuFN: Relational Context Learning and Multiplex Fusion Network for Multimodal Sarcasm Detection Tongguan Wang Junkai Li Guixin Su Yongcheng Zhang Dongyu Su Yuxue Hu Ying Sha 81 2 0 17 Dec 2024
WavFusion: Towards wav2vec 2.0 Multimodal Speech Emotion Recognition Feng Li Jiusong Luo Wanjun Xia 57 1 0 07 Dec 2024
UGotMe: An Embodied System for Affective Human-Robot Interaction Peizhen Li Longbing Cao Xiao-Ming Wu Xiaohan Yu Runze Yang 16 0 0 24 Oct 2024
Enhancing Multimodal Sentiment Analysis for Missing Modality through Self-Distillation and Unified Modality Cross-Attention Yuzhe Weng Haotian Wang Tian Gao Kewei Li Shutong Niu Jun Du 25 0 0 19 Oct 2024
Early Joint Learning of Emotion Information Makes MultiModal Model Understand You Better Mengying Ge Mingyang Li Dongkai Tang Pengbo Li Kuo Liu Shuhao Deng Songbai Pu L. Liu Yang Song Tao Zhang 13 0 0 12 Sep 2024
Recent Trends of Multimodal Affective Computing: A Survey from NLP Perspective Guimin Hu Yi Xin Weimin Lyu Haojian Huang Chang Sun Z. Zhu Lin Gui Ruichu Cai Erik Cambria Hasti Seifi 23 5 0 11 Sep 2024
Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysis Sijie Mai Yu Zhao Ying Zeng Jianhua Yao Haifeng Hu 20 2 0 28 Aug 2024
PanoSent: A Panoptic Sextuple Extraction Benchmark for Multimodal Conversational Aspect-based Sentiment Analysis Meng Luo Hao Fei Bobo Li Shengqiong Wu Qian Liu Soujanya Poria Erik Cambria M. Lee W. Hsu 28 7 0 18 Aug 2024
End-to-end Semantic-centric Video-based Multimodal Affective Computing Ronghao Lin Ying Zeng Sijie Mai Haifeng Hu VGen 28 0 0 14 Aug 2024
BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks Jieying Xue Minh Phuong Nguyen Blake Matheny Le Minh Nguyen 16 4 0 05 Jul 2024
Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learning Xiongye Xiao Gengshuo Liu Gaurav Gupta De-An Cao Shixuan Li Yaxing Li Tianqing Fang Mingxi Cheng Paul Bogdan 30 1 0 15 Apr 2024
Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations Sangmin Lee Bolin Lai Fiona Ryan Bikram Boote James M. Rehg 16 8 0 04 Mar 2024
CARBD-Ko: A Contextually Annotated Review Benchmark Dataset for Aspect-Level Sentiment Classification in Korean Dongjun Jang Jean Seo Sungjoo Byun Taekyoung Kim Minseok Kim Hyopil Shin 14 1 0 23 Feb 2024
Triple Disentangled Representation Learning for Multimodal Affective Analysis Ying Zhou Xuefeng Liang Han Chen Yin Zhao Xin Chen Lida Yu 38 3 0 29 Jan 2024
AM^2-EmoJE: Adaptive Missing-Modality Emotion Recognition in Conversation via Joint Embedding Learning Naresh Kumar Devulapally Sidharth Anand S. Bhattacharjee Junsong Yuan 20 1 0 26 Jan 2024
AMuSE: Adaptive Multimodal Analysis for Speaker Emotion Recognition in Group Conversations Naresh Kumar Devulapally Sidharth Anand S. Bhattacharjee Junsong Yuan Yu-Ping Chang 11 3 0 26 Jan 2024
VideoAdviser: Video Knowledge Distillation for Multimodal Transfer Learning Yanan Wang Donghuo Zeng Shinya Wada Satoshi Kurihara 14 6 0 27 Sep 2023
Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models Haoyu Gao Ting-En Lin Hangyu Li Min Yang Yuchuan Wu Wentao Ma Yongbin Li LRM 19 10 0 22 Sep 2023
InstructERC: Reforming Emotion Recognition in Conversation with a Retrieval Multi-task LLMs Framework Shanglin Lei Guanting Dong Xiaoping Wang Keheng Wang Sirui Wang 22 43 0 21 Sep 2023
Hierarchical Audio-Visual Information Fusion with Multi-label Joint Decoding for MER 2023 Haotian Wang Yuxuan Xi Hang Chen Jun Du Yan Song ... Pengfei Hu Ya Jiang Shi Cheng Jie M. Zhang Yuzhe Weng 39 4 0 11 Sep 2023
UniSA: Unified Generative Framework for Sentiment Analysis Zaijing Li Ting-En Lin Yuchuan Wu Meng Liu Fengxiao Tang Mingde Zhao Yongbin Li 16 16 0 04 Sep 2023
Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition Bobo Li Hao Fei Lizi Liao Yu Zhao Chong Teng Tat-Seng Chua Donghong Ji Fei Li 19 30 0 08 Aug 2023
CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition Jiang Li Xiaoping Wang Yingjian Liu Zhigang Zeng 11 15 0 28 Jul 2023
Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems Shivani Kumar S. Bhatia Milan Aggarwal Tanmoy Chakraborty 11 1 0 14 Jul 2023
Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications Paul Pu Liang Chun Kai Ling Yun Cheng A. Obolenskiy Yudong Liu Rohan Pandey Alex Wilf Louis-Philippe Morency Ruslan Salakhutdinov OffRL 19 7 0 07 Jun 2023
Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment Tianshu Yu Haoyu Gao Ting-En Lin Min Yang Yuchuan Wu Wen-Cheng Ma Chao Wang Fei Huang Yongbin Li 11 18 0 19 May 2023
Unsupervised Dialogue Topic Segmentation with Topic-aware Utterance Representation Haoyu Gao Rui Wang Ting-En Lin Yuchuan Wu Min Yang Fei Huang Yongbin Li 19 10 0 04 May 2023
SeqAug: Sequential Feature Resampling as a modality agnostic augmentation method Efthymios Georgiou Alexandros Potamianos 9 1 0 03 May 2023
CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos Seungju Han Jack Hessel Nouha Dziri Yejin Choi Youngjae Yu VGen 17 16 0 17 Mar 2023
Emotion Prediction Oriented method with Multiple Supervisions for Emotion-Cause Pair Extraction Guimin Hu Yi Zhao Guangming Lu 8 4 0 24 Feb 2023
Empathetic Response Generation via Emotion Cause Transition Graph Yushan Qian Bo Wang Ting-En Lin Yinhe Zheng Yingfu Zhu Dongming Zhao Yuexian Hou Yuchuan Wu Yongbin Li 27 15 0 23 Feb 2023
MIntRec: A New Dataset for Multimodal Intent Recognition Hanlei Zhang Huanlin Xu Xin Eric Wang Qianrui Zhou Shaojie Zhao Jiayan Teng 25 23 0 09 Sep 2022
VISTANet: VIsual Spoken Textual Additive Net for Interpretable Multimodal Emotion Recognition Puneet Kumar Sarthak Malik Balasubramanian Raman Xiaobai Li 13 2 0 24 Aug 2022
Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systems Ting-En Lin Yuchuan Wu Feiling Huang Luo Si Jian Sun Yongbin Li 34 22 0 30 May 2022
A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots Sai Zhang Y. Hu Yuchuan Wu Jiaman Wu Yongbin Li Jian Sun Caixia Yuan Xiaojie Wang 26 15 0 21 Mar 2022
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation Zhengkun Zhang Xiaojun Meng Yasheng Wang Xin Jiang Qun Liu Zhenglu Yang 26 32 0 13 Sep 2021
MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversation Jingwen Hu Yuchen Liu Jinming Zhao Qin Jin 26 196 0 14 Jul 2021
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis Wenmeng Yu Hua Xu Ziqi Yuan Jiele Wu SSL 45 430 0 09 Feb 2021
A Post-processing Method for Detecting Unknown Intent of Dialogue System via Pre-trained Deep Neural Network Classifier Ting-En Lin Hua Xu 31 31 0 07 Mar 2020