MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations

5 October 2018

Papers citing "MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations"

50 / 403 papers shown

Title
Multi-modal Speech Emotion Recognition via Feature Distribution Adaptation Network Shaokai Li Yixuan Ji Peng Song Haoqin Sun Wenming Zheng 26 0 0 29 Oct 2024
MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark S. Sakshi Utkarsh Tyagi Sonal Kumar Ashish Seth Ramaneswaran Selvakumar Oriol Nieto R. Duraiswami Sreyan Ghosh Dinesh Manocha AuLLM ELM 75 22 0 24 Oct 2024
A Survey of Multimodal Sarcasm Detection Shafkat Farabi Tharindu Ranasinghe Diptesh Kanojia Yu Kong Marcos Zampieri 26 4 0 24 Oct 2024
UGotMe: An Embodied System for Affective Human-Robot Interaction Peizhen Li Longbing Cao Xiao-Ming Wu Xiaohan Yu Runze Yang 31 0 0 24 Oct 2024
How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making? Kenza Benkirane Jackie Kay Maria Perez-Ortiz 28 0 0 21 Oct 2024
Enhancing Multimodal Affective Analysis with Learned Live Comment Features Zhaoyuan Deng Amith Ananthram Kathleen McKeown 24 0 0 21 Oct 2024
You Shall Know a Tool by the Traces it Leaves: The Predictability of Sentiment Analysis Tools Daniel Baumartz Mevlut Bagci Alexander Henlein Maxim Konca Andy Lucking Alexander Mehler 24 0 0 18 Oct 2024
Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modeling Rui Liu Zhenqi Jia Jie Yang Yifan Hu H. Li 29 2 0 12 Oct 2024
Self-Powered LLM Modality Expansion for Large Speech-Text Models Tengfei Yu Xuebo Liu Zhiyi Hou Liang Ding Dacheng Tao Min Zhang 32 0 0 04 Oct 2024
FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model Yichen Lu Jiaqi Song Chao-Han Huck Yang Shinji Watanabe 23 0 0 03 Oct 2024
Distilling an End-to-End Voice Assistant Without Instruction Training Data William B. Held Ella Li Michael Joseph Ryan Weiyan Shi Yanzhe Zhang Diyi Yang AuLLM 47 8 0 03 Oct 2024
Mixed-Session Conversation with Egocentric Memory Jihyoung Jang Taeyoung Kim Hyounghun Kim 30 0 0 03 Oct 2024
Open-vocabulary Multimodal Emotion Recognition: Dataset, Metric, and Benchmark Zheng Lian Haiyang Sun Guoying Zhao Lan Chen Haoyu Chen ... Rui Liu Shan Liang Ya Li Jiangyan Yi Jianhua Tao VLM 32 0 0 02 Oct 2024
EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control Haozhe Chen Run Chen Julia Hirschberg 21 3 0 01 Oct 2024
Beyond Single-Audio: Advancing Multi-Audio Processing in Audio Large Language Models Yiming Chen Xianghu Yue Xiaoxue Gao Chen Zhang L. F. D’Haro R. Tan Haizhou Li AuLLM 32 0 0 27 Sep 2024
Facial Expression-Enhanced TTS: Combining Face Representation and Emotion Intensity for Adaptive Speech Yunji Chu Yunseob Shim Unsang Park 31 0 0 24 Sep 2024
Personalized Speech Emotion Recognition in Human-Robot Interaction using Vision Transformers Ruchik Mishra Andrew Frye M. M. Rayguru Dan O. Popa 39 1 0 16 Sep 2024
Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation Cheng Charles Ma Kevin Hyekang Joo Alexandria K. Vail Sunreeta Bhattacharya Álvaro Fernández García Kailana Baker-Matsuoka Sheryl Mathew Lori L. Holt Fernando De la Torre 49 3 0 13 Sep 2024
Recent Trends of Multimodal Affective Computing: A Survey from NLP Perspective Guimin Hu Yi Xin Weimin Lyu Haojian Huang Chang Sun Zehan Zhu Lin Gui Ruichu Cai Erik Cambria Hasti Seifi 32 5 0 11 Sep 2024
MoWE-Audio: Multitask AudioLLMs with Mixture of Weak Encoders W. Zhang Shuo Sun Bin Wang Xunlong Zou Zhuohan Liu Yingxu He Geyu Lin Nancy F. Chen A. Aw AuLLM 67 1 0 10 Sep 2024
HyperSMOTE: A Hypergraph-based Oversampling Approach for Imbalanced Node Classifications Ziming Zhao Tiehua Zhang Zijian Yi Zhishu Shen 28 0 0 09 Sep 2024
Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in Conversations Xinran Li Xiaomao Fan Q. Wu Xiaojiang Peng Yongqian Li Mamba 34 1 0 08 Sep 2024
Towards Social AI: A Survey on Understanding Social Interactions Sangmin Lee Minzhi Li Bolin Lai Wenqi Jia Fiona Ryan ... Ozgur Kara Bikram Boote Weiyan Shi Diyi Yang James M. Rehg 39 4 0 05 Sep 2024
Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysis Xianbing Zhao Lizhen Qu Tao Feng Jianfei Cai Buzhou Tang 53 0 0 05 Sep 2024
EMO-LLaMA: Enhancing Facial Emotion Understanding with Instruction Tuning Bohao Xing Zitong Yu Xin Liu Kaishen Yuan Qilang Ye Weicheng Xie Huanjing Yue Jingyu Yang Heikki Kälviäinen 48 10 0 21 Aug 2024
SZTU-CMU at MER2024: Improving Emotion-LLaMA with Conv-Attention for Multimodal Emotion Recognition Zebang Cheng Shuyuan Tu Dawei Huang Minghan Li Xiaojiang Peng Zhi-Qi Cheng Alexander G. Hauptmann 53 2 0 20 Aug 2024
PanoSent: A Panoptic Sextuple Extraction Benchmark for Multimodal Conversational Aspect-based Sentiment Analysis Meng Luo Hao Fei Bobo Li Shengqiong Wu Qian Liu Soujanya Poria Erik Cambria M. Lee W. Hsu 28 7 0 18 Aug 2024
EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamics Chenwei Wan Matthieu Labeau Chloé Clavel 40 0 0 16 Aug 2024
SER Evals: In-domain and Out-of-domain Benchmarking for Speech Emotion Recognition Mohamed Osman Daniel Z. Kaplan Tamer Nadeem 31 1 0 14 Aug 2024
End-to-end Semantic-centric Video-based Multimodal Affective Computing Ronghao Lin Ying Zeng Sijie Mai Haifeng Hu VGen 45 0 0 14 Aug 2024
BI-MDRG: Bridging Image History in Multimodal Dialogue Response Generation Hee Suk Yoon Eunseop Yoon Joshua Tian Jin Tee Kang Zhang Yu-Jung Heo Du-Seong Chang Chang D. Yoo 36 3 0 12 Aug 2024
Adapting General Disentanglement-Based Speaker Anonymization for Enhanced Emotion Preservation Xiaoxiao Miao Yuxiang Zhang Xin Wang N. Tomashenko D. Soh Ian Mcloughlin 42 1 0 12 Aug 2024
Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models Philipp Müller Alexander Heimerl Sayed Muddashir Hossain Lea Siegel Jan Alexandersson Patrick Gebhard Elisabeth André T. Schneeberger 31 0 0 08 Aug 2024
Generative Expressive Conversational Speech Synthesis Rui Liu Yifan Hu Yi Ren Xiang Yin Haizhou Li 58 5 0 31 Jul 2024
Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal Nuances Mieko Ochi Ziwei Gong D. Komura Pengyuan Shi Kaan Donbekci Julia Hirschberg 44 10 0 31 Jul 2024
Multimodal Machine Learning in Mental Health: A Survey of Data, Algorithms, and Challenges Zahraa Al Sahili Ioannis Patras Matthew Purver 35 0 0 23 Jul 2024
Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversation Tao Meng Fuchen Zhang Yuntao Shou Hongen Shao Wei Ai Keqin Li 40 16 0 23 Jul 2024
Qwen2-Audio Technical Report Yunfei Chu Jin Xu Qian Yang Haojie Wei Xipin Wei ... Yuanjun Lv Jinzheng He Junyang Lin Chang Zhou Jingren Zhou AuLLM VLM 37 105 0 15 Jul 2024
BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks Jieying Xue Minh Phuong Nguyen Blake Matheny Le Minh Nguyen 37 6 0 05 Jul 2024
FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs Keyu An Qian Chen Chong Deng Zhihao Du Changfeng Gao ... Bin Zhang Qinglin Zhang Shiliang Zhang Nan Zhao Siqi Zheng AuLLM 32 44 0 04 Jul 2024
Emotion and Intent Joint Understanding in Multimodal Conversation: A Benchmarking Dataset Rui Liu Haolin Zuo Zheng Lian Xiaofen Xing Björn W. Schuller Haizhou Li 42 4 0 03 Jul 2024
MasonTigers at SemEval-2024 Task 10: Emotion Discovery and Flip Reasoning in Conversation with Ensemble of Transformers and Prompting Al Nahian Bin Emran Amrita Ganguly Sadiya Sayara Chowdhury Puspo Nishat Raihan Dhiman Goswami LRM 21 0 0 30 Jun 2024
A Simple Attention-Based Mechanism for Bimodal Emotion Classification Mazen Elabd S. Jaf 19 0 0 28 Jun 2024
Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations Ritam Dutt Zhen Wu Kelly Shi Divyanshu Sheth Prakhar Gupta Carolyn Rose 46 2 0 27 Jun 2024
Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversations Yuntao Shou Wei Ai JiaYi Du Tao Meng Haiyan Liu Nan Yin 53 16 0 27 Jun 2024
AudioBench: A Universal Benchmark for Audio Large Language Models Bin Wang Xunlong Zou Geyu Lin Shri Kiran Srinivasan Zhuohan Liu Wenyu Zhang Zhengyuan Liu AiTi Aw Nancy F. Chen AuLLM ELM LM&MA 92 20 0 23 Jun 2024
Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction Haoqiu Yan Yongxin Zhu Kai Zheng Bing Liu Haoyu Cao Deqiang Jiang Linli Xu AuLLM 38 4 0 18 Jun 2024
A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editing Ming Meng Yufei Zhao Bo Zhang Yonggui Zhu Weimin Shi Maxwell Wen Zhaoxin Fan VGen 42 1 0 15 Jun 2024
What Does it Take to Generalize SER Model Across Datasets? A Comprehensive Benchmark Adham Ibrahim Shady Shehata Ajinkya Kulkarni Mukhtar Mohamed Muhammad Abdul-Mageed 33 2 0 14 Jun 2024
Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey Hao Yang Yanyan Zhao Yang Wu Shilong Wang Tian Zheng Hongbo Zhang Zongyang Ma Wanxiang Che Bing Qin 42 8 0 12 Jun 2024