Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with
Instruction Tuning

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

17 June 2024

Zebang Cheng

Zhi-Qi Cheng

Kai Wang

Zheng Lian

Xiaojiang Peng

Alexander G. Hauptmann

Papers citing "Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning"

13 / 13 papers shown

Title
VAEmo: Efficient Representation Learning for Visual-Audio Emotion with Knowledge Injection Hao Cheng Zhiwei Zhao Yichao He Zhenzhen Hu Jia Li M. Wang Richang Hong 36 0 0 05 May 2025
DEEMO: De-identity Multimodal Emotion Recognition and Reasoning Deng Li Bohao Xing Xin Liu Baiqiang Xia Bihan Wen H. Kalviainen VLM 68 0 0 28 Apr 2025
MultiMind: Enhancing Werewolf Agents with Multimodal Reasoning and Theory of Mind Z. Zhang Nuoqian Xiao Qi Chai Deheng Ye Hao Wang LLMAG LRM 88 0 0 25 Apr 2025
Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models Yuxiang Lin Jingdong Sun Zhi-Qi Cheng Jue Wang Haomin Liang Zebang Cheng Yifei Dong Jun-Yan He Xiaojiang Peng Xian-Sheng Hua 39 0 0 10 Apr 2025
StimuVAR: Spatiotemporal Stimuli-aware Video Affective Reasoning with Multimodal Large Language Models Y. Guo Faizan Siddiqui Yang Zhao Rama Chellappa Shao-Yuan Lo LRM 24 2 0 31 Aug 2024
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection Bin Lin Yang Ye Bin Zhu Jiaxi Cui Munan Ning Peng Jin Li-ming Yuan VLM MLLM 185 576 0 16 Nov 2023
MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning Jun Chen Deyao Zhu Xiaoqian Shen Xiang Li Zechun Liu Pengchuan Zhang Raghuraman Krishnamoorthi Vikas Chandra Yunyang Xiong Mohamed Elhoseiny MLLM 154 280 0 14 Oct 2023
Learning Emotion Representations from Verbal and Nonverbal Communication Sitao Zhang Yimu Pan J. Z. Wang VLM 45 21 0 22 May 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 244 4,186 0 30 Jan 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,337 0 11 Nov 2021
LSSED: a large-scale dataset and benchmark for speech emotion recognition Weiquan Fan Xiangmin Xu Xiaofen Xing Weidong Chen Dongyan Huang 37 32 0 30 Jan 2021
Exploring Emotion Features and Fusion Strategies for Audio-Video Emotion Recognition Hengshun Zhou Debin Meng Yuanyuan Zhang Xiaojiang Peng Jun Du Kai Wang Yu Qiao 29 64 0 27 Dec 2020