To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations

5 October 2019

Chaitanya Ahuja

Shugao Ma

Louis-Philippe Morency

Yaser Sheikh

ArXiv (abs)PDF HTML

Papers citing "To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations"

27 / 27 papers shown

Title
Latent Behavior Diffusion for Sequential Reaction Generation in Dyadic Setting Minh-Duc Nguyen Hyung-Jeong Yang Soo-Hyung Kim Ji-Eun Shin Seung-Won Kim DiffM 131 1 0 12 May 2025
DiTaiListener: Controllable High Fidelity Listener Video Generation with Diffusion Maksim Siniukov Di Chang Minh Tran Hongkun Gong Ashutosh Chaubey Mohammad Soleymani DiffM VGen 162 1 0 05 Apr 2025
No Joke: An Embodied Conversational Agent Greeting Older Adults with Humour or a Smile Unrelated to Initial Acceptance Ge Li Katie Seaborn 46 1 0 14 May 2024
Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communication Mingze Sun Chao Xu Xinyu Jiang Yang Liu Baigui Sun Ruqi Huang 121 7 0 28 Mar 2024
Dyadic Interaction Modeling for Social Behavior Generation Minh Tran Di Chang Maksim Siniukov Mohammad Soleymani VGen 152 13 0 14 Mar 2024
From Audio to Photoreal Embodiment: Synthesizing Humans in Conversations Evonne Ng Javier Romero Timur M. Bagautdinov Shaojie Bai Trevor Darrell Angjoo Kanazawa Alexander Richard VGen 109 52 0 03 Jan 2024
AgentAvatar: Disentangling Planning, Driving and Rendering for Photorealistic Avatar Agents Duomin Wang Bin Dai Yu Deng Baoyuan Wang VGen 182 9 0 29 Nov 2023
ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions Anindita Ghosh Rishabh Dabral Vladislav Golyanik Christian Theobalt Philipp Slusallek 151 34 0 28 Nov 2023
Emotional Listener Portrait: Neural Listener Head Generation with Emotion Luchuan Song Guojun Yin Zhenchao Jin Xiaoyi Dong Chenliang Xu 146 16 0 29 Sep 2023
Can Language Models Learn to Listen? Evonne Ng Sanjay Subramanian Dan Klein Angjoo Kanazawa Trevor Darrell Shiry Ginosar 128 28 0 21 Aug 2023
ZS-MSTM: Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding Mireille Fares Catherine Pelachaud Nicolas Obin 79 0 0 22 May 2023
A Comprehensive Review of Data-Driven Co-Speech Gesture Generation Simbarashe Nyatsanga Taras Kucherenko Chaitanya Ahuja G. Henter Michael Neff SLR 210 104 0 13 Jan 2023
Learning in Audio-visual Context: A Review, Analysis, and New Perspective Yake Wei Di Hu Yapeng Tian Xuelong Li 188 61 0 20 Aug 2022
Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding Mireille Fares Michele Grimaldi Catherine Pelachaud Nicolas Obin 118 18 0 03 Aug 2022
A Probabilistic Model Of Interaction Dynamics for Dyadic Face-to-Face Settings Renke Wang Ifeoma Nwogu CVBM 80 0 0 10 Jul 2022
Interaction Transformer for Human Reaction Generation Baptiste Chopin Hao Tang N. Otberdout Mohamed Daoudi N. Sebe ViT 125 32 0 04 Jul 2022
Why Did This Model Forecast This Future? Closed-Form Temporal Saliency Towards Causal Explanations of Probabilistic Forecasts Chirag Raman Hayley Hung Marco Loog 113 3 0 01 Jun 2022
Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion Evonne Ng Hanbyul Joo Liwen Hu Hao Li Trevor Darrell Angjoo Kanazawa Shiry Ginosar VGen 102 107 0 18 Apr 2022
Comparison of Spatio-Temporal Models for Human Motion and Pose Forecasting in Face-to-Face Interaction Scenarios German Barquero Johnny Núnez Zhen Xu Sergio Escalera Wei-Wei Tu Isabelle M Guyon Cristina Palmero CVBM 86 12 0 07 Mar 2022
Didn't see that coming: a survey on non-verbal social human behavior forecasting German Barquero Johnny Núnez Sergio Escalera Zhen Xu Wei-Wei Tu Isabelle M Guyon Cristina Palmero AI4TS 103 21 0 04 Mar 2022
Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis Tong Sha Wei Zhang T. Shen Zhoujun Li Tao Mei 102 43 0 05 Sep 2021
Social Processes: Self-Supervised Meta-Learning over Conversational Groups for Forecasting Nonverbal Social Cues Chirag Raman Hayley Hung Marco Loog AI4TS 53 10 0 28 Jul 2021
Context-Aware Personality Inference in Dyadic Scenarios: Introducing the UDIVA Dataset Cristina Palmero Javier Selva Sorina Smeureanu Julio C. S. Jacques Junior Albert Clapés ... Zejian Zhang D. Gallardo-Pujol G. Guilera D. Leiva Sergio Escalera 111 57 0 28 Dec 2020
Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach Chaitanya Ahuja Dong Won Lee Y. Nakano Louis-Philippe Morency 105 110 0 24 Jul 2020
Moving fast and slow: Analysis of representations and post-processing in speech-driven automatic gesture generation Taras Kucherenko Dai Hasegawa Naoshi Kaneko G. Henter Hedvig Kjellström 151 43 0 16 Jul 2020
Let's Face It: Probabilistic Multi-modal Interlocutor-aware Generation of Facial Gestures in Dyadic Settings Patrik Jonell Taras Kucherenko G. Henter Jonas Beskow CVBM 220 61 0 11 Jun 2020
Gesticulator: A framework for semantically-aware speech-driven gesture generation Taras Kucherenko Patrik Jonell S. V. Waveren G. Henter Simon Alexanderson Iolanda Leite Hedvig Kjellström SLR 183 185 0 25 Jan 2020