Gesticulator: A framework for semantically-aware speech-driven gesture generation

25 January 2020

Papers citing "Gesticulator: A framework for semantically-aware speech-driven gesture generation"

29 / 29 papers shown

Title
Synchronize Dual Hands for Physics-Based Dexterous Guitar Playing Pei Xu Ruocheng Wang 53 2 0 20 Feb 2025
Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents Anna Deichler Simon Alexanderson Jonas Beskow 29 0 0 07 Aug 2024
Investigating the impact of 2D gesture representation on co-speech gesture generation Teo Guichoux Laure Soulier Nicolas Obin Catherine Pelachaud SLR 19 0 0 21 Jun 2024
Fake it to make it: Using synthetic data to remedy the data shortage in joint multimodal speech-and-gesture synthesis Shivam Mehta Anna Deichler Jim O'Regan Birger Moëll Jonas Beskow G. Henter Simon Alexanderson 34 4 0 30 Apr 2024
SpeechAct: Towards Generating Whole-body Motion from Speech Jinsong Zhang Minjie Zhu Yuxiang Zhang Yebin Liu Kun Li 21 0 0 29 Nov 2023
BodyFormer: Semantics-guided 3D Body Gesture Synthesis with Transformer Kunkun Pang Dafei Qin Yingruo Fan Julian Habekost Takaaki Shiratori Junichi Yamagishi Taku Komura SLR ViT 14 19 0 07 Sep 2023
Audio is all in one: speech-driven gesture synthetics using WavLM pre-trained model Fan Zhang Naye Ji Fuxing Gao Siyuan Zhao Zhaohan Wang Shunman Li 24 0 0 11 Aug 2023
Human Motion Generation: A Survey Wentao Zhu Xiaoxuan Ma Dongwoo Ro Hai Ci Jinlu Zhang Jiaxin Shi Feng Gao Qi Tian Yizhou Wang VGen 26 51 0 20 Jul 2023
QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation Sicheng Yang Zhiyong Wu Minglei Li Zhensong Zhang Lei Hao Weihong Bao Hao-Wen Zhuang SLR 16 40 0 18 May 2023
Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022 Taras Kucherenko Pieter Wolfert Youngwoo Yoon Carla Viegas Teodor Nikolov Mihail Tsakov G. Henter 30 24 0 15 Mar 2023
A Comprehensive Review of Data-Driven Co-Speech Gesture Generation Simbarashe Nyatsanga Taras Kucherenko Chaitanya Ahuja G. Henter Michael Neff SLR 33 90 0 13 Jan 2023
Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models Simon Alexanderson Rajmund Nagy Jonas Beskow G. Henter DiffM VGen 22 165 0 17 Nov 2022
Evaluating Data-Driven Co-Speech Gestures of Embodied Conversational Agents through Real-Time Interaction Yuan He André Pereira Taras Kucherenko 14 10 0 13 Oct 2022
Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddings Tenglong Ao Qingzhe Gao Yuke Lou Baoquan Chen Libin Liu SLR 25 59 0 04 Oct 2022
ZeroEGGS: Zero-shot Example-based Gesture Generation from Speech Saeed Ghorbani Ylva Ferstl Daniel Holden N. Troje M. Carbonneau 28 79 0 15 Sep 2022
Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding Mireille Fares Michele Grimaldi Catherine Pelachaud Nicolas Obin 25 17 0 03 Aug 2022
Audio-driven Neural Gesture Reenactment with Video Motion Graphs Yang Zhou Jimei Yang Dingzeyu Li Jun Saito Deepali Aneja E. Kalogerakis DiffM SLR 34 20 0 23 Jul 2022
Representation Learning of Image Schema Fajrian Yunus Chloé Clavel Catherine Pelachaud OCL 8 0 0 17 Jul 2022
Analysis of Co-Laughter Gesture Relationship on RGB videos in Dyadic Conversation Contex Hugo Bohy Ahmad Hammoudeh Antoine Maiorca Stéphane Dupont Thierry Dutoit 6 2 0 20 May 2022
To Rate or Not To Rate: Investigating Evaluation Methods for Generated Co-Speech Gestures Pieter Wolfert J. Girard Taras Kucherenko Tony Belpaeme 24 16 0 12 Aug 2021
SGToolkit: An Interactive Gesture Authoring Toolkit for Embodied Conversational Agents Youngwoo Yoon Keunwoo Park Minsu Jang Jaehong Kim Geehyuk Lee VGen SLR 19 19 0 10 Aug 2021
Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learning Uttaran Bhattacharya Elizabeth Childs Nicholas Rewkowski Dinesh Manocha SLR GAN 8 80 0 31 Jul 2021
Speech2Properties2Gestures: Gesture-Property Prediction as a Tool for Generating Representational Gestures from Speech Taras Kucherenko Rajmund Nagy Patrik Jonell Michael Neff Hedvig Kjellström G. Henter 22 18 0 28 Jun 2021
Toward Automated Generation of Affective Gestures from Text:A Theory-Driven Approach Micol Spitale Maja J. Matarić 20 1 0 04 Mar 2021
A Framework for Integrating Gesture Generation Models into Interactive Conversational Agents Rajmund Nagy Taras Kucherenko Birger Moell André Pereira Hedvig Kjellström Ulysses Bernardet 12 12 0 24 Feb 2021
Learning Speech-driven 3D Conversational Gestures from Video I. Habibie Weipeng Xu Dushyant Mehta Lingjie Liu Hans-Peter Seidel Gerard Pons-Moll Mohamed A. Elgharib Christian Theobalt SLR CVBM 3DH 40 106 0 13 Feb 2021
A Review of Evaluation Practices of Gesture Generation in Embodied Conversational Agents Pieter Wolfert Nicole L. Robinson Tony Belpaeme 49 50 0 11 Jan 2021
Quantitative analysis of robot gesticulation behavior Unai Zabala I. Rodriguez J. M. Martínez-Otzeta I. Irigoien E. Lazkano SLR 10 10 0 22 Oct 2020
Geometry-guided Dense Perspective Network for Speech-Driven Facial Animation Jing-ying Liu Binyuan Hui Kun Li Yunke Liu Yu-Kun Lai Yuxiang Zhang Yebin Liu Jingyu Yang 3DH CVBM 6 22 0 23 Aug 2020