Diffusion-Based Co-Speech Gesture Generation Using Joint Text and Audio Representation

International Conference on Multimodal Interaction (ICMI), 2023

11 September 2023

Papers citing "Diffusion-Based Co-Speech Gesture Generation Using Joint Text and Audio Representation"

20 / 20 papers shown

Title
Towards Reliable Human Evaluations in Gesture Generation: Insights from a Community-Driven State-of-the-Art Benchmark Rajmund Nagy Hendric Voss Thanh Hoang-Minh Mihail Tsakov Teodor Nikolov ... R. Mcdonnell Michael Neff Taras Kucherenko Youngwoo Yoon G. Henter EGVM VGen 298 0 0 03 Nov 2025
Gesture Evaluation in Virtual Reality Axel Wiebe Werner Jonas Beskow Anna Deichler 48 4 0 16 Sep 2025
Intentional Gesture: Deliver Your Intentions with Gestures for Speech Pinxin Liu Haiyang Liu Luchuan Song Chenliang Xu Chenliang Xu SLR 262 7 0 21 May 2025
Joint Co-Speech Gesture and Expressive Talking Face Generation using Diffusion with AdaptersIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024 S. Hogue Chenxu Zhang Yapeng Tian Xiaohu Guo DiffM 270 0 0 18 Dec 2024
Towards a GENEA Leaderboard -- an Extended, Living Benchmark for Evaluating and Advancing Conversational Motion Synthesis Rajmund Nagy Hendric Voss Youngwoo Yoon Taras Kucherenko Teodor Nikolov Thanh Hoang-Minh R. Mcdonnell Stefan Kopp Michael Neff G. Henter 161 4 0 08 Oct 2024
MM-Conv: A Multi-modal Conversational Dataset for Virtual Humans Anna Deichler Jim O'Regan Jonas Beskow 214 1 0 30 Sep 2024
2D or not 2D: How Does the Dimensionality of Gesture Representation Affect 3D Co-Speech Gesture Generation?International Conference on Intelligent Virtual Agents (IVA), 2024 Teo Guichoux Laure Soulier Nicolas Obin Catherine Pelachaud SLR 141 0 0 16 Sep 2024
DiffTED: One-shot Audio-driven TED Talk Video Generation with Diffusion-based Co-speech Gestures S. Hogue Chenxu Zhang Hamza Daruger Yapeng Tian Xiaohu Guo VGen 195 20 0 11 Sep 2024
Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual AgentsInternational Conference on Intelligent Virtual Agents (IVA), 2024 Anna Deichler Simon Alexanderson Jonas Beskow 95 1 0 07 Aug 2024
Investigating the impact of 2D gesture representation on co-speech gesture generation Teo Guichoux Laure Soulier Nicolas Obin Catherine Pelachaud SLR 230 0 0 21 Jun 2024
Semantic Gesticulator: Semantics-Aware Co-Speech Gesture SynthesisACM Transactions on Graphics (TOG), 2024 Zeyi Zhang Tenglong Ao Yuyao Zhang Qingzhe Gao Chuan Lin Baoquan Chen Libin Liu SLR 183 30 0 16 May 2024
LLAniMAtion: LLAMA Driven Gesture Animation John T. Windle Iain Matthews Sarah Taylor 195 0 0 13 May 2024
Fake it to make it: Using synthetic data to remedy the data shortage in joint multimodal speech-and-gesture synthesis Shivam Mehta Anna Deichler Jim O'Regan Birger Moëll Jonas Beskow G. Henter Simon Alexanderson 200 7 0 30 Apr 2024
MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space ModelsNeural Information Processing Systems (NeurIPS), 2024 Zunnan Xu Yukang Lin Haonan Han Sicheng Yang Ronghui Li Yachao Zhang Xiu Li Mamba 505 36 0 14 Mar 2024
LM2D: Lyrics- and Music-Driven Dance Synthesis Wenjie Yin Xuejiao Zhao Yi Yu Hang Yin Danica Kragic Mårten Björkman 203 4 0 14 Mar 2024
MotionScript: Natural Language Descriptions for Expressive 3D Human Motions Payam Jome Yazdian Rachel Lagasse Hamid Mohammadi Eric Liu Li Cheng Angelica Lim 380 18 0 19 Dec 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 217 149 0 11 Oct 2023
Unified speech and gesture synthesis using flow matchingIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 Shivam Mehta Ruibo Tu Simon Alexanderson Jonas Beskow Éva Székely G. Henter 200 5 0 08 Oct 2023
The GENEA Challenge 2023: A large scale evaluation of gesture generation models in monadic and dyadic settingsInternational Conference on Multimodal Interaction (ICMI), 2023 Taras Kucherenko Rajmund Nagy Youngwoo Yoon Jieyeon Woo Teodor Nikolov Mihail Tsakov G. Henter VGen 153 57 0 24 Aug 2023
Let's Face It: Probabilistic Multi-modal Interlocutor-aware Generation of Facial Gestures in Dyadic SettingsInternational Conference on Intelligent Virtual Agents (IVA), 2020 Patrik Jonell Taras Kucherenko G. Henter Jonas Beskow CVBM 375 65 0 11 Jun 2020