Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2009.02119
Cited By
Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identity
ACM Transactions on Graphics (TOG), 2020
4 September 2020
Youngwoo Yoon
Bok Cha
Joo-Haeng Lee
Minsu Jang
Jaeyeon Lee
Jaehong Kim
Geehyuk Lee
Re-assign community
ArXiv (abs)
PDF
HTML
Github (264★)
Papers citing
"Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identity"
50 / 168 papers shown
ACT2G: Attention-based Contrastive Learning for Text-to-Gesture Generation
Proceedings of the ACM on Computer Graphics and Interactive Techniques (PACMCGIT), 2023
Hitoshi Teshima
Naoki Wake
Diego Thomas
Yuta Nakashima
Hiroshi Kawasaki
Katsushi Ikeuchi
177
0
0
28 Sep 2023
The Importance of Multimodal Emotion Conditioning and Affect Consistency for Embodied Conversational Agents
International Conference on Intelligent User Interfaces (IUI), 2023
Che-Jui Chang
Samuel S. Sohn
Sen Zhang
R. Jayashankar
Muhammad Usman
Mubbasir Kapadia
261
11
0
26 Sep 2023
Autoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representations
Eui Jun Hwang
Huije Lee
Jong C. Park
SLR
292
10
0
21 Sep 2023
Speech-Gesture GAN: Gesture Generation for Robots and Embodied Agents
IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 2023
Carson Yu Liu
Gelareh Mohammadi
Yang Song
W. Johal
145
3
0
17 Sep 2023
LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation
IEEE International Conference on Computer Vision (ICCV), 2023
Yihao Zhi
Xiaodong Cun
Xuelin Chen
Xi Shen
Wen Guo
Shaoli Huang
Shenghua Gao
132
38
0
17 Sep 2023
Towards the generation of synchronized and believable non-verbal facial behaviors of a talking virtual agent
Alice Delbosc
M. Ochs
Nicolas Sabouret
Brian Ravenet
Stéphane Ayache
316
13
0
15 Sep 2023
UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletons
ACM Multimedia (ACM MM), 2023
Sicheng Yang
Zehao Wang
Zhiyong Wu
Minglei Li
Zhensong Zhang
...
Lei Hao
Songcen Xu
Xiaofei Wu
Changpeng Yang
Zonghong Dai
DiffM
255
17
0
13 Sep 2023
BodyFormer: Semantics-guided 3D Body Gesture Synthesis with Transformer
ACM Transactions on Graphics (TOG), 2023
Kunkun Pang
Dafei Qin
Yingruo Fan
Julian Habekost
Takaaki Shiratori
Junichi Yamagishi
Taku Komura
SLR
ViT
136
26
0
07 Sep 2023
MCM: Multi-condition Motion Synthesis Framework for Multi-scenario
Zeyu Ling
Bo Han
Yongkang Wong
Mohan Kankanhalli
Weidong Geng
DiffM
168
8
0
06 Sep 2023
C2G2: Controllable Co-speech Gesture Generation with Latent Diffusion Model
Longbin Ji
Pengfei Wei
Yi Ren
Jinglin Liu
Chen Zhang
Xiang Yin
DiffM
146
3
0
29 Aug 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey
ACM Computing Surveys (ACM Comput. Surv.), 2023
Lin Geng Foo
Hossein Rahmani
Jing Liu
749
47
0
27 Aug 2023
The DiffuseStyleGesture+ entry to the GENEA Challenge 2023
International Conference on Multimodal Interaction (ICMI), 2023
Sicheng Yang
Haiwei Xue
Zhensong Zhang
Minglei Li
Zhiyong Wu
Xiaofei Wu
Songcen Xu
Zonghong Dai
DiffM
277
25
0
26 Aug 2023
The GENEA Challenge 2023: A large scale evaluation of gesture generation models in monadic and dyadic settings
International Conference on Multimodal Interaction (ICMI), 2023
Taras Kucherenko
Rajmund Nagy
Youngwoo Yoon
Jieyeon Woo
Teodor Nikolov
Mihail Tsakov
G. Henter
VGen
198
60
0
24 Aug 2023
A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation
Li Liu
Lufei Gao
Wen-Ling Lei
Fengji Ma
Xiaotian Lin
Jin-Tao Wang
CVBM
199
9
0
17 Aug 2023
TranSTYLer: Multimodal Behavioral Style Transfer for Facial and Body Gestures Generation
Speech Communication (Speech Commun.), 2023
Mireille Fares
Catherine Pelachaud
Nicolas Obin
182
1
0
08 Aug 2023
Human Motion Generation: A Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Wentao Zhu
Xiaoxuan Ma
Dongwoo Ro
Hai Ci
Jinlu Zhang
Jiaxin Shi
Feng Gao
Qi Tian
Yizhou Wang
VGen
501
106
0
20 Jul 2023
Augmented Co-Speech Gesture Generation: Including Form and Meaning Features to Guide Learning-Based Gesture Synthesis
International Conference on Intelligent Virtual Agents (IVA), 2023
Hendric Voss
S. Kopp
SLR
186
11
0
13 Jul 2023
The Ethical Implications of Generative Audio Models: A Systematic Literature Review
AAAI/ACM Conference on AI, Ethics, and Society (AIES), 2023
J. Barnett
255
48
0
07 Jul 2023
EMoG: Synthesizing Emotive Co-speech 3D Gesture with Diffusion Model
Li-Ping Yin
Yijun Wang
Tianyu He
Jinming Liu
Wei Zhao
Bohan Li
Xin Jin
Jianxin Lin
DiffM
183
20
0
20 Jun 2023
Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
Speech Synthesis Workshop (SSW), 2023
Shivam Mehta
Siyang Wang
Simon Alexanderson
Jonas Beskow
Éva Székely
G. Henter
DiffM
242
15
0
15 Jun 2023
EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation
IEEE transactions on multimedia (IEEE TMM), 2023
Xingqun Qi
Chen Liu
Lincheng Li
Jie Hou
Haoran Xin
Xin Yu
SLR
285
43
0
30 May 2023
MPE4G: Multimodal Pretrained Encoder for Co-Speech Gesture Generation
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Gwantae Kim
Seong-Soo Noh
Insung Ham
Hanseok Ko
SLR
136
10
0
25 May 2023
QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation
Computer Vision and Pattern Recognition (CVPR), 2023
Sicheng Yang
Zhiyong Wu
Minglei Li
Zhensong Zhang
Lei Hao
Weihong Bao
Hao-Wen Zhuang
SLR
206
55
0
18 May 2023
DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Models
International Joint Conference on Artificial Intelligence (IJCAI), 2023
Sicheng Yang
Zhiyong Wu
Minglei Li
Zhensong Zhang
Lei Hao
Weihong Bao
Ming Cheng
Long Xiao
208
104
0
08 May 2023
AQ-GT: a Temporally Aligned and Quantized GRU-Transformer for Co-Speech Gesture Synthesis
International Conference on Multimodal Interaction (ICMI), 2023
Hendric Voss
S. Kopp
SLR
270
12
0
02 May 2023
GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents
ACM Transactions on Graphics (TOG), 2023
Tenglong Ao
Zeyi Zhang
Libin Liu
DiffM
VGen
285
192
0
26 Mar 2023
GesGPT: Speech Gesture Synthesis With Text Parsing from ChatGPT
IEEE Robotics and Automation Letters (RA-L), 2023
Nan Gao
Zeyu Zhao
Zhi Zeng
Shuwu Zhang
Dongdong Weng
Yihua Bao
231
12
0
23 Mar 2023
Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation
Computer Vision and Pattern Recognition (CVPR), 2023
Lingting Zhu
Xian Liu
Xuanyu Liu
Rui Qian
Ziwei Liu
Lequan Yu
268
154
0
16 Mar 2023
Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022
ACM Transactions on Graphics (TOG), 2023
Taras Kucherenko
Pieter Wolfert
Youngwoo Yoon
Carla Viegas
Teodor Nikolov
Mihail Tsakov
G. Henter
176
35
0
15 Mar 2023
Co-Speech Gesture Synthesis using Discrete Gesture Token Learning
IEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2023
Shuhong Lu
Youngwoo Yoon
Andrew W. Feng
SLR
155
14
0
04 Mar 2023
Diverse 3D Hand Gesture Prediction from Body Dynamics by Bilateral Hand Disentanglement
Computer Vision and Pattern Recognition (CVPR), 2023
Xingqun Qi
Chen Liu
Muyi Sun
Lincheng Li
Changjie Fan
Xin Yu
SLR
221
21
0
03 Mar 2023
DanceAnyWay: Synthesizing Beat-Guided 3D Dances with Randomized Temporal Contrastive Learning
AAAI Conference on Artificial Intelligence (AAAI), 2023
Aneesh Bhattacharya
Manas Paranjape
Uttaran Bhattacharya
Aniket Bera
DiffM
278
4
0
30 Jan 2023
A Comprehensive Review of Data-Driven Co-Speech Gesture Generation
Simbarashe Nyatsanga
Taras Kucherenko
Chaitanya Ahuja
G. Henter
Michael Neff
SLR
422
129
0
13 Jan 2023
Generating Holistic 3D Human Motion from Speech
Computer Vision and Pattern Recognition (CVPR), 2022
Hongwei Yi
Hualin Liang
Yifei Liu
Qiong Cao
Yandong Wen
Timo Bolkart
Dacheng Tao
Michael J. Black
SLR
268
197
0
08 Dec 2022
Audio-Driven Co-Speech Gesture Video Generation
Neural Information Processing Systems (NeurIPS), 2022
Xian Liu
Qianyi Wu
Hang Zhou
Yuanqi Du
Wayne Wu
Dahua Lin
Ziwei Liu
SLR
VGen
278
67
0
05 Dec 2022
3d human motion generation from the text via gesture action classification and the autoregressive model
International Conference on Information Photonics (ICIP), 2022
Gwantae Kim
Youngsuk Ryu
Junyeop Lee
D. Han
Jeongmin Bae
Hanseok Ko
152
2
0
18 Nov 2022
Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models
ACM Transactions on Graphics (TOG), 2022
Simon Alexanderson
Rajmund Nagy
Jonas Beskow
G. Henter
DiffM
VGen
288
232
0
17 Nov 2022
Naturalistic Head Motion Generation from Speech
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022
Trisha Mittal
Zakaria Aldeneh
Masha Fedzechkina
Anurag Ranjan
B. Theobald
160
1
0
26 Oct 2022
Deep Gesture Generation for Social Robots Using Type-Specific Libraries
IEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2022
Hitoshi Teshima
Naoki Wake
Diego Thomas
Yuta Nakashima
Hiroshi Kawasaki
Katsushi Ikeuchi
SLR
132
8
0
13 Oct 2022
Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddings
ACM Transactions on Graphics (TOG), 2022
Tenglong Ao
Qingzhe Gao
Yuke Lou
Baoquan Chen
Libin Liu
SLR
306
77
0
04 Oct 2022
NEURAL MARIONETTE: A Transformer-based Multi-action Human Motion Synthesis System
Weiqiang Wang
Xuefei Zhe
Huan Chen
Di Kang
Tingguang Li
Ruizhi Chen
Linchao Bao
202
6
0
27 Sep 2022
ZeroEGGS: Zero-shot Example-based Gesture Generation from Speech
Saeed Ghorbani
Ylva Ferstl
Daniel Holden
N. Troje
M. Carbonneau
299
117
0
15 Sep 2022
The ReprGesture entry to the GENEA Challenge 2022
International Conference on Multimodal Interaction (ICMI), 2022
Sicheng Yang
Zhiyong Wu
Minglei Li
Mengchen Zhao
Jiuxin Lin
Liyang Chen
Weihong Bao
147
12
0
25 Aug 2022
The GENEA Challenge 2022: A large evaluation of data-driven co-speech gesture generation
International Conference on Multimodal Interaction (ICMI), 2022
Youngwoo Yoon
Pieter Wolfert
Taras Kucherenko
Carla Viegas
Teodor Nikolov
Mihail Tsakov
G. Henter
VGen
175
97
0
22 Aug 2022
Non-Autoregressive Sign Language Production via Knowledge Distillation
Eui Jun Hwang
Jung Ho Kim
Sukmin Cho
Jong C. Park
SLR
142
3
0
12 Aug 2022
Audio-driven Neural Gesture Reenactment with Video Motion Graphs
Computer Vision and Pattern Recognition (CVPR), 2022
Yang Zhou
Jimei Yang
Dingzeyu Li
Jun Saito
Deepali Aneja
E. Kalogerakis
DiffM
SLR
221
28
0
23 Jul 2022
Interaction Transformer for Human Reaction Generation
IEEE transactions on multimedia (IEEE TMM), 2022
Baptiste Chopin
Hao Tang
N. Otberdout
Mohamed Daoudi
Andrii Zadaianchuk
ViT
220
46
0
04 Jul 2022
Analysis of Co-Laughter Gesture Relationship on RGB videos in Dyadic Conversation Contex
Hugo Bohy
Ahmad Hammoudeh
Antoine Maiorca
Stéphane Dupont
Thierry Dutoit
75
3
0
20 May 2022
Evaluating the Quality of a Synthesized Motion with the Fréchet Motion Distance
Antoine Maiorca
Youngwoo Yoon
Thierry Dutoit
153
15
0
26 Apr 2022
Speaker Extraction with Co-Speech Gestures Cue
IEEE Signal Processing Letters (SPL), 2022
Zexu Pan
Xinyuan Qian
Haizhou Li
SLR
175
33
0
31 Mar 2022
Previous
1
2
3
4
Next
