Capture, Learning, and Synthesis of 3D Speaking Styles

8 May 2019

Papers citing "Capture, Learning, and Synthesis of 3D Speaking Styles"

50 / 201 papers shown

Title
DF-3DFace: One-to-Many Speech Synchronized 3D Face Animation with Diffusion Se Jin Park Joanna Hong Minsu Kim Y. Ro 29 3 0 23 Aug 2023
A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation Li Liu Lufei Gao Wen-Ling Lei Fengji Ma Xiaotian Lin Jin-Tao Wang CVBM 25 5 0 17 Aug 2023
Speech-Driven 3D Face Animation with Composite and Regional Facial Movements Haozhe Wu Songtao Zhou Jia Jia Junliang Xing Qi Wen Xiang Wen CVBM 32 14 0 10 Aug 2023
VAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfer Liyang Chen Zhiyong Wu Runnan Li Weihong Bao Jun Ling Xuejiao Tan Sheng Zhao 21 5 0 09 Aug 2023
TranSTYLer: Multimodal Behavioral Style Transfer for Facial and Body Gestures Generation Mireille Fares Catherine Pelachaud Nicolas Obin 27 1 0 08 Aug 2023
UniBriVL: Robust Universal Representation and Generation of Audio Driven Diffusion Models Sen Fang Bowen Gao Yangjian Wu T. Teoh DiffM 18 1 0 29 Jul 2023
Rethinking Voice-Face Correlation: A Geometry View Xiang Li Yandong Wen Muqiao Yang Jinglu Wang Rita Singh Bhiksha Raj CVBM 3DH 20 6 0 26 Jul 2023
FACTS: Facial Animation Creation using the Transfer of Styles Jack D. Saunders Steven Caulkin Vinay P. Namboodiri 3DH CVBM 36 0 0 18 Jul 2023
Audio-Driven 3D Facial Animation from In-the-Wild Videos Liying Lu Tianke Zhang Yunfei Liu Xuangeng Chu Yu Li VGen 42 3 0 20 Jun 2023
SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces Ziqiao Peng Yihao Luo Yue Shi Hao-Xuan Xu Xiangyu Zhu Jun He Hongyan Liu Zhaoxin Fan 52 39 0 19 Jun 2023
Unsupervised Learning of Style-Aware Facial Animation from Real Acting Performances Wolfgang Paier A. Hilsmann Peter Eisert 3DH 27 10 0 16 Jun 2023
Emotional Speech-Driven Animation with Content-Emotion Disentanglement Radek Danvevcek Kiran Chhatre Shashank Tripathi Yandong Wen Michael J. Black Timo Bolkart 16 65 0 15 Jun 2023
Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads Generation Federico Nocentini Claudio Ferrari Stefano Berretti 22 7 0 02 Jun 2023
RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars Dongwei Pan Long Zhuo Jingtan Piao Huiwen Luo W. Cheng ... Chen Change Loy Chao Qian Wayne Wu Dahua Lin Kwan-Yee Lin 25 19 0 22 May 2023
ZS-MSTM: Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding Mireille Fares Catherine Pelachaud Nicolas Obin 17 0 0 22 May 2023
An Android Robot Head as Embodied Conversational Agent Marcel Heisler C. Becker-Asano LM&Ro LLMAG 27 0 0 18 May 2023
HACK: Learning a Parametric Head and Neck Model for High-fidelity Animation Longwen Zhang Zijun Zhao Xinzhou Cong Qixuan Zhang Shuqian Gu Yuchong Gao Ruichen Zheng Wei Yang Lan Xu Jingyi Yu 3DH 30 8 0 08 May 2023
NeRSemble: Multi-view Radiance Field Reconstruction of Human Heads Tobias Kirschstein Shenhan Qian Simon Giebenhain Tim Walter Matthias Nießner 3DH 25 87 0 04 May 2023
Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generator Chao Xu Shaoting Zhu Junwei Zhu Alexander I. Rudnicky Jiangning Zhang Ying Tai Yong Liu DiffM 48 14 0 04 May 2023
AVFace: Towards Detailed Audio-Visual 4D Face Reconstruction Aggelina Chatziagapi Dimitris Samaras 3DH CVBM 19 3 0 25 Apr 2023
Designing a realistic peer-like embodied conversational agent for supporting children's storytelling Zhixin Li Ying Xu SyDa 8 2 0 19 Apr 2023
Application of Self-Supervised Learning to MICA Model for Reconstructing Imperfect 3D Facial Structures P. D. Nguyen Thinh D. Le Duong Q. Nguyen Binh Duc Nguyen H. Nguyen-Xuan 18 1 0 08 Apr 2023
MusicFace: Music-driven Expressive Singing Face Synthesis Peng Liu W. Deng Hengda Li Jintai Wang Yinglin Zheng Yiwei Ding Xiaohu Guo Ming Zeng CVBM 30 10 0 24 Mar 2023
A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need? Chaoning Zhang Chenshuang Zhang Sheng Zheng Yu Qiao Chenghao Li ... Lik-Hang Lee Yang Yang Heng Tao Shen In So Kweon Choong Seon Hong 77 159 0 21 Mar 2023
HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Details Zenghao Chai Tianke Zhang Tianyu He Xuejiao Tan T. Baltrušaitis Hsiang-Tao Wu Runnan Li Sheng Zhao Chun Yuan Jiang Bian 3DH 19 19 0 20 Mar 2023
EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation Ziqiao Peng Hao Wu Zhenbo Song Hao-Xuan Xu Xiangyu Zhu Jun He Hongyan Liu Zhaoxin Fan CVBM 11 99 0 20 Mar 2023
Style Transfer for 2D Talking Head Animation Trong-Thang Pham Nhat Le Tuong Khanh Long Do Hung Nguyen Erman Tjiputra Quang-Dieu Tran A. Nguyen 17 3 0 17 Mar 2023
MMFace4D: A Large-Scale Multi-Modal 4D Face Dataset for Audio-Driven 3D Face Animation Haozhe Wu Jia Jia Junliang Xing Hongwei Xu Xiangyuan Wang Jelo Wang CVBM 24 7 0 17 Mar 2023
FaceXHuBERT: Text-less Speech-driven E(X)pressive 3D Facial Animation Synthesis Using Self-Supervised Speech Representation Learning Kazi Injamamul Haque Zerrin Yumak 8 23 0 09 Mar 2023
Improving Few-Shot Learning for Talking Face System with TTS Data Augmentation Qi Chen Ziyang Ma Tao Liu Xuejiao Tan Qu Lu Xie Chen K. Yu CVBM 35 5 0 09 Mar 2023
Exploring Efficient-Tuned Learning Audio Representation Method from BriVL Sen Fang Yang Wu Bowen Gao Jingwen Cai T. Teoh DiffM 16 1 0 08 Mar 2023
READ Avatars: Realistic Emotion-controllable Audio Driven Avatars Jack D. Saunders Vinay P. Namboodiri VGen 21 11 0 01 Mar 2023
Pose-Controllable 3D Facial Animation Synthesis using Hierarchical Audio-Vertex Attention Bin Liu Xiaolin K. Wei Bo Li Junjie Cao Yunyu Lai CVBM 19 1 0 24 Feb 2023
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis Zhenhui Ye Ziyue Jiang Yi Ren Jinglin Liu Jinzheng He Zhou Zhao CVBM 20 122 0 31 Jan 2023
Learning Audio-Driven Viseme Dynamics for 3D Face Animation Linchao Bao Haoxian Zhang Yue Qian Tangli Xue Changan Chen Xuefei Zhe Di Kang 3DH 20 12 0 15 Jan 2023
Speech Driven Video Editing via an Audio-Conditioned Diffusion Model Dan Bigioi Shubhajit Basak Michał Stypułkowski Maciej Ziȩba H. Jordan R. Mcdonnell Peter Corcoran DiffM VGen 19 34 0 10 Jan 2023
DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation Shuai Shen Wenliang Zhao Zibin Meng Wanhua Li Zhengbiao Zhu Jie Zhou Jiwen Lu DiffM VGen 33 99 0 10 Jan 2023
CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior Jinbo Xing Menghan Xia Yuechen Zhang Xiaodong Cun Jue Wang T. Wong 24 140 0 06 Jan 2023
Expressive Speech-driven Facial Animation with controllable emotions Yutong Chen Junhong Zhao Weiqiang Zhang 25 8 0 05 Jan 2023
Imitator: Personalized Speech-driven 3D Facial Animation Balamurugan Thambiraja I. Habibie S. Aliakbarian Darren Cosker Christian Theobalt Justus Thies CVBM 39 49 0 30 Dec 2022
Memories are One-to-Many Mapping Alleviators in Talking Face Generation Anni Tang Tianyu He Xuejiao Tan Jun Ling Liang Song CVBM 26 23 0 09 Dec 2022
Generating Holistic 3D Human Motion from Speech Hongwei Yi Hualin Liang Yifei Liu Qiong Cao Yandong Wen Timo Bolkart Dacheng Tao Michael J. Black SLR 21 143 0 08 Dec 2022
Audio-Driven Co-Speech Gesture Video Generation Xian Liu Qianyi Wu Hang Zhou Yuanqi Du Wayne Wu Dahua Lin Ziwei Liu SLR VGen 23 47 0 05 Dec 2022
Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decomposition Jiaxiang Tang Kaisiyuan Wang Hang Zhou Xiaokang Chen Dongliang He Tianshu Hu Jingtuo Liu Gang Zeng Jingdong Wang 3DH 18 76 0 22 Nov 2022
The Florence 4D Facial Expression Dataset F. Principi Stefano Berretti Claudio Ferrari N. Otberdout Mohamed Daoudi A. Bimbo 3DH 41 8 0 30 Oct 2022
Synthesizing Photorealistic Virtual Humans Through Cross-modal Disentanglement S. Ravichandran Ondrej Texler Dimitar Dinev Hyun Jae Kang 17 4 0 03 Sep 2022
Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding Mireille Fares Michele Grimaldi Catherine Pelachaud Nicolas Obin 25 17 0 03 Aug 2022
Generating Multiple 4D Expression Transitions by Learning Face Landmark Trajectories N. Otberdout Claudio Ferrari Mohamed Daoudi Stefano Berretti A. Bimbo CVBM 16 9 0 29 Jul 2022
Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis Shuai Shen Wanhua Li Zhengbiao Zhu Yueqi Duan Jie Zhou Jiwen Lu CVBM 25 105 0 24 Jul 2022
Deep Learning for Visual Speech Analysis: A Survey Changchong Sheng Gangyao Kuang L. Bai Chen Hou Y. Guo Xin Xu M. Pietikäinen Li Liu VLM 21 33 0 22 May 2022