Capture, Learning, and Synthesis of 3D Speaking Styles

8 May 2019

Papers citing "Capture, Learning, and Synthesis of 3D Speaking Styles"

50 / 201 papers shown

Title
A Novel Speech-Driven Lip-Sync Model with CNN and LSTM Xiaohong Li Xiang Wang Kai Wang Shiguo Lian 6 4 0 02 May 2022
TEMOS: Generating diverse human motions from textual descriptions Mathis Petrovich Michael J. Black Gül Varol 40 368 0 25 Apr 2022
Dynamic Neural Textures: Generating Talking-Face Videos with Continuously Controllable Expressions Zipeng Ye Zhiyao Sun Yu-Hui Wen Y. Sun Tian Lv Ran Yi Y. Liu CVBM 19 7 0 13 Apr 2022
Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape Xiangyu Zhu Chang Yu Di Huang Zhen Lei Hao Wang Stan Z. Li 3DH CVBM 16 8 0 09 Apr 2022
Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices? Cho-Ying Wu Chin-Cheng Hsu Ulrich Neumann CVBM 6 14 0 18 Mar 2022
DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generation Yichao Yan Zanwei Zhou Zi Wang Chen-Ning Yang Xiaokang Yang CVBM 19 18 0 15 Mar 2022
BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis Haiyang Liu Zihao Zhu Naoya Iwamoto Yichen Peng Zhengqing Li You Zhou E. Bozkurt Bo Zheng SLR CVBM 23 136 0 10 Mar 2022
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN Fei Yin Yong Zhang Xiaodong Cun Ming Cao Yanbo Fan Xuanxia Wang Qingyan Bai Baoyuan Wu Jue Wang Yujiu Yang CVBM 31 171 0 08 Mar 2022
Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation Xian Liu Yinghao Xu Qianyi Wu Hang Zhou Wayne Wu Bolei Zhou VGen DiffM 3DH 32 140 0 19 Jan 2022
DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Rendering Shunyu Yao Ruizhe Zhong Yichao Yan Guangtao Zhai Xiaokang Yang CVBM 19 90 0 03 Jan 2022
I M Avatar: Implicit Morphable Head Avatars from Videos Yufeng Zheng Victoria Fernandez-Abrevaya Marcel C. Bühler Xu Chen Michael J. Black Otmar Hilliges 3DH 25 211 0 14 Dec 2021
FaceFormer: Speech-Driven 3D Facial Animation with Transformers Yingruo Fan Zhaojiang Lin Jun Saito Wenping Wang Taku Komura CVBM 38 194 0 10 Dec 2021
One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning Suzhe Wang Lincheng Li Yueqing Ding Xin Yu CVBM 59 117 0 06 Dec 2021
Joint Audio-Text Model for Expressive Speech-Driven 3D Facial Animation Yingruo Fan Zhaojiang Lin Jun Saito Wenping Wang Taku Komura 15 21 0 04 Dec 2021
Transformer-S2A: Robust and Efficient Speech-to-Animation Liyang Chen Zhiyong Wu Jun Ling Runnan Li Xu Tan Sheng Zhao 27 18 0 18 Nov 2021
FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction Hao Zhu Haotian Yang Longwei Guo Yiding Zhang Yanru Wang Mingkai Huang Menghua Wu Qiu Shen Ruigang Yang Xun Cao CVBM 3DH 17 36 0 01 Nov 2021
Imitating Arbitrary Talking Style for Realistic Audio-DrivenTalking Face Synthesis Haozhe Wu Jia Jia Haoyu Wang Yishun Dou Chao Duan Qingshan Deng CVBM 9 73 0 30 Oct 2021
Active Learning of Neural Collision Handler for Complex 3D Mesh Deformations Qingyang Tan Zherong Pan Breannan Smith Takaaki Shiratori Dinesh Manocha 3DH 22 6 0 08 Oct 2021
Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation Yuanxun Lu Jinxiang Chai Xun Cao 24 82 0 22 Sep 2021
Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis Tong Sha Wei Zhang T. Shen Zhoujun Li Tao Mei 27 38 0 05 Sep 2021
Productivity, Portability, Performance: Data-Centric Python Yiheng Wang Yao Zhang Yanzhang Wang Yan Wan Jiao Wang Zhongyuan Wu Yuhao Yang Bowen She 52 94 0 01 Jul 2021
LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization A. Lahiri Vivek Kwatra C. Frueh J. P. Lewis C. Bregler 3DH 27 98 0 08 Jun 2021
Sparse to Dense Dynamic 3D Facial Expression Generation N. Otberdout Claudio Ferrari Mohamed Daoudi Stefano Berretti A. Bimbo 3DH 6 22 0 16 May 2021
3D-TalkEmo: Learning to Synthesize 3D Emotional Talking Head Qianyun Wang Zhenfeng Fan Shi-hong Xia 3DH 63 18 0 25 Apr 2021
Voice2Mesh: Cross-Modal 3D Face Model Generation from Voices Cho-Ying Wu Ke Xu Chin-Cheng Hsu Ulrich Neumann CVBM 3DH 37 4 0 21 Apr 2021
Visually Guided Sound Source Separation and Localization using Self-Supervised Motion Representations Lingyu Zhu Esa Rahtu 8 25 0 17 Apr 2021
MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement Alexander Richard Michael Zollhoefer Yandong Wen Fernando De la Torre Yaser Sheikh CVBM 29 193 0 16 Apr 2021
Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation Lilin Cheng Suzhe Wang Zhimeng Zhang Yu-qiong Ding Yixing Zheng Xin Yu Changjie Fan VGen 17 70 0 16 Apr 2021
AudioVisual Speech Synthesis: A brief literature review Efthymios Georgiou Athanasios Katsamanis 11 0 0 18 Feb 2021
Learning Speech-driven 3D Conversational Gestures from Video I. Habibie Weipeng Xu Dushyant Mehta Lingjie Liu Hans-Peter Seidel Gerard Pons-Moll Mohamed A. Elgharib Christian Theobalt SLR CVBM 3DH 40 107 0 13 Feb 2021
4D Atlas: Statistical Analysis of the Spatiotemporal Variability in Longitudinal 3D Shape Data Hamid Laga Marcel Padilla Ian H. Jermyn S. Kurtek Bennamoun A. Srivastava 6 11 0 23 Jan 2021
Learning an Animatable Detailed 3D Face Model from In-The-Wild Images Yao Feng Haiwen Feng Michael J. Black Timo Bolkart CVBM 3DH 15 568 0 07 Dec 2020
Learning to dance: A graph convolutional adversarial network to generate realistic dance motions from audio João P. Ferreira Thiago M. Coutinho Thiago L. Gomes J. F. Neto Rafael Azevedo Renato Martins Erickson R. Nascimento GAN 28 68 0 25 Nov 2020
APB2FaceV2: Real-Time Audio-Guided Multi-Face Reenactment Jiangning Zhang Xianfang Zeng Chao Xu Jun Chen Yong Liu Yunliang Jiang CVBM 20 1 0 25 Oct 2020
GIF: Generative Interpretable Faces Partha Ghosh Pravir Singh Gupta Roy Uziel Anurag Ranjan Michael J. Black Timo Bolkart CVBM AI4CE 8 76 0 31 Aug 2020
GRAB: A Dataset of Whole-Body Human Grasping of Objects Omid Taheri N. Ghorbani Michael J. Black Dimitrios Tzionas 3DH 4 367 0 25 Aug 2020
Geometry-guided Dense Perspective Network for Speech-Driven Facial Animation Jing-ying Liu Binyuan Hui Kun Li Yunke Liu Yu-Kun Lai Yuxiang Zhang Yebin Liu Jingyu Yang 3DH CVBM 14 22 0 23 Aug 2020
Audio- and Gaze-driven Facial Animation of Codec Avatars Alexander Richard Colin S. Lea Shugao Ma Juergen Gall Fernando De la Torre Yaser Sheikh CVBM 11 81 0 11 Aug 2020
Learning to Generate Customized Dynamic 3D Facial Expressions Rolandos Alexandros Potamias Jiali Zheng Stylianos Ploumpis Giorgos Bouritsas Evangelos Ververas S. Zafeiriou 3DH 18 22 0 19 Jul 2020
A Robust Interactive Facial Animation Editing System Eloïse Berson Catherine Soladié Vincent Barrielle Nicolas Stoiber 3DH 11 7 0 18 Jul 2020
Leveraging Category Information for Single-Frame Visual Sound Source Separation Lingyu Zhu Esa Rahtu 12 9 0 15 Jul 2020
Let's Face It: Probabilistic Multi-modal Interlocutor-aware Generation of Facial Gestures in Dyadic Settings Patrik Jonell Taras Kucherenko G. Henter Jonas Beskow CVBM 15 60 0 11 Jun 2020
Visually Guided Sound Source Separation using Cascaded Opponent Filter Network Lingyu Zhu Esa Rahtu 14 23 0 04 Jun 2020
Modality Dropout for Improved Performance-driven Talking Faces Ahmed Hussen Abdelaziz B. Theobald Paul Dixon Reinhard Knothe N. Apostoloff Sachin Kajareker 24 36 0 27 May 2020
APB2Face: Audio-guided face reenactment with auxiliary pose and blink signals Jiangning Zhang L. Liu Zhucun Xue Yong Liu CVBM 15 16 0 30 Apr 2020
MakeItTalk: Speaker-Aware Talking-Head Animation Yang Zhou Xintong Han Eli Shechtman J. Echevarria E. Kalogerakis Dingzeyu Li 15 412 0 27 Apr 2020
A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors Ruobing Zheng Zhou Zhu Bo Song Changjiang Ji 3DH 13 2 0 20 Feb 2020
Neural Voice Puppetry: Audio-driven Facial Reenactment Justus Thies Mohamed A. Elgharib A. Tewari Christian Theobalt Matthias Nießner VGen 3DH 34 366 0 11 Dec 2019
Animation Synthesis Triggered by Vocal Mimics A. Nivaggioli D. Rohmer 18 1 0 18 Oct 2019
Animating Face using Disentangled Audio Representations Gaurav Mittal Baoyuan Wang CVBM 8 39 0 02 Oct 2019