Neural Style-Preserving Visual Dubbing

5 September 2019

Hyeongwoo Kim

Mohamed A. Elgharib

Michael Zollhöfer

Hans-Peter Seidel

Christian Richardt

Papers citing "Neural Style-Preserving Visual Dubbing"

50 / 51 papers shown

Title
Improving Lip-synchrony in Direct Audio-Visual Speech-to-Speech Translation Lucas Goncalves Prashant Mathur Xing Niu Brady Houston Chandrashekhar Lavania Srikanth Vishnubhotla Lijia Sun Anthony Ferritto 67 0 0 21 Dec 2024
Fake it to make it: Using synthetic data to remedy the data shortage in joint multimodal speech-and-gesture synthesis Shivam Mehta Anna Deichler Jim O'Regan Birger Moëll Jonas Beskow G. Henter Simon Alexanderson 36 4 0 30 Apr 2024
Superior and Pragmatic Talking Face Generation with Teacher-Student Framework Chao Liang Jianwen Jiang Tianyun Zhong Gaojie Lin Zhengkun Rong Jiaqi Yang Yongming Zhu 37 1 0 26 Mar 2024
Deepfake Generation and Detection: A Benchmark and Survey Gan Pei Jiangning Zhang Menghan Hu Zhenyu Zhang Chengjie Wang Yunsheng Wu Guangtao Zhai Jian Yang Chunhua Shen Dacheng Tao 38 25 0 26 Mar 2024
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis Zhenhui Ye Tianyun Zhong Yi Ren Jiaqi Yang Weichuang Li ... Jinglin Liu Chen Zhang Xiang Yin Zejun Ma Zhou Zhao 24 45 0 16 Jan 2024
Dubbing for Everyone: Data-Efficient Visual Dubbing using Neural Rendering Priors Jack D. Saunders Vinay P. Namboodiri VGen DiffM 31 1 0 11 Jan 2024
Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realism Georgios Milis P. Filntisis A. Roussos Petros Maragos CVBM 24 2 0 11 Dec 2023
FT2TF: First-Person Statement Text-To-Talking Face Generation Xingjian Diao Ming Cheng Wayner Barrios SouYoung Jin 38 11 0 09 Dec 2023
OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions Jin Liu Xi Wang Xiaomeng Fu Yesheng Chai Cai Yu Jiao Dai Jizhong Han 19 3 0 28 Sep 2023
Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis Linsen Song Wayne Wu Chaoyou Fu Chen Change Loy Ran He 23 10 0 31 Aug 2023
FACTS: Facial Animation Creation using the Transfer of Styles Jack D. Saunders Steven Caulkin Vinay P. Namboodiri 3DH CVBM 36 0 0 18 Jul 2023
Text-driven Talking Face Synthesis by Reprogramming Audio-driven Models J. Choi Minsu Kim Se Jin Park Y. Ro CVBM 16 3 0 28 Jun 2023
Emotional Speech-Driven Animation with Content-Emotion Disentanglement Radek Danvevcek Kiran Chhatre Shashank Tripathi Yandong Wen Michael J. Black Timo Bolkart 16 65 0 15 Jun 2023
Emotional Talking Head Generation based on Memory-Sharing and Attention-Augmented Networks Jianrong Wang Yaxin Zhao Li Liu Tian-Shun Xu Qi Li Sen Li 13 9 0 06 Jun 2023
Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videos Ekta Prashnani Koki Nagano Shalini De Mello D. Luebke Orazio Gallo 23 2 0 05 May 2023
Face Animation with an Attribute-Guided Diffusion Model Bo-Wen Zeng Xuhui Liu Sicheng Gao Boyu Liu Hong Li Jianzhuang Liu Baochang Zhang 40 31 0 06 Apr 2023
READ Avatars: Realistic Emotion-controllable Audio Driven Avatars Jack D. Saunders Vinay P. Namboodiri VGen 21 11 0 01 Mar 2023
DPE: Disentanglement of Pose and Expression for General Video Portrait Editing Youxin Pang Yong Zhang Weize Quan Yanbo Fan Xiaodong Cun Ying Shan Dong-ming Yan VGen 24 33 0 16 Jan 2023
Dubbing in Practice: A Large Scale Study of Human Localization With Insights for Automatic Dubbing William Brannon Yogesh Virkar Brian Thompson 42 21 0 23 Dec 2022
MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptation Bo Zhang Chenyang Qi Pan Zhang Bo Zhang Hsiang-Tao Wu Dong Chen Qifeng Chen Yong Wang Fang Wen 21 54 0 15 Dec 2022
An Implicit Parametric Morphable Dental Model Congyi Zhang Mohamed A. Elgharib G. Fox Min Gu Christian Theobalt Wenping Wang 3DH MedIm AI4CE 25 39 0 21 Nov 2022
FNeVR: Neural Volume Rendering for Face Animation Bo-Wen Zeng Bo-Ye Liu Hong Li Xuhui Liu Jianzhuang Liu Dapeng Chen Wei Peng Baochang Zhang CVBM 3DH 40 26 0 21 Sep 2022
Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review Enes ALTUNCU V. N. Franqueira Shujun Li 19 11 0 21 Aug 2022
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model Xinya Ji Hang Zhou Kaisiyuan Wang Qianyi Wu Wayne Wu Feng Xu Xun Cao CVBM 50 157 0 30 May 2022
Deep Learning for Visual Speech Analysis: A Survey Changchong Sheng Gangyao Kuang L. Bai Chen Hou Y. Guo Xin Xu M. Pietikäinen Li Liu VLM 21 33 0 22 May 2022
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN Fei Yin Yong Zhang Xiaodong Cun Ming Cao Yanbo Fan Xuanxia Wang Qingyan Bai Baoyuan Wu Jue Wang Yujiu Yang CVBM 29 171 0 08 Mar 2022
FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment Y. Nirkin Y. Keller Tal Hassner PICV CVBM 27 34 0 25 Feb 2022
Towards Realistic Visual Dubbing with Heterogeneous Sources Tianyi Xie Liucheng Liao Cheng Bi Benlai Tang Xiang Yin Jianfei Yang Mingjie Wang Jiali Yao Yang Zhang Zejun Ma VGen 22 37 0 17 Jan 2022
Neural Emotion Director: Speech-preserving semantic control of facial expressions in "in-the-wild" videos Foivos Paraperas-Papantoniou P. Filntisis Petros Maragos A. Roussos 3DH CVBM 18 22 0 01 Dec 2021
More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speech Michael Hassid Michelle Tadmor Ramanovich Brendan Shillingford Miaosen Wang Ye Jia Tal Remez DiffM 17 16 0 19 Nov 2021
Deep Semantic Manipulation of Facial Videos Girish Kumar Solanki A. Roussos CVBM 24 6 0 15 Nov 2021
Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editor Anchit Gupta Faizan Farooq Khan Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar CVBM 22 6 0 16 Oct 2021
Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation Yuanxun Lu Jinxiang Chai Xun Cao 24 82 0 22 Sep 2021
Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis Tong Sha Wei Zhang T. Shen Zhoujun Li Tao Mei 27 38 0 05 Sep 2021
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning Chenxu Zhang Yifan Zhao Yifei Huang Ming Zeng Saifeng Ni M. Budagavi Xiaohu Guo CVBM 13 122 0 18 Aug 2021
Neural Relighting and Expression Transfer On Video Portraits Youjia Wang Taotao Zhou Minzhang Li Teng Xu Minye Wu Lan Xu Jingyi Yu 3DH 11 0 0 30 Jul 2021
Egocentric Videoconferencing Mohamed A. Elgharib Mohit Mendiratta Justus Thies Matthias Nießner Hans-Peter Seidel A. Tewari Vladislav Golyanik Christian Theobalt EgoV 28 17 0 07 Jul 2021
Cross-Domain and Disentangled Face Manipulation with 3D Guidance Can Wang Menglei Chai Mingming He Dongdong Chen Jing Liao CVBM 136 26 0 22 Apr 2021
Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation Hang Zhou Yasheng Sun Wayne Wu Chen Change Loy Xiaogang Wang Ziwei Liu CVBM 26 360 0 22 Apr 2021
Everything's Talkin': Pareidolia Face Reenactment Linsen Song Wayne Wu Chaoyou Fu Chao Qian Chen Change Loy R. He CVBM 27 12 0 07 Apr 2021
Neural Re-Rendering of Humans from a Single Image Kripasindhu Sarkar Dushyant Mehta Weipeng Xu Vladislav Golyanik Christian Theobalt 3DH 22 77 0 11 Jan 2021
Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Video E. Tretschk A. Tewari Vladislav Golyanik Michael Zollhöfer Christoph Lassner Christian Theobalt 3DH 52 494 0 22 Dec 2020
Iterative Text-based Editing of Talking-heads Using Neural Retargeting Xinwei Yao Ohad Fried Kayvon Fatahalian Maneesh Agrawala VGen 11 33 0 21 Nov 2020
Large-scale multilingual audio visual dubbing Yi Yang Brendan Shillingford Yannis Assael Miaosen Wang Wendi Liu ... Eren Sezener Luis C. Cobo Misha Denil Y. Aytar Nando de Freitas 19 20 0 06 Nov 2020
Intuitive Facial Animation Editing Based On A Generative RNN Framework Eloïse Berson Catherine Soladié Nicolas Stoiber 3DH CVBM 17 7 0 12 Oct 2020
PIE: Portrait Image Embedding for Semantic Control A. Tewari Mohamed A. Elgharib Mallikarjun B R Florian Bernard Hans-Peter Seidel P. Pérez Michael Zollhöfer C. Theobalt 17 53 0 20 Sep 2020
VideoForensicsHQ: Detecting High-quality Manipulated Face Videos Gereon Fox Wentao Liu Hyeongwoo Kim Hans-Peter Seidel Mohamed A. Elgharib Christian Theobalt CVBM 32 17 0 20 May 2020
MakeItTalk: Speaker-Aware Talking-Head Animation Yang Zhou Xintong Han Eli Shechtman J. Echevarria E. Kalogerakis Dingzeyu Li 15 412 0 27 Apr 2020
One-Shot Identity-Preserving Portrait Reenactment Sitao Xiang Yuming Gu Pengda Xiang Mingming He Koki Nagano Haiwei Chen Hao Li CVBM 24 14 0 26 Apr 2020
Everybody's Talkin': Let Me Talk as You Want Linsen Song Wayne Wu Chao Qian R. He Chen Change Loy DiffM VGen 23 142 0 15 Jan 2020