Realistic Speech-Driven Facial Animation with GANs

14 June 2019

Papers citing "Realistic Speech-Driven Facial Animation with GANs"

50 / 154 papers shown

Title
OT-Talk: Animating 3D Talking Head with Optimal Transportation Xinmu Wang Xiang Gao Xiyun Song Heather Yu Zongfang Lin Liang Peng Xianfeng Gu 17 0 0 03 May 2025
KeySync: A Robust Approach for Leakage-free Lip Synchronization in High Resolution Antoni Bigata Rodrigo Mira Stella Bounareli Michał Stypułkowski Konstantinos Vougioukas Stavros Petridis Maja Pantic 52 0 0 01 May 2025
SE4Lip: Speech-Lip Encoder for Talking Head Synthesis to Solve Phoneme-Viseme Alignment Ambiguity Yihuan Huang Jiajun Liu Yanzhen Ren Wuyang Liu Juhua Tang 21 0 0 08 Apr 2025
KeyFace: Expressive Audio-Driven Facial Animation for Long Sequences via KeyFrame Interpolation Antoni Bigata Michał Stypułkowski Rodrigo Mira Stella Bounareli Konstantinos Vougioukas Zoe Landgraf Nikita Drobyshev Maciej Ziȩba Stavros Petridis M. Pantic DiffM VGen 65 2 0 03 Mar 2025
Emotion Recognition and Generation: A Comprehensive Review of Face, Speech, and Text Modalities Rebecca Mobbs Dimitrios Makris Vasileios Argyriou 38 0 0 02 Feb 2025
Towards Dynamic Neural Communication and Speech Neuroprosthesis Based on Viseme Decoding Ji-Ha Park Seo-Hyun Lee Soowon Kim Seong-Whan Lee 39 0 0 28 Jan 2025
Joint Learning of Depth and Appearance for Portrait Image Animation Xinya Ji Gaspard Zoss Prashanth Chandran Lingchen Yang Xun Cao B. Solenthaler D. Bradley 3DH MDE 42 0 0 15 Jan 2025
A Review of Human Emotion Synthesis Based on Generative Technology Fei Ma Y. Li Yifan Xie Y. He Y. Zhang ... Z. Liu Wei Yao Fuji Ren Fei Richard Yu Shiguang Ni 76 1 0 10 Dec 2024
DAWN: Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for Talking Head Video Generation Hanbo Cheng Limin Lin Chenyu Liu Pengcheng Xia Pengfei Hu Jiefeng Ma Jun Du Jia Pan DiffM VGen 107 0 0 17 Oct 2024
EmoGene: Audio-Driven Emotional 3D Talking-Head Generation Wenqing Wang Yun Fu VGen 74 0 0 07 Oct 2024
StyleTalk++: A Unified Framework for Controlling the Speaking Styles of Talking Heads Suzhen Wang Yifeng Ma Yu Ding Zhipeng Hu Changjie Fan Tangjie Lv Zhidong Deng Xin Yu 38 9 0 14 Sep 2024
KAN-Based Fusion of Dual-Domain for Audio-Driven Facial Landmarks Generation Hoang-Son Vo-Thanh Quang Vinh Nguyen Soo-Hyung Kim CVBM 24 0 0 09 Sep 2024
FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model Ziyu Yao Xuxin Cheng Zhiqi Huang DiffM 19 3 0 18 Aug 2024
The impact of differences in facial features between real speakers and 3D face models on synthesized lip motions Rabab Algadhy Yoshihiko Gotoh Steve Maddock CVBM 18 0 0 24 Jul 2024
EmoFace: Audio-driven Emotional 3D Face Animation Chang Liu Qunfen Lin Zijiao Zeng Ye Pan CVBM 36 4 0 17 Jul 2024
Listen and Move: Improving GANs Coherency in Agnostic Sound-to-Video Generation Rafael Redondo 35 0 0 23 Jun 2024
A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editing Ming Meng Yufei Zhao Bo Zhang Yonggui Zhu Weimin Shi Maxwell Wen Zhaoxin Fan VGen 34 1 0 15 Jun 2024
Deepfakes and Higher Education: A Research Agenda and Scoping Review of Synthetic Media Jasper Roe Mike Perkins 29 9 0 24 Apr 2024
GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting Hongyun Yu Zhan Qu Qihang Yu Jianchuan Chen Zhonghua Jiang ... Shengyu Zhang Jimin Xu Fei Wu Chengfei Lv Gang Yu 3DGS 30 12 0 22 Apr 2024
Learn2Talk: 3D Talking Face Learns from 2D Talking Face Yixiang Zhuang Baoping Cheng Yao Cheng Yuntao Jin Renshuai Liu Chengyang Li Xuan Cheng Jing Liao Juncong Lin CVBM 3DH 29 6 0 19 Apr 2024
MI-NeRF: Learning a Single Face NeRF from Multiple Identities Aggelina Chatziagapi Grigorios G. Chrysos Dimitris Samaras CVBM 31 2 0 29 Mar 2024
Dyadic Interaction Modeling for Social Behavior Generation Minh Tran Di Chang Maksim Siniukov Mohammad Soleymani VGen 32 6 0 14 Mar 2024
VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis Enric Corona Andrei Zanfir Eduard Gabriel Bazavan Nikos Kolotouros Thiemo Alldieck C. Sminchisescu VGen DiffM 35 26 0 13 Mar 2024
FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization Shuai Tan Bin Ji Ye Pan 42 15 0 11 Mar 2024
Say Anything with Any Style Shuai Tan Bin Ji Yu Ding Ye Pan VGen DiffM 21 10 0 11 Mar 2024
CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generation Xi Liu Ying Guo Cheng Zhen Tong Li Yingying Ao Pengfei Yan DiffM 34 3 0 01 Mar 2024
AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation Yasheng Sun Wenqing Chu Hang Zhou Kaisiyuan Wang Hideki Koike 37 5 0 25 Feb 2024
EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Model Bingyuan Zhang Xulong Zhang Ning Cheng Jun Yu Jing Xiao Jianzong Wang DiffM 23 5 0 16 Jan 2024
From Audio to Photoreal Embodiment: Synthesizing Humans in Conversations Evonne Ng Javier Romero Timur M. Bagautdinov Shaojie Bai Trevor Darrell Angjoo Kanazawa Alexander Richard VGen 25 37 0 03 Jan 2024
DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models Yifeng Ma Shiwei Zhang Jiayu Wang Xiang Wang Yingya Zhang Zhidong Deng DiffM 39 23 0 15 Dec 2023
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models Shivangi Aneja Justus Thies Angela Dai Matthias Nießner DiffM VGen 26 29 0 13 Dec 2023
GSmoothFace: Generalized Smooth Talking Face Generation via Fine Grained 3D Face Guidance Haiming Zhang Zhihao Yuan Chaoda Zheng Xu Yan Baoyuan Wang Guanbin Li Song Wu Shuguang Cui Zhen Li CVBM 42 1 0 12 Dec 2023
GMTalker: Gaussian Mixture-based Audio-Driven Emotional Talking Video Portraits Yibo Xia Lizhen Wang Xiang Deng Xiaoyan Luo Yunhong Wang Yebin Liu VGen 33 1 0 12 Dec 2023
R2-Talker: Realistic Real-Time Talking Head Synthesis with Hash Grid Landmarks Encoding and Progressive Multilayer Conditioning Zhiling Ye LiangGuo Zhang Dingheng Zeng Quan Lu Ning Jiang 24 0 0 09 Dec 2023
VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior Xusen Sun Longhao Zhang Hao Zhu Peng Zhang Bang Zhang Xinya Ji Kangneng Zhou Daiheng Gao Liefeng Bo Xun Cao VGen 25 24 0 04 Dec 2023
3DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing Balamurugan Thambiraja S. Aliakbarian Darren Cosker Justus Thies DiffM VGen 40 11 0 01 Dec 2023
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis Ziqiao Peng Wentao Hu Yue Shi Xiangyu Zhu Xiaomei Zhang Hao Zhao Jun He Hongyan Liu Zhaoxin Fan 33 39 0 29 Nov 2023
META4: Semantically-Aligned Generation of Metaphoric Gestures Using Self-Supervised Text and Speech Representation Mireille Fares Catherine Pelachaud Nicolas Obin 18 1 0 09 Nov 2023
DualTalker: A Cross-Modal Dual Learning Approach for Speech-Driven 3D Facial Animation Guinan Su Yanwu Yang Zhifeng Li VGen 31 1 0 08 Nov 2023
Breathing Life into Faces: Speech-driven 3D Facial Animation with Natural Head Pose and Detailed Shape Wei Zhao Yijun Wang Tianyu He Li-Ping Yin Jianxin Lin Xin Jin 3DH 16 2 0 31 Oct 2023
Emotional Listener Portrait: Neural Listener Head Generation with Emotion Luchuan Song Guojun Yin Zhenchao Jin Xiaoyi Dong Chenliang Xu 22 10 0 29 Sep 2023
OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions Jin Liu Xi Wang Xiaomeng Fu Yesheng Chai Cai Yu Jiao Dai Jizhong Han 19 3 0 28 Sep 2023
Towards the generation of synchronized and believable non-verbal facial behaviors of a talking virtual agent Alice Delbosc M. Ochs Nicolas Sabouret Brian Ravenet Stéphane Ayache 32 7 0 15 Sep 2023
HDTR-Net: A Real-Time High-Definition Teeth Restoration Network for Arbitrary Talking Face Generation Methods Yongyuan Li Xiuyuan Qin Chao Liang Mingqiang Wei 14 3 0 14 Sep 2023
Blendshapes GHUM: Real-time Monocular Facial Blendshape Prediction Ivan Grishchenko Geng Yan Eduard Gabriel Bazavan Andrei Zanfir Nikolai Chinaev Karthik Raveendran Matthias Grundmann C. Sminchisescu 3DH CVBM 30 0 0 11 Sep 2023
Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation Yuan Gan Zongxin Yang Xihang Yue Lingyun Sun Yezhou Yang 23 57 0 10 Sep 2023
Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video Xiuzhe Wu Pengfei Hu Yang Wu Xiaoyang Lyu Yan-Pei Cao Ying Shan Wenming Yang Zhongqian Sun Xiaojuan Qi 10 14 0 09 Sep 2023
A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation Li Liu Lufei Gao Wen-Ling Lei Fengji Ma Xiaotian Lin Jin-Tao Wang CVBM 19 5 0 17 Aug 2023
Speech-Driven 3D Face Animation with Composite and Regional Facial Movements Haozhe Wu Songtao Zhou Jia Jia Junliang Xing Qi Wen Xiang Wen CVBM 32 14 0 10 Aug 2023
Learning and Evaluating Human Preferences for Conversational Head Generation Mohan Zhou Yalong Bai Wei Zhang Ting Yao Tiejun Zhao Tao Mei 21 2 0 20 Jul 2023