Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos

22 July 2022

P. Filntisis

George Retsinas

Foivos Paraperas-Papantoniou

Athanasios Katsamanis

Papers citing "Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos"

25 / 25 papers shown

Title
Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstruction Simon Giebenhain Tobias Kirschstein Martin Rünz Lourdes Agapito Matthias Nießner CVBM 3DH 57 0 0 01 May 2025
Supervising 3D Talking Head Avatars with Analysis-by-Audio-Synthesis Radek Daněček Carolin Schmitt Senya Polikovsky Michael J. Black 36 0 0 18 Apr 2025
EmojiDiff: Advanced Facial Expression Control with High Identity Preservation in Portrait Generation Liangwei Jiang Ruida Li Zhifeng Zhang Shuo Fang Chenguang Ma DiffM 72 1 0 02 Dec 2024
MMHead: Towards Fine-grained Multi-modal 3D Facial Animation Sijing Wu Yunhao Li Yichao Yan Huiyu Duan Ziwei Liu Guangtao Zhai 3DH VGen 36 4 0 10 Oct 2024
Portrait Video Editing Empowered by Multimodal Generative Priors Xuan Gao Haiyao Xiao Chenglai Zhong Shimin Hu Yudong Guo Juyong Zhang VGen 3DGS 42 4 0 20 Sep 2024
UniTalker: Scaling up Audio-Driven 3D Facial Animation through A Unified Model Xiangyu Fan Jiaqi Li Zhiqian Lin Weiye Xiao Lei Yang CVBM VGen 41 3 0 01 Aug 2024
Rank-based No-reference Quality Assessment for Face Swapping Xinghui Zhou Wenbo Zhou Tianyi Wei Shen Chen Taiping Yao Shouhong Ding Weiming Zhang Nenghai Yu CVBM 37 0 0 04 Jun 2024
Learn2Talk: 3D Talking Face Learns from 2D Talking Face Yixiang Zhuang Baoping Cheng Yao Cheng Yuntao Jin Renshuai Liu Chengyang Li Xuan Cheng Jing Liao Juncong Lin CVBM 3DH 34 6 0 19 Apr 2024
Video-Driven Animation of Neural Head Avatars Wolfgang Paier Paul Hinzer A. Hilsmann Peter Eisert 3DH 34 0 0 07 Mar 2024
Learning a Generalized Physical Face Model From Data Lingchen Yang Gaspard Zoss Prashanth Chandran Markus Gross B. Solenthaler Eftychios Sifakis Derek Bradley CVBM AI4CE 3DH 34 2 0 29 Feb 2024
Eye Motion Matters for 3D Face Reconstruction Xuan Wang Mengyuan Liu 3DH CVBM 16 0 0 18 Jan 2024
Dubbing for Everyone: Data-Efficient Visual Dubbing using Neural Rendering Priors Jack D. Saunders Vinay P. Namboodiri VGen DiffM 31 1 0 11 Jan 2024
Mimic: Speaking Style Disentanglement for Speech-Driven 3D Facial Animation Hui Fu Zeqing Wang Ke Gong Keze Wang Tianshui Chen Haojie Li Haifeng Zeng Xiandong Li 36 10 0 18 Dec 2023
SingingHead: A Large-scale 4D Dataset for Singing Head Animation Sijing Wu Yunhao Li Weitian Zhang Jun Jia Yucheng Zhu Yichao Yan Guangtao Zhai Xiaokang Yang 41 2 0 07 Dec 2023
Do VSR Models Generalize Beyond LRS3? Y. A. D. Djilali Sanath Narayan Eustache Le Bihan Haithem Boussaid Ebtesam Almazrouei Merouane Debbah 35 4 0 23 Nov 2023
A Perceptual Shape Loss for Monocular 3D Face Reconstruction Christopher Otto Prashanth Chandran Gaspard Zoss Markus Gross Paulo F. U. Gotardo Derek Bradley 3DH CVBM 38 6 0 30 Oct 2023
DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Models Zhiyao Sun Tian Lv Sheng Ye Matthieu Lin Jenny Sheng Yuhui Wen Minjing Yu Yong-jin Liu DiffM 31 45 0 30 Sep 2023
Can Language Models Learn to Listen? Evonne Ng Sanjay Subramanian Dan Klein Angjoo Kanazawa Trevor Darrell Shiry Ginosar 27 16 0 21 Aug 2023
Lip2Vec: Efficient and Robust Visual Speech Recognition via Latent-to-Latent Visual to Audio Representation Mapping Y. A. D. Djilali Sanath Narayan Haithem Boussaid Ebtesam Almazrouei Merouane Debbah 29 10 0 11 Aug 2023
Emotional Speech-Driven Animation with Content-Emotion Disentanglement Radek Danvevcek Kiran Chhatre Shashank Tripathi Yandong Wen Michael J. Black Timo Bolkart 16 66 0 15 Jun 2023
Instant Multi-View Head Capture through Learnable Registration Timo Bolkart Tianye Li Michael J. Black 3DH 19 20 0 12 Jun 2023
Reconstructing Signing Avatars From Video Using Linguistic Priors M. Forte Peter Kulits C. Huang Vasileios Choutas Dimitrios Tzionas Katherine J. Kuchenbecker Michael J. Black SLR 20 8 0 20 Apr 2023
DPE: Disentanglement of Pose and Expression for General Video Portrait Editing Youxin Pang Yong Zhang Weize Quan Yanbo Fan Xiaodong Cun Ying Shan Dong-ming Yan VGen 26 33 0 16 Jan 2023
SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation Wenxuan Zhang Xiaodong Cun Xuan Wang Yong Zhang Xiaodong Shen Yu-Xiao Guo Ying Shan Fei-Yue Wang VGen 35 233 0 22 Nov 2022
Visual Speech Recognition for Multiple Languages in the Wild Pingchuan Ma Stavros Petridis M. Pantic VLM 122 144 0 26 Feb 2022