v1v2 (latest)

MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement

IEEE International Conference on Computer Vision (ICCV), 2021

16 April 2021

ArXiv (abs)PDF HTML Github (384★)

Papers citing "MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement"

50 / 145 papers shown

Title
StreamingTalker: Audio-driven 3D Facial Animation with Autoregressive Diffusion Model Y. Yang Zhi Cen Sida Peng Xiangwei Chen Yifu Deng Xinyu Zhu Fan Jia Xiaowei Zhou Hujun Bao DiffM VGen 172 0 0 18 Nov 2025
Learning Disentangled Speech- and Expression-Driven Blendshapes for 3D Talking Face Animation Yuxiang Mao Zhijie Zhang Zhiheng Zhang Jiawei Liu Chen Zeng Shihong Xia 43 0 0 29 Oct 2025
LSF-Animation: Label-Free Speech-Driven Facial Animation via Implicit Feature Representation Xin Lu Chuanqing Zhuang Chenxi Jin Zhengda Lu Yiqun Wang Wu Liu Jun Xiao 68 0 0 23 Oct 2025
Audio Driven Real-Time Facial Animation for Social Telepresence Jiye Lee Chenghui Li Linh Tran S. Wei Jason M. Saragih Alexander Richard Hanbyul Joo Shaojie Bai VGen 111 0 0 01 Oct 2025
3DiFACE: Synthesizing and Editing Holistic 3D Facial AnimationInternational Conference on 3D Vision (3DV), 2025 Balamurugan Thambiraja Malte Prinzler S. Aliakbarian Darren Cosker Justus Thies DiffM VGen 100 1 0 30 Sep 2025
KSDiff: Keyframe-Augmented Speech-Aware Dual-Path Diffusion for Facial Animation Tianle Lyu Junchuan Zhao Ye Wang VGen 72 0 0 24 Sep 2025
Audio-Driven Universal Gaussian Head Avatars Kartik Teotia Helge Rhodin Mohit Mendiratta Hyeongwoo Kim Marc Habermann Christian Theobalt 100 0 0 23 Sep 2025
Beat on Gaze: Learning Stylized Generation of Gaze and Head Dynamics Chengwei Shi Chong Cao Xin Tong Xukun Shen 93 0 0 21 Sep 2025
InterAct: A Large-Scale Dataset of Dynamic, Expressive and Interactive Activities between Two People in Daily ScenariosProceedings of the ACM on Computer Graphics and Interactive Techniques (PACMCGIT), 2025 Leo Ho Yinghao Huang Dafei Qin Mingyi Shi Wangpok Tse Wei Liu Junichi Yamagishi Taku Komura VGen 89 0 0 06 Sep 2025
Audio2Face-3D: Audio-driven Realistic Facial Animation For Digital Avatars NVIDIA Chaeyeon Chung Ilya Fedorov Michael Huang Aleksey Karmanov Dmitry Korobchenko Roger Ribera Yeongho Seol CVBM 195 1 0 22 Aug 2025
Learning Phonetic Context-Dependent Viseme for Enhancing Speech-Driven 3D Facial Animation Hyung Kyu Kim Hak Gu Kim 103 0 0 28 Jul 2025
MemoryTalker: Personalized Speech-Driven 3D Facial Animation via Audio-Guided Stylization Hyung Kyu Kim Sangmin Lee Hak Gu Kim 105 1 0 28 Jul 2025
Morpheus: A Neural-driven Animatronic Face with Hybrid Actuation and Diverse Emotion Control Zongzheng Zhang Jiawen Yang Ziqiao Peng M. Yang Jianzhu Ma Lin Cheng Huazhe Xu Hang Zhao Hao Zhao 97 0 0 22 Jul 2025
MEDTalk: Multimodal Controlled 3D Facial Animation with Dynamic Emotions by Disentangled Embedding Chang Liu Ye Pan C. Ding Susanto Rahardja Yunbo Wang VGen 250 0 0 08 Jul 2025
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis Alexandre Symeonidis-Herzig Ozge Mercanoglu Sincan Richard Bowden 147 1 0 08 Jul 2025
Wav2Sem: Plug-and-Play Audio Semantic Decoupling for 3D Speech-Driven Facial AnimationComputer Vision and Pattern Recognition (CVPR), 2025 Hao Li Ju Dai Xin Zhao Feng Zhou Junjun Pan Lei Li 112 1 0 29 May 2025
DualTalk: Dual-Speaker Interaction for 3D Talking Head ConversationsComputer Vision and Pattern Recognition (CVPR), 2025 Ziqiao Peng Yanbo Fan Haoyu Wu Xuan Wang Hongyan Liu Jun He Zhaoxin Fan 199 7 0 23 May 2025
AsynFusion: Towards Asynchronous Latent Consistency Models for Decoupled Whole-Body Audio-Driven Avatars T. Zhang Jian Zhao Yuer Li Zheng Zhu Ping Hu Zhaoxin Fan Wenjun Wu Xuelong Li 206 0 0 21 May 2025
OT-Talk: Animating 3D Talking Head with Optimal TransportationInternational Conference on Multimedia Retrieval (ICMR), 2025 Xinmu Wang Xiang Gao Xiyun Song Heather Yu Zongfang Lin Liang Peng Xianfeng Gu 294 2 0 03 May 2025
Model See Model Do: Speech-Driven Facial Animation with Style Control Yifang Pan Karan Singh Luiz Gustavo Hafemann DiffM 219 0 0 02 May 2025
VividListener: Expressive and Controllable Listener Dynamics Modeling for Multi-Modal Responsive Interaction Shiying Li Xingqun Qi Bingkun Yang Chen Weile Zezhao Tian Muyi Sun Qifeng Liu Man Zhang Zhenan Sun 244 0 0 30 Apr 2025
Supervising 3D Talking Head Avatars with Analysis-by-Audio-Synthesis Radek Daněček Carolin Schmitt Senya Polikovsky Michael J. Black 310 1 0 18 Apr 2025
Controllable Expressive 3D Facial Animation via Diffusion in a Unified Multimodal Space Kangwei Liu Junwu Liu Xiaowei Yi Jinlin Guo Yun Cao VGen 126 0 0 14 Apr 2025
EasyGenNet: An Efficient Framework for Audio-Driven Gesture Video Generation Based on Diffusion Model Renda Li Xiaohua Qi Q. Ling Jun Yu Ziyi Chen Peng Chang Mei HanJing Xiao DiffM VGen 228 0 0 11 Apr 2025
Perceptually Accurate 3D Talking Head Generation: New Definitions, Speech-Mesh Representation, and Evaluation MetricsComputer Vision and Pattern Recognition (CVPR), 2025 Lee Chae-Yeon Oh Hyun-Bin Han EunGi Kim Sung-Bin Suekyeong Nam Tae-Hyun Oh EGVM 3DH 347 5 1 26 Mar 2025
DiffusionTalker: Efficient and Compact Speech-Driven 3D Talking Head via Personalizer-Guided Distillation Peng Chen Xiaobao Wei Ming Lu Hui Chen Feng Tian 236 2 0 23 Mar 2025
3D Engine-ready Photorealistic Avatars via Dynamic Textures Yifan Wang Ivan Molodetskikh Ondrej Texler Dimitar Dinev 213 0 0 19 Mar 2025
EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models Yixuan Zhang Qing Chang Yuxi Wang Guang Chen Zhenru Zhang Junran Peng 327 0 0 14 Mar 2025
Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained ControlInternational Conference on Learning Representations (ICLR), 2025 Hejia Chen Haoxian Zhang Shoulong Zhang Xiaoqiang Liu Sisi Zhuang Yuan Zhang Pengfei Wan Di Zhang Shuai Li 195 6 0 14 Mar 2025
Towards High-fidelity 3D Talking Avatar with Personalized Dynamic TextureComputer Vision and Pattern Recognition (CVPR), 2025 X. Li Jianyu Wang Yuhao Cheng Yikun Zeng X. Ren W. Zhu Weiming Zhao Manwen Liao 174 1 0 01 Mar 2025
ARTalk: Speech-Driven 3D Head Animation via Autoregressive Model Xuangeng Chu Nabarun Goswami Ziteng Cui Hanqin Wang Tatsuya Harada DiffM 446 3 0 27 Feb 2025
Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Heads Federico Nocentini T. Besnier Claudio Ferrari Sylvain Arguillere Stefano Berretti Mohamed Daoudi 285 2 0 14 Oct 2024
MMHead: Towards Fine-grained Multi-modal 3D Facial AnimationACM Multimedia (MM), 2024 Sijing Wu Yunhao Li Manwen Liao Huiyu Duan Ziwei Liu Guangtao Zhai 3DH VGen 144 17 0 10 Oct 2024
Diverse Code Query Learning for Speech-Driven Facial AnimationIEEE Transactions on Visualization and Computer Graphics (TVCG), 2024 Chunzhi Gu Shigeru Kuriyama Katsuya Hotta DiffM 165 0 0 27 Sep 2024
FastTalker: Jointly Generating Speech and Conversational Gestures from Text Zixin Guo Jian Zhang 327 3 0 24 Sep 2024
3DFacePolicy: Audio-Driven 3D Facial Animation Based on Action Control Xuanmeng Sha Liyun Zhang Tomohiro Mashita Yuki Uranishi Yuki Uranishi VGen 216 2 0 17 Sep 2024
ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAEMotion in Games (MIG), 2024 Sichun Wu Kazi Injamamul Haque Zerrin Yumak VGen 402 10 0 12 Sep 2024
TalkLoRA: Low-Rank Adaptation for Speech-Driven AnimationBritish Machine Vision Conference (BMVC), 2024 Jack D. Saunders Vinay P. Namboodiri 183 2 0 25 Aug 2024
T3M: Text Guided 3D Human Motion Synthesis from Speech Wenshuo Peng Kaipeng Zhang Sai Qian Zhang 132 1 0 23 Aug 2024
EmoFace: Emotion-Content Disentangled Speech-Driven 3D Talking Face Animation Yihong Lin Liang Peng Jianqiao Hu Xiandong Li Xiandong Li Xiandong Li Wenxiong Kang Huang Xu CVBM 3DH 379 0 0 21 Aug 2024
Meta-Learning Empowered Meta-Face: Personalized Speaking Style Adaptation for Audio-Driven 3D Talking Face Animation Xukun Zhou Fengxin Li Ziqiao Peng Kejian Wu Jun He Biao Qin Zhaoxin Fan Hongyan Liu 3DH CVBM 233 6 0 18 Aug 2024
Content and Style Aware Audio-Driven Facial AnimationBritish Machine Vision Conference (BMVC), 2024 Qingju Liu Hyeongwoo Kim Gaurav Bharaj DiffM 267 2 0 13 Aug 2024
DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face AnimationAAAI Conference on Artificial Intelligence (AAAI), 2024 Jisoo Kim Jungbin Cho Joonho Park Soonmin Hwang Da Eun Kim Geon Kim Youngjae Yu 410 5 0 12 Aug 2024
ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial PerformerEuropean Conference on Computer Vision (ECCV), 2024 Jiazhi Guan Zhiliang Xu Hang Zhou Kaisiyuan Wang Shengyi He ... Errui Ding Jingtuo Liu Jingdong Wang Youjian Zhao Ziwei Liu VGen 159 10 0 06 Aug 2024
GLDiTalker: Speech-Driven 3D Facial Animation with Graph Latent Diffusion TransformerInternational Joint Conference on Artificial Intelligence (IJCAI), 2024 Yihong Lin Zhaoxin Fan Lingyu Xiong Liang Peng Xiandong Li Xiandong Li Wenxiong Kang Xiandong Li Huang Xu 394 6 0 03 Aug 2024
JambaTalk: Speech-Driven 3D Talking Head Generation Based on Hybrid Transformer-Mamba Model Farzaneh Jafari Stefano Berretti Anup Basu Mamba 271 1 0 03 Aug 2024
UniTalker: Scaling up Audio-Driven 3D Facial Animation through A Unified ModelEuropean Conference on Computer Vision (ECCV), 2024 Xiangyu Fan Jiaqi Li Zhiqian Lin Weiye Xiao Lei Yang CVBM VGen 175 15 0 01 Aug 2024
EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking HeadEuropean Conference on Computer Vision (ECCV), 2024 Qianyun He Xinya Ji Ruichen Zheng Yuanxun Lu Zhengyu Diao ... Songcen Xu Xiaofei Wu Zixiao Zhang Xun Cao Hao Zhu 174 12 0 01 Aug 2024
Modeling and Driving Human Body Soundfields through Acoustic Primitives Chao Huang Dejan Marković Chenliang Xu Alexander Richard 210 12 0 18 Jul 2024
EmoFace: Audio-driven Emotional 3D Face Animation Chang Liu Qunfen Lin Zijiao Zeng Ye Pan CVBM 156 7 0 17 Jul 2024