Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance

28 January 2024

Qingcheng Zhao

Pengyu Long

Qixuan Zhang

Dafei Qin

Jingyi Yu

Papers citing "Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance"

24 / 24 papers shown

Title
Model See Model Do: Speech-Driven Facial Animation with Style Control Yifang Pan Karan Singh Luiz Gustavo Hafemann DiffM 48 0 0 02 May 2025
VividListener: Expressive and Controllable Listener Dynamics Modeling for Multi-Modal Responsive Interaction Shiying Li Xingqun Qi Bingkun Yang Chen Weile Zezhao Tian Muyi Sun Qifeng Liu Man Zhang Zhenan Sun 59 0 0 30 Apr 2025
ExFace: Expressive Facial Control for Humanoid Robots with Diffusion Transformers and Bootstrap Training Dong Zhang Jingwei Peng Yuyang Jiao Jiayuan Gu Jingyi Yu Jiahao Chen 29 0 0 20 Apr 2025
Supervising 3D Talking Head Avatars with Analysis-by-Audio-Synthesis Radek Daněček Carolin Schmitt Senya Polikovsky Michael J. Black 34 0 0 18 Apr 2025
EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models Yixuan Zhang Qing Chang Yuxi Wang Guang Chen Z. Zhang Junran Peng 36 0 0 14 Mar 2025
Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained Control Hejia Chen Haoxian Zhang Shoulong Zhang Xiaoqiang Liu Sisi Zhuang Yuan Zhang Pengfei Wan Di Zhang Shuai Li 54 1 0 14 Mar 2025
Towards High-fidelity 3D Talking Avatar with Personalized Dynamic Texture X. Li Jianyu Wang Yuhao Cheng Yikun Zeng X. Ren W. Zhu Weiming Zhao Yichao Yan 31 0 0 01 Mar 2025
SMGDiff: Soccer Motion Generation using diffusion probabilistic models Hongdi Yang Chengyang Li Zhenxuan Wu Gaozheng Li Jingya Wang Jingyi Yu Zhuo Su Lan Xu DiffM VGen 73 1 0 25 Nov 2024
MMHead: Towards Fine-grained Multi-modal 3D Facial Animation Sijing Wu Yunhao Li Yichao Yan Huiyu Duan Ziwei Liu Guangtao Zhai 3DH VGen 32 4 0 10 Oct 2024
ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAE Sichun Wu Kazi Injamamul Haque Zerrin Yumak VGen 28 2 0 12 Sep 2024
UniTalker: Scaling up Audio-Driven 3D Facial Animation through A Unified Model Xiangyu Fan Jiaqi Li Zhiqian Lin Weiye Xiao Lei Yang CVBM VGen 31 3 0 01 Aug 2024
DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image Qingxuan Wu Zhiyang Dou Sirui Xu Soshi Shimada Chen Wang ... Taku Komura Vladislav Golyanik Christian Theobalt Wenping Wang Lingjie Liu CVBM 3DH 66 4 0 26 Jun 2024
InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation Yuchi Wang Junliang Guo Jianhong Bai Runyi Yu Tianyu He Xu Tan Xu Sun Jiang Bian DiffM 33 9 0 24 May 2024
Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communication Mingze Sun Chao Xu Xinyu Jiang Yang Liu Baigui Sun Ruqi Huang 41 3 0 28 Mar 2024
DiffSpeaker: Speech-Driven 3D Facial Animation with Diffusion Transformer Zhiyuan Ma Xiangyu Zhu Guojun Qi Chen Qian Zhaoxiang Zhang Zhen Lei 19 9 0 08 Feb 2024
SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models Lee Hyun Kim Sung-Bin Seungju Han Youngjae Yu Tae-Hyun Oh 25 13 0 15 Dec 2023
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers Hanming Liang Jiacheng Bao Ruichi Zhang Sihan Ren Yuecheng Xu Sibei Yang Xin Chen Jingyi Yu Lan Xu 42 17 0 14 Dec 2023
SingingHead: A Large-scale 4D Dataset for Singing Head Animation Sijing Wu Yunhao Li Weitian Zhang Jun Jia Yucheng Zhu Yichao Yan Guangtao Zhai Xiaokang Yang 41 2 0 07 Dec 2023
SpeechAct: Towards Generating Whole-body Motion from Speech Jinsong Zhang Minjie Zhu Yuxiang Zhang Yebin Liu Kun Li 21 0 0 29 Nov 2023
SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces Ziqiao Peng Yihao Luo Yue Shi Hao-Xuan Xu Xiangyu Zhu Jun He Hongyan Liu Zhaoxin Fan 47 39 0 19 Jun 2023
GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents Tenglong Ao Zeyi Zhang Libin Liu DiffM VGen 65 143 0 26 Mar 2023
Human Motion Diffusion Model Guy Tevet Sigal Raab Brian Gordon Yonatan Shafir Daniel Cohen-Or Amit H. Bermano DiffM VGen 188 713 0 29 Sep 2022
Diffusion Models: A Comprehensive Survey of Methods and Applications Ling Yang Zhilong Zhang Yingxia Shao Shenda Hong Runsheng Xu Yue Zhao Wentao Zhang Bin Cui Ming-Hsuan Yang DiffM MedIm 215 1,277 0 02 Sep 2022
A cappella: Audio-visual Singing Voice Separation Juan F. Montesinos V. S. Kadandale G. Haro 38 16 0 20 Apr 2021