v1v2 (latest)

MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement

IEEE International Conference on Computer Vision (ICCV), 2021

16 April 2021

ArXiv (abs)PDF HTML Github (384★)

Papers citing "MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement"

50 / 145 papers shown

Title
The Tug-of-War Between Deepfake Generation and Detection Hannah Lee Changyeon Lee Kevin Farhat Lin Qiu Steve Geluso Aerin Kim O. Etzioni 365 8 0 08 Jul 2024
CLHOP: Combined Audio-Video Learning for Horse 3D Pose and Shape Estimation Ci Li Elin Hernlund Hedvig Kjellström Silvia Zuffi 3DH 182 3 0 01 Jul 2024
Enhancing Speech-Driven 3D Facial Animation with Audio-Visual Guidance from Lip Reading Expert Han EunGi Oh Hyun-Bin Kim Sung-Bin Corentin Nivelet Etcheberry Suekyeong Nam Janghoon Joo Tae-Hyun Oh 232 7 0 01 Jul 2024
Speech2UnifiedExpressions: Synchronous Synthesis of Co-Speech Affective Face and Body Expressions from Affordable Inputs Uttaran Bhattacharya Aniket Bera Dinesh Manocha CVBM 224 3 0 26 Jun 2024
MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Dataset Kim Sung-Bin Lee Chae-Yeon Gihun Son Oh Hyun-Bin Janghoon Ju Suekyeong Nam Tae-Hyun Oh 232 20 0 20 Jun 2024
InterAct: Capture and Modelling of Realistic, Expressive and Interactive Activities between Two Persons in Daily Scenarios Yinghao Huang Leo Ho Dafei Qin Mingyi Shi Taku Komura VGen 182 6 0 19 May 2024
Embedded Representation Learning Network for Animating Styled Video Portrait Tianyong Wang Xiangyu Liang Wangguandong Zheng Dan Niu Haifeng Xia Siyu Xia 3DH 155 0 0 29 Apr 2024
CSTalk: Correlation Supervised Speech-driven 3D Emotional Facial Animation Generation Xiangyu Liang Wenlin Zhuang Tianyong Wang Guangxing Geng Guangyue Geng Haifeng Xia Siyu Xia CVBM 138 3 0 29 Apr 2024
GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting Hongyun Yu Zhan Qu Qihang Yu Jianchuan Chen Zhonghua Jiang ... Shengyu Zhang Jimin Xu Leilei Gan Chengfei Lv Gang Yu 3DGS 245 30 0 22 Apr 2024
Learn2Talk: 3D Talking Face Learns from 2D Talking Face Yixiang Zhuang Baoping Cheng Yao Cheng Yuntao Jin Renshuai Liu Chengyang Li Xuan Cheng Jing Liao Juncong Lin CVBM 3DH 202 11 0 19 Apr 2024
FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features Andre Rochow Max Schwarz Sven Behnke ViT 210 22 0 15 Apr 2024
SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesis George Retsinas P. Filntisis Radek Daněček Victoria Fernandez-Abrevaya A. Roussos Timo Bolkart Petros Maragos 3DH 329 50 0 05 Apr 2024
Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communication Mingze Sun Chao Xu Xinyu Jiang Yang Liu Baigui Sun Ruqi Huang 189 11 0 28 Mar 2024
AnimateMe: 4D Facial Expressions via Diffusion Models Dimitrios Gerogiannis Foivos Paraperas-Papantoniou Rolandos Alexandros Potamias Alexandros Lattas Stylianos Moschoglou Stylianos Ploumpis Stefanos Zafeiriou 229 9 0 25 Mar 2024
Driving Animatronic Robot Facial Expression From Speech Boren Li Hang Li Hangxin Liu 176 5 0 19 Mar 2024
EmoVOCA: Speech-Driven Emotional 3D Talking HeadsIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024 Federico Nocentini Claudio Ferrari Stefano Berretti 287 9 0 19 Mar 2024
ScanTalk: 3D Talking Heads from Unregistered Scans Federico Nocentini T. Besnier Claudio Ferrari Sylvain Arguillere Stefano Berretti Mohamed Daoudi 311 13 0 16 Mar 2024
Dyadic Interaction Modeling for Social Behavior GenerationEuropean Conference on Computer Vision (ECCV), 2024 Minh Tran Di Chang Maksim Siniukov Mohammad Soleymani VGen 259 19 0 14 Mar 2024
VLOGGER: Multimodal Diffusion for Embodied Avatar SynthesisComputer Vision and Pattern Recognition (CVPR), 2024 Enric Corona Andrei Zanfir Eduard Gabriel Bazavan Nikos Kolotouros Thiemo Alldieck C. Sminchisescu VGen DiffM 188 45 0 13 Mar 2024
CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generation Xi Liu Ying Guo Cheng Zhen Tong Li Yingying Ao Pengfei Yan DiffM 311 14 0 01 Mar 2024
AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation Yasheng Sun Wenqing Chu Hang Zhou Kaisiyuan Wang Hideki Koike 130 10 0 25 Feb 2024
DiffSpeaker: Speech-Driven 3D Facial Animation with Diffusion Transformer Zhiyuan Ma Xiangyu Zhu Guojun Qi Chen Qian Zhaoxiang Zhang Zhen Lei 161 22 0 08 Feb 2024
Media2Face: Co-speech Facial Animation Generation With Multi-Modality GuidanceInternational Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), 2024 Qingcheng Zhao Pengyu Long Qixuan Zhang Dafei Qin Hanming Liang Longwen Zhang Yingliang Zhang Jingyi Yu Lan Xu DiffM 3DH 207 51 0 28 Jan 2024
DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture GenerationComputer Vision and Pattern Recognition (CVPR), 2024 Junming Chen Yunfei Liu Jianan Wang Ailing Zeng Yu Li Qifeng Chen VGen 235 57 0 09 Jan 2024
From Audio to Photoreal Embodiment: Synthesizing Humans in ConversationsComputer Vision and Pattern Recognition (CVPR), 2024 Evonne Ng Javier Romero Timur M. Bagautdinov Shaojie Bai Trevor Darrell Angjoo Kanazawa Alexander Richard VGen 185 69 0 03 Jan 2024
EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture ModelingComputer Vision and Pattern Recognition (CVPR), 2023 Haiyang Liu Zihao Zhu Giorgio Becherini Yichen Peng Mingyang Su You Zhou Xuefei Zhe Naoya Iwamoto Bo Zheng Michael J. Black SLR 836 71 0 31 Dec 2023
SAiD: Speech-driven Blendshape Facial Animation with Diffusion Inkyu Park Jaewoong Cho 240 10 0 25 Dec 2023
Mimic: Speaking Style Disentanglement for Speech-Driven 3D Facial Animation Hui Fu Zeqing Wang Ke Gong Keze Wang Tianshui Chen Haojie Li Haifeng Zeng Xiandong Li 169 21 0 18 Dec 2023
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head ModelsComputer Vision and Pattern Recognition (CVPR), 2023 Shivangi Aneja Justus Thies Angela Dai Matthias Nießner DiffM VGen 403 52 0 13 Dec 2023
GSmoothFace: Generalized Smooth Talking Face Generation via Fine Grained 3D Face GuidanceIEEE Transactions on Visualization and Computer Graphics (TVCG), 2023 Haiming Zhang Zhihao Yuan Chaoda Zheng Xu Yan Baoyuan Wang Guanbin Li Song Wu Shuguang Cui Zhen Li CVBM 145 1 0 12 Dec 2023
GMTalker: Gaussian Mixture-based Audio-Driven Emotional Talking Video Portraits Yibo Xia Lizhen Wang Xiang Deng Xiaoyan Luo Yunhong Wang Yebin Liu VGen 263 2 0 12 Dec 2023
SingingHead: A Large-scale 4D Dataset for Singing Head Animation Sijing Wu Yunhao Li Weitian Zhang Jun Jia Yucheng Zhu Manwen Liao Guangtao Zhai Xiaokang Yang 196 5 0 07 Dec 2023
PMMTalk: Speech-Driven 3D Facial Animation from Complementary Pseudo Multi-modal FeaturesIEEE transactions on multimedia (IEEE TMM), 2023 Tianshun Han Shengnan Gui Yiqing Huang Baihui Li Lijian Liu ... Quan Lu Ruicong Zhi Yanyan Liang Du Zhang Jun Wan VGen 174 6 0 05 Dec 2023
3DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing Balamurugan Thambiraja S. Aliakbarian Darren Cosker Justus Thies DiffM VGen 260 16 0 01 Dec 2023
Probabilistic Speech-Driven 3D Facial Motion Synthesis: New Benchmarks, Methods, and ApplicationsComputer Vision and Pattern Recognition (CVPR), 2023 Karren D. Yang Anurag Ranjan Jen-Hao Rick Chang Raviteja Vemulapalli Oncel Tuzel 249 13 0 30 Nov 2023
DiffusionTalker: Personalization and Acceleration for Speech-Driven 3D Face Diffuser Peng Chen Xiaobao Wei Ming Lu Yitong Zhu Nai-Ming Yao Xingyu Xiao Hui Chen 243 21 0 28 Nov 2023
Multimodal Large Language Models: A SurveyBigData Congress [Services Society] (BSS), 2023 Jiayang Wu Wensheng Gan Zefeng Chen Shicheng Wan Philip S. Yu 204 290 0 22 Nov 2023
DualTalker: A Cross-Modal Dual Learning Approach for Speech-Driven 3D Facial Animation Guinan Su Yanwu Yang Zhifeng Li VGen 204 3 0 08 Nov 2023
LaughTalk: Expressive 3D Talking Head Generation with LaughterIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023 Kim Sung-Bin Lee Hyun Da Hye Hong Suekyeong Nam Janghoon Ju Tae-Hyun Oh 253 29 0 02 Nov 2023
Breathing Life into Faces: Speech-driven 3D Facial Animation with Natural Head Pose and Detailed Shape Wei Zhao Yijun Wang Tianyu He Li-Ping Yin Jianxin Lin Xin Jin 3DH 144 5 0 31 Oct 2023
Personalized Speech-driven Expressive 3D Facial Animation Synthesis with Style Control Elif Bozkurt 179 1 0 25 Oct 2023
CorrTalk: Correlation Between Hierarchical Speech and Facial Activity Variances for 3D Animation Zhaojie Chu K. Guo Xiaofen Xing Yilin Lan Bolun Cai Xiangmin Xu 187 11 0 17 Oct 2023
AdaMesh: Personalized Facial Expressions and Head Poses for Adaptive Speech-Driven 3D Facial AnimationIEEE transactions on multimedia (IEEE TMM), 2023 Liyang Chen Weihong Bao Shunwei Lei Boshi Tang Zhiyong Wu Shiyin Kang Haozhi Huang Helen M. Meng 304 3 0 11 Oct 2023
A Large-Scale 3D Face Mesh Video Dataset via Neural Re-parameterized Optimization Youwang Kim Lee Hyun Kim Sung-Bin Suekyeong Nam Janghoon Ju Tae-Hyun Oh CVBM 3DH 204 4 0 04 Oct 2023
DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion ModelsACM Transactions on Graphics (TOG), 2023 Zhiyao Sun Tian Lv Sheng Ye Matthieu Lin Jenny Sheng Yuhui Wen Minjing Yu Yong Liu DiffM 340 86 0 30 Sep 2023
Emotional Listener Portrait: Neural Listener Head Generation with EmotionIEEE International Conference on Computer Vision (ICCV), 2023 Luchuan Song Guojun Yin Zhenchao Jin Xiaoyi Dong Chenliang Xu 369 18 0 29 Sep 2023
FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using DiffusionMotion in Games (MiG), 2023 Stefan Stan Kazi Injamamul Haque Zerrin Yumak DiffM 284 87 0 20 Sep 2023
Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short VideoIEEE International Conference on Computer Vision (ICCV), 2023 Xiuzhe Wu Pengfei Hu Yang Wu Xiaoyang Lyu Yan-Pei Cao Ying Shan Wenming Yang Zhongqian Sun Xiaojuan Qi 94 15 0 09 Sep 2023
ReliTalk: Relightable Talking Portrait Generation from a Single VideoInternational Journal of Computer Vision (IJCV), 2023 Haonan Qiu Zhaoxi Chen Yuming Jiang Hang Zhou Xiangyu Fan Lei Yang Wayne Wu Ziwei Liu DiffM VGen 202 14 0 05 Sep 2023
ExpCLIP: Bridging Text and Facial Expressions via Semantic AlignmentAAAI Conference on Artificial Intelligence (AAAI), 2023 Yicheng Zhong Huawei Wei Pei-Yin Yang Zhisheng Wang CLIP 227 18 0 28 Aug 2023