Capture, Learning, and Synthesis of 3D Speaking Styles

8 May 2019

Papers citing "Capture, Learning, and Synthesis of 3D Speaking Styles"

50 / 201 papers shown

Title
CSTalk: Correlation Supervised Speech-driven 3D Emotional Facial Animation Generation Xiangyu Liang Wenlin Zhuang Tianyong Wang Guangxing Geng Guangyue Geng Haifeng Xia Siyu Xia CVBM 33 1 0 29 Apr 2024
Learn2Talk: 3D Talking Face Learns from 2D Talking Face Yixiang Zhuang Baoping Cheng Yao Cheng Yuntao Jin Renshuai Liu Chengyang Li Xuan Cheng Jing Liao Juncong Lin CVBM 3DH 29 6 0 19 Apr 2024
3D Face Tracking from 2D Video through Iterative Dense UV to Image Flow Felix Taubner Prashant Raina Mathieu Tuli Eu Wern Teh Chul Lee Jinmiao Huang 3DH CVBM 38 4 0 15 Apr 2024
Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communication Mingze Sun Chao Xu Xinyu Jiang Yang Liu Baigui Sun Ruqi Huang 41 3 0 28 Mar 2024
AnimateMe: 4D Facial Expressions via Diffusion Models Dimitrios Gerogiannis Foivos Paraperas-Papantoniou Rolandos Alexandros Potamias Alexandros Lattas Stylianos Moschoglou Stylianos Ploumpis S. Zafeiriou 32 3 0 25 Mar 2024
EmoVOCA: Speech-Driven Emotional 3D Talking Heads Federico Nocentini Claudio Ferrari Stefano Berretti 53 4 0 19 Mar 2024
Driving Animatronic Robot Facial Expression From Speech Boren Li Hang Li Hangxin Liu 26 0 0 19 Mar 2024
ScanTalk: 3D Talking Heads from Unregistered Scans Federico Nocentini T. Besnier Claudio Ferrari Sylvain Arguillere Stefano Berretti Mohamed Daoudi 38 5 0 16 Mar 2024
Dyadic Interaction Modeling for Social Behavior Generation Minh Tran Di Chang Maksim Siniukov Mohammad Soleymani VGen 32 6 0 14 Mar 2024
VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis Enric Corona Andrei Zanfir Eduard Gabriel Bazavan Nikos Kolotouros Thiemo Alldieck C. Sminchisescu VGen DiffM 35 26 0 13 Mar 2024
AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation Yasheng Sun Wenqing Chu Hang Zhou Kaisiyuan Wang Hideki Koike 37 5 0 25 Feb 2024
DiffSpeaker: Speech-Driven 3D Facial Animation with Diffusion Transformer Zhiyuan Ma Xiangyu Zhu Guojun Qi Chen Qian Zhaoxiang Zhang Zhen Lei 22 9 0 08 Feb 2024
Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance Qingcheng Zhao Pengyu Long Qixuan Zhang Dafei Qin Hanming Liang Longwen Zhang Yingliang Zhang Jingyi Yu Lan Xu DiffM 3DH 31 25 0 28 Jan 2024
An Implicit Physical Face Model Driven by Expression and Style Lingchen Yang Gaspard Zoss Prashanth Chandran Paulo F. U. Gotardo Markus Gross B. Solenthaler Eftychios Sifakis Derek Bradley CVBM 3DH AI4CE 27 2 0 27 Jan 2024
DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation Junming Chen Yunfei Liu Jianan Wang Ailing Zeng Yu Li Qifeng Chen VGen 25 28 0 09 Jan 2024
A Survey on 3D Gaussian Splatting Guikun Chen Wenguan Wang 3DGS 30 170 0 08 Jan 2024
From Audio to Photoreal Embodiment: Synthesizing Humans in Conversations Evonne Ng Javier Romero Timur M. Bagautdinov Shaojie Bai Trevor Darrell Angjoo Kanazawa Alexander Richard VGen 25 37 0 03 Jan 2024
EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling Haiyang Liu Zihao Zhu Giorgio Becherini Yichen Peng Mingyang Su You Zhou Xuefei Zhe Naoya Iwamoto Bo Zheng Michael J. Black SLR 31 29 0 31 Dec 2023
SAiD: Speech-driven Blendshape Facial Animation with Diffusion Inkyu Park Jaewoong Cho 29 4 0 25 Dec 2023
Mimic: Speaking Style Disentanglement for Speech-Driven 3D Facial Animation Hui Fu Zeqing Wang Ke Gong Keze Wang Tianshui Chen Haojie Li Haifeng Zeng Wenxiong Kang 36 10 0 18 Dec 2023
DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models Yifeng Ma Shiwei Zhang Jiayu Wang Xiang Wang Yingya Zhang Zhidong Deng DiffM 39 23 0 15 Dec 2023
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models Shivangi Aneja Justus Thies Angela Dai Matthias Nießner DiffM VGen 26 29 0 13 Dec 2023
GSmoothFace: Generalized Smooth Talking Face Generation via Fine Grained 3D Face Guidance Haiming Zhang Zhihao Yuan Chaoda Zheng Xu Yan Baoyuan Wang Guanbin Li Song Wu Shuguang Cui Zhen Li CVBM 42 1 0 12 Dec 2023
R2-Talker: Realistic Real-Time Talking Head Synthesis with Hash Grid Landmarks Encoding and Progressive Multilayer Conditioning Zhiling Ye LiangGuo Zhang Dingheng Zeng Quan Lu Ning Jiang 24 0 0 09 Dec 2023
SingingHead: A Large-scale 4D Dataset for Singing Head Animation Sijing Wu Yunhao Li Weitian Zhang Jun Jia Yucheng Zhu Yichao Yan Guangtao Zhai Xiaokang Yang 41 2 0 07 Dec 2023
PMMTalk: Speech-Driven 3D Facial Animation from Complementary Pseudo Multi-modal Features Tianshun Han Shengnan Gui Yiqing Huang Baihui Li Lijian Liu ... Quan Lu Ruicong Zhi Yanyan Liang Du Zhang Jun Wan VGen 27 1 0 05 Dec 2023
DPHMs: Diffusion Parametric Head Models for Depth-based Tracking Jiapeng Tang Angela Dai Yinyu Nie Lev Markhasin Justus Thies Matthias Niessner DiffM 34 10 0 02 Dec 2023
3DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing Balamurugan Thambiraja S. Aliakbarian Darren Cosker Justus Thies DiffM VGen 40 11 0 01 Dec 2023
Probabilistic Speech-Driven 3D Facial Motion Synthesis: New Benchmarks, Methods, and Applications Karren D. Yang Anurag Ranjan Jen-Hao Rick Chang Raviteja Vemulapalli Oncel Tuzel 25 8 0 30 Nov 2023
SpeechAct: Towards Generating Whole-body Motion from Speech Jinsong Zhang Minjie Zhu Yuxiang Zhang Yebin Liu Kun Li 28 0 0 29 Nov 2023
THInImg: Cross-modal Steganography for Presenting Talking Heads in Images Lin Zhao Hongxuan Li Xuefei Ning Xinru Jiang 27 1 0 28 Nov 2023
DiffusionTalker: Personalization and Acceleration for Speech-Driven 3D Face Diffuser Peng Chen Xiaobao Wei Ming Lu Yitong Zhu Nai-Ming Yao Xingyu Xiao Hui Chen 26 11 0 28 Nov 2023
DualTalker: A Cross-Modal Dual Learning Approach for Speech-Driven 3D Facial Animation Guinan Su Yanwu Yang Zhifeng Li VGen 31 1 0 08 Nov 2023
LaughTalk: Expressive 3D Talking Head Generation with Laughter Kim Sung-Bin Lee Hyun Da Hye Hong Suekyeong Nam Janghoon Ju Tae-Hyun Oh 20 20 0 02 Nov 2023
Breathing Life into Faces: Speech-driven 3D Facial Animation with Natural Head Pose and Detailed Shape Wei Zhao Yijun Wang Tianyu He Li-Ping Yin Jianxin Lin Xin Jin 3DH 16 2 0 31 Oct 2023
Personalized Speech-driven Expressive 3D Facial Animation Synthesis with Style Control Elif Bozkurt 29 0 0 25 Oct 2023
Towards Streaming Speech-to-Avatar Synthesis Tejas S. Prabhune Peter Wu Bohan Yu Gopala K. Anumanchipalli 6 1 0 25 Oct 2023
CorrTalk: Correlation Between Hierarchical Speech and Facial Activity Variances for 3D Animation Zhaojie Chu K. Guo Xiaofen Xing Yilin Lan Bolun Cai Xiangmin Xu 35 5 0 17 Oct 2023
AdaMesh: Personalized Facial Expressions and Head Poses for Adaptive Speech-Driven 3D Facial Animation Liyang Chen Weihong Bao Shunwei Lei Boshi Tang Zhiyong Wu Shiyin Kang Haozhi Huang Helen M. Meng 35 1 0 11 Oct 2023
A Large-Scale 3D Face Mesh Video Dataset via Neural Re-parameterized Optimization Youwang Kim Lee Hyun Kim Sung-Bin Suekyeong Nam Janghoon Ju Tae-Hyun Oh CVBM 3DH 19 3 0 04 Oct 2023
MUNCH: Modelling Unique Ñ Controllable Heads Debayan Deb Suvidha Tripathi Pranit Puri DiffM 16 1 0 04 Oct 2023
DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Models Zhiyao Sun Tian Lv Sheng Ye Matthieu Lin Jenny Sheng Yuhui Wen Minjing Yu Yong-jin Liu DiffM 31 44 0 30 Sep 2023
Emotional Listener Portrait: Neural Listener Head Generation with Emotion Luchuan Song Guojun Yin Zhenchao Jin Xiaoyi Dong Chenliang Xu 22 10 0 29 Sep 2023
FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using Diffusion Stefan Stan Kazi Injamamul Haque Zerrin Yumak DiffM 29 53 0 20 Sep 2023
DiffTalker: Co-driven audio-image diffusion for talking faces via intermediate landmarks Zipeng Qi Xulong Zhang Ning Cheng Jing Xiao Jianzong Wang 14 7 0 14 Sep 2023
ReliTalk: Relightable Talking Portrait Generation from a Single Video Haonan Qiu Zhaoxi Chen Yuming Jiang Hang Zhou Xiangyu Fan Lei Yang Wayne Wu Ziwei Liu DiffM VGen 24 10 0 05 Sep 2023
MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Vision Jianning Li Zongwei Zhou Jiancheng Yang Antonio Pepe Christina Schwarz-Gsaxner ... B. Puladi Pascal Fua Alan L. Yuille Jens Kleesiek Jan Egger MedIm 3DH 26 32 0 30 Aug 2023
ExpCLIP: Bridging Text and Facial Expressions via Semantic Alignment Yicheng Zhong Huawei Wei Pei-Yin Yang Zhisheng Wang CLIP 27 6 0 28 Aug 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey Lin Geng Foo Hossein Rahmani J. Liu 73 31 0 27 Aug 2023
Unpaired Multi-domain Attribute Translation of 3D Facial Shapes with a Square and Symmetric Geometric Map Zhenfeng Fan Zhiheng Zhang Shuang Yang Chongyang Zhong Min Cao Shi-hong Xia 3DH 26 1 0 25 Aug 2023