StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN

8 March 2022

Fei Yin

Yong Zhang

Xiaodong Cun

Yujiu Yang

Papers citing "StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN"

50 / 129 papers shown

Title
MagicPortrait: Temporally Consistent Face Reenactment with 3D Geometric Guidance Mengting Wei Yante Li Tuomas Varanka Yan Jiang Licai Sun DiffM VGen 62 0 0 30 Apr 2025
IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos Yuan Li Ziqian Bai Feitong Tan Zhaopeng Cui S. Fanello Yinda Zhang DiffM VGen 52 0 0 27 Apr 2025
FaceCraft4D: Animated 3D Facial Avatar Generation from a Single Image Fei Yin M. Rakesh Chun-Han Yao Rafał Mantiuk Varun Jampani 29 0 0 21 Apr 2025
Exploiting Temporal Audio-Visual Correlation Embedding for Audio-Driven One-Shot Talking Head Animation Zhihua Xu Tianshui Chen Zhijing Yang Siyuan Peng Keze Wang Liang Lin 24 0 0 08 Apr 2025
Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generation Fa-Ting Hong Zunnan Xu Zixiang Zhou Jun Zhou Xiu Li Qin Lin Qinglin Lu D. Xu DiffM VGen 54 2 0 03 Apr 2025
Monocular and Generalizable Gaussian Talking Head Animation Shengjie Gong H. Li Jiapeng Tang Dongming Hu Shuangping Huang Hao Chen Tianshui Chen Zhuoman Liu 3DGS 41 1 0 01 Apr 2025
AvatarArtist: Open-Domain 4D Avatarization Hongyu Liu Xuan Wang Ziyu Wan Yue Ma Jingye Chen Yanbo Fan Yujun Shen Yibing Song Qifeng Chen 41 0 0 25 Mar 2025
HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animation Zunnan Xu Zhentao Yu Zixiang Zhou Jun Zhou Xiaoyu Jin ... Chengfei Cai Shiyu Tang Qin Lin Xiu Li Qinglin Lu DiffM VGen 91 7 0 24 Mar 2025
Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generation Dingcheng Zhen Shunshun Yin Shiyang Qin Hou Yi Ziwei Zhang Siyuan Liu Gan Qi Ming Tao VGen 69 0 0 24 Mar 2025
Controlling Avatar Diffusion with Learnable Gaussian Embedding Xuan Gao Jingtao Zhou Dongyu Liu Yuqi Zhou Juyong Zhang 3DGS DiffM 46 0 0 20 Mar 2025
Unlock Pose Diversity: Accurate and Efficient Implicit Keypoint-based Spatiotemporal Diffusion for Audio-driven Talking Portrait Chaolong Yang Kai Yao Yuyao Yan Chenru Jiang Weiguang Zhao Jie Sun Guangliang Cheng Yifei Zhang Bin Dong K. Huang DiffM 67 0 0 17 Mar 2025
EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models Yixuan Zhang Qing Chang Yuxi Wang Guang Chen Z. Zhang Junran Peng 36 0 0 14 Mar 2025
Removing Averaging: Personalized Lip-Sync Driven Characters Based on Identity Adapter Yanyu Zhu Licheng Bai Jintao Xu Jiwei Tang Hai-tao Zheng 33 0 0 09 Mar 2025
High-Fidelity Relightable Monocular Portrait Animation with Lighting-Controllable Video Diffusion Model Mingtao Guo Guanyu Xing Yanli Liu DiffM VGen 57 0 0 27 Feb 2025
LAM: Large Avatar Model for One-shot Animatable Gaussian Head Yisheng He Xiaodong Gu Xiaodan Ye Chao Xu Zhengyi Zhao Yuan Dong Weihao Yuan Zilong Dong Liefeng Bo 3DGS 74 0 0 25 Feb 2025
GHOST 2.0: generative high-fidelity one shot transfer of heads A. Groshev Anastasiia Iashchenko Pavel Paramonov Denis Dimitrov Andrey Kuznetsov 60 0 0 25 Feb 2025
TEASER: Token Enhanced Spatial Modeling for Expressions Reconstruction Yunfei Liu Lei Zhu Lijian Lin Ye Zhu Ailing Zhang Yu Li 45 1 0 16 Feb 2025
CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Models Felix Taubner Ruihang Zhang Mathieu Tuli David B. Lindell 71 2 0 16 Dec 2024
Sonic: Shifting Focus to Global Audio Perception in Portrait Animation Xiaozhong Ji Xiaobin Hu Zhihong Xu Junwei Zhu Chuming Lin ... Donghao Luo Yi Chen Qin Lin Qinglin Lu Chengjie Wang VGen 73 3 0 25 Nov 2024
Takin-ADA: Emotion Controllable Audio-Driven Animation with Canonical and Landmark Loss Optimization Bin Lin Yanzhen Yu Jianhao Ye Ruitao Lv Y. Yang Ruoye Xie Pan Yu Hongbin Zhou VGen 30 1 0 18 Oct 2024
EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Models Eungbean Lee Somi Jeong K. Sohn DiffM 28 1 0 13 Oct 2024
Generalizable and Animatable Gaussian Head Avatar Xuangeng Chu Tatsuya Harada 3DGS 31 19 0 10 Oct 2024
Learning Frame-Wise Emotion Intensity for Audio-Driven Talking-Head Generation Jingyi Xu Hieu Le Zhixin Shu Yang Wang Yi-Hsuan Tsai Dimitris Samaras 29 0 0 29 Sep 2024
MIMAFace: Face Animation via Motion-Identity Modulated Appearance Feature Learning Yue Han Junwei Zhu Yuxiang Feng Xiaozhong Ji Keke He Xiangtai Li Zhucun Xue Yong Liu 26 0 0 23 Sep 2024
LawDNet: Enhanced Audio-Driven Lip Synthesis via Local Affine Warping Deformation Deng Junli Luo Yihao Yang Xueting Li Siyou Wang Wei Guo Jinyang Shi Ping 26 0 0 14 Sep 2024
StyleTalk++: A Unified Framework for Controlling the Speaking Styles of Talking Heads Suzhen Wang Yifeng Ma Yu Ding Zhipeng Hu Changjie Fan Tangjie Lv Zhidong Deng Xin Yu 38 9 0 14 Sep 2024
CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attention Gaojie Lin Jianwen Jiang Chao Liang Tianyun Zhong Jiaqi Yang Yanbo Zheng VGen DiffM 61 13 0 03 Sep 2024
Interpretable Convolutional SyncNet Sungjoon Park Jaesub Yun Donggeon Lee Minsik Park 52 0 0 02 Sep 2024
G3FA: Geometry-guided GAN for Face Animation Alireza Javanmardi A. Pagani Didier Stricker CVBM 3DH 32 2 0 23 Aug 2024
DEGAS: Detailed Expressions on Full-Body Gaussian Avatars Zhijing Shao D. B. Wang Qing-Yao Tian Yao-Dong Yang Hengyu Meng Zeyu Cai Bo Dong Yu Zhang Kang Zhang Z. Wang 3DGS 34 3 0 20 Aug 2024
HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priors Xiaozheng Zheng Chao Wen Zhaohu Li Weiyi Zhang Zhuo Su ... Zheng Lv Xiaoyuan Zhang Yongjie Zhang Guidong Wang Lan Xu 3DGS 37 11 0 12 Aug 2024
Learning Online Scale Transformation for Talking Head Video Generation Fa-Ting Hong Dan Xu 58 1 0 13 Jul 2024
Audio-driven High-resolution Seamless Talking Head Video Editing via StyleGAN Jiacheng Su Kunhong Liu Liyan Chen Junfeng Yao Qingsong Liu Dongdong Lv VGen 37 3 0 08 Jul 2024
MobilePortrait: Real-Time One-Shot Neural Head Avatars on Mobile Devices Jianwen Jiang Gaojie Lin Zhengkun Rong Chao Liang Yongming Zhu Jiaqi Yang Tianyun Zhong 3DH 80 8 0 08 Jul 2024
A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editing Ming Meng Yufei Zhao Bo Zhang Yonggui Zhu Weimin Shi Maxwell Wen Zhaoxin Fan VGen 34 1 0 15 Jun 2024
Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation Mingwang Xu Hui Li Qingkun Su Hanlin Shang Liwei Zhang Ce Liu Jingdong Wang Yao Yao Siyu Zhu VGen 29 67 0 13 Jun 2024
MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model Muyao Niu Xiaodong Cun Xintao Wang Yong Zhang Ying Shan Yinqiang Zheng DiffM VGen 33 31 0 30 May 2024
VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresence Phong Tran Egor Zakharov Long-Nhat Ho Liwen Hu Adilbek Karmanov Aviral Agarwal Mclean Goldwhite Ariana Bermudez Venegas Anh Tran Hao Li 3DH 34 4 0 25 May 2024
Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control Yue Han Junwei Zhu Keke He Xu Chen Yanhao Ge Wei Li Xiangtai Li Jiangning Zhang Chengjie Wang Yong Liu DiffM 45 26 0 21 May 2024
Future You: A Conversation with an AI-Generated Future Self Reduces Anxiety, Negative Emotions, and Increases Future Self-Continuity Pat Pataranutaporn Kavin Winson Peggy Yin Auttasak Lapapirojn Pichayoot Ouppaphan Monchai Lertsutthiwong Pattie Maes Hal E. Hershfield 33 6 0 21 May 2024
NeRFFaceSpeech: One-shot Audio-driven 3D Talking Head Synthesis via Generative Prior Gihoon Kim Kwanggyoon Seo Sihun Cha Junyong Noh DiffM 3DH 34 1 0 09 May 2024
SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Space Zeren Zhang Haibo Qin Jiayu Huang Yixin Li Hui Lin Yitao Duan Jinwen Ma 35 0 0 09 May 2024
Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation Dogucan Yaman Fevziye Irem Eyiokur Leonard Barmann Seymanur Akti H. K. Ekenel Alexander H. Waibel EGVM 25 9 0 07 May 2024
Coherent 3D Portrait Video Reconstruction via Triplane Fusion Shengze Wang Xueting Li Chao Liu Matthew Chan Michael Stengel Josef Spjut Henry Fuchs Shalini De Mello Koki Nagano 3DH 48 1 0 01 May 2024
EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars Nikita Drobyshev Antoni Bigata Casademunt Konstantinos Vougioukas Zoe Landgraf Stavros Petridis Maja Pantic 39 23 0 29 Apr 2024
3DFlowRenderer: One-shot Face Re-enactment via Dense 3D Facial Flow Estimation Siddharth Nijhawan T. Yashima Tamaki Kojima 3DH 29 0 0 23 Apr 2024
VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time Sicheng Xu Guojun Chen Yu-Xiao Guo Jiaolong Yang Chong Li Zhenyu Zang Yizhong Zhang Xin Tong Baining Guo 40 86 0 16 Apr 2024
EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesis Shuai Tan Bin Ji Mengxiao Bi Ye Pan 33 26 0 02 Apr 2024
Learning to Generate Conditional Tri-plane for 3D-aware Expression Controllable Portrait Animation Taekyung Ki Dongchan Min Gyeongsu Chae 3DH 30 5 0 31 Mar 2024
MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation Seyeon Kim Siyoon Jin Jihye Park Kihong Kim Jiyoung Kim Jisu Nam Seungryong Kim DiffM VGen 52 3 0 28 Mar 2024