Neural Head Avatars from Monocular RGB Videos

2 December 2021

Philip-William Grassal

Matthias Nießner

Papers citing "Neural Head Avatars from Monocular RGB Videos"

50 / 152 papers shown

Title
Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization Connor Z. Lin Koki Nagano Jan Kautz E. R. Chan Umar Iqbal Leonidas J. Guibas Gordon Wetzstein S. Khamis 3DH 8 14 0 04 May 2023
NeRSemble: Multi-view Radiance Field Reconstruction of Human Heads Tobias Kirschstein Shenhan Qian Simon Giebenhain Tim Walter Matthias Nießner 3DH 25 87 0 04 May 2023
LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatar Yuelang Xu Hongwen Zhang Lizhen Wang Xiaochen Zhao Han Huang Guojun Qi Yebin Liu 48 51 0 02 May 2023
StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Video Lizhen Wang Xiaochen Zhao Jingxiang Sun Yuxiang Zhang Hongwen Zhang Tao Yu Yebin Liu 3DH 37 37 0 01 May 2023
LumiGAN: Unconditional Generation of Relightable 3D Human Faces Boyang Deng Yifan Wang Gordon Wetzstein CVBM 3DH 22 12 0 25 Apr 2023
AVFace: Towards Detailed Audio-Visual 4D Face Reconstruction Aggelina Chatziagapi Dimitris Samaras 3DH CVBM 8 3 0 25 Apr 2023
Towards Realistic Generative 3D Face Models Aashish Rai Hiresh Gupta Ayush Pandey Francisco Vicente Carrasco Shingo Takagi Amaury Aubel Daeil Kim Aayush Prakash Fernando De la Torre 3DH 8 23 0 24 Apr 2023
Implicit Neural Head Synthesis via Controllable Local Deformation Fields Chuhan Chen Matthew O'Toole Gaurav Bharaj Pablo Garrido 3DH 23 11 0 21 Apr 2023
FIANCEE: Faster Inference of Adversarial Networks via Conditional Early Exits Polina Karpikova Radionova Ekaterina A. Yaschenko Andrei A. Spiridonov Leonid Kostyushko Riccardo Fabbricatore Aleksei Ivakhnenko Samsung AI Center 11 3 0 20 Apr 2023
High-Fidelity and Freely Controllable Talking Head Video Generation Yue Gao Yuan-yuan Zhou Jinglu Wang Xiao Li Xiang Ming Yan Lu VGen 19 35 0 20 Apr 2023
DiffusionRig: Learning Personalized Priors for Facial Appearance Editing Zheng Ding X. Zhang Zhihao Xia Lars Jebe Z. Tu Xiuming Zhang DiffM 17 63 0 13 Apr 2023
One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Field Weichuang Li Longhao Zhang Dong Wang Bingyan Zhao Zhigang Wang Mulin. Chen Bangze Zhang Zhongjian Wang Liefeng Bo Xuelong Li 3DH CVBM 14 52 0 11 Apr 2023
GANHead: Towards Generative Animatable Neural Head Avatars Sijing Wu Yichao Yan Yunhao Li Y. Cheng Wenhan Zhu Ke Gao Xiaobo Li Guangtao Zhai 3DH 23 15 0 08 Apr 2023
Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videos Ziqian Bai Feitong Tan Zeng Huang Kripasindhu Sarkar Danhang Tang ... Rohit Pandey Ping Tan Thabo Beeler S. Fanello Yinda Zhang 3DH 15 39 0 04 Apr 2023
Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation Y. Cheng Yichao Yan Wenhan Zhu Ye Pan Bowen Pan Xiaokang Yang 3DH 23 3 0 28 Mar 2023
HQ3DAvatar: High Quality Controllable 3D Head Avatar Kartik Teotia R. MallikarjunB. Xingang Pan Hyeon-Joong Kim Pablo Garrido Mohamed A. Elgharib Christian Theobalt 28 14 0 25 Mar 2023
Efficient Meshy Neural Fields for Animatable Human Avatars Xiaoke Huang Yiji Cheng Yansong Tang Xiu Li Jie Zhou Jiwen Lu 3DH 11 1 0 23 Mar 2023
Style Transfer for 2D Talking Head Animation Trong-Thang Pham Nhat Le Tuong Khanh Long Do Hung Nguyen Erman Tjiputra Quang-Dieu Tran A. Nguyen 17 3 0 17 Mar 2023
READ Avatars: Realistic Emotion-controllable Audio Driven Avatars Jack D. Saunders Vinay P. Namboodiri VGen 11 11 0 01 Mar 2023
LiveHand: Real-time and Photorealistic Neural Hand Rendering A. Mundra R. MallikarjunB. Jiayi Wang Marc Habermann Christian Theobalt Mohamed A. Elgharib 3DH 19 8 0 15 Feb 2023
MEGANE: Morphable Eyeglass and Avatar Network Junxuan Li Shunsuke Saito Tomas Simon Stephen Lombardi Hongdong Li Jason M. Saragih 19 16 0 09 Feb 2023
Towards a Pipeline for Real-Time Visualization of Faces for VR-based Telepresence and Live Broadcasting Utilizing Neural Rendering Philipp Ladwig Rene Ebertowski Alexander Pech R. Dörner C. Geiger 3DH 22 0 0 04 Jan 2023
Neural Volumetric Blendshapes: Computationally Efficient Physics-Based Facial Blendshapes Nicolas Wagner Ulrich Schwanecke Mario Botsch 3DH AI4CE 29 1 0 23 Dec 2022
HARP: Personalized Hand Reconstruction from a Monocular RGB Video Korrawe Karunratanakul Sergey Prokudin Otmar Hilliges Siyu Tang 3DH 19 23 0 19 Dec 2022
PointAvatar: Deformable Point-based Head Avatars from Videos Yufeng Zheng Yifan Wang Gordon Wetzstein Michael J. Black Otmar Hilliges 3DH 24 133 0 16 Dec 2022
PhoMoH: Implicit Photorealistic 3D Models of Human Heads M. Zanfir Thiemo Alldieck C. Sminchisescu 3DH 14 5 0 14 Dec 2022
PV3D: A 3D Generative Model for Portrait Video Generation Eric Xu Jianfeng Zhang Jun Hao Liew Wenqing Zhang Song Bai Jiashi Feng Mike Zheng Shou VGen 32 20 0 13 Dec 2022
EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points Chengwei Zheng Wen-chang Lin F. Xu VGen 27 33 0 07 Dec 2022
High-Res Facial Appearance Capture from Polarized Smartphone Images Dejan Azinović Olivier Maury C. Hery Mathias Niessner Justus Thies CVBM 3DH 17 15 0 02 Dec 2022
NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animation Ziyan Wang Giljoo Nam Tuur Stuyck Stephen Lombardi Chen Cao Jason M. Saragih Michael Zollhoefer Jessica Hodgins Christoph Lassner 3DH 25 19 0 01 Dec 2022
DINER: Depth-aware Image-based NEural Radiance fields Malte Prinzler Otmar Hilliges Justus Thies 3DH 8 19 0 29 Nov 2022
High-fidelity Facial Avatar Reconstruction from Monocular Video with Generative Priors Yun-Hao Bai Yanbo Fan Xuanxia Wang Yong Zhang Jingxiang Sun Chun Yuan Ying Shan 3DH 6 25 0 28 Nov 2022
AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxels Yuelang Xu Lizhen Wang Xiaochen Zhao Hongwen Zhang Yebin Liu 3DH 32 61 0 23 Nov 2022
Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Video Xingyu Chen Baoyuan Wang H. Shum 3DH 21 30 0 23 Nov 2022
Instant Volumetric Head Avatars Wojciech Zielonka Timo Bolkart Justus Thies 3DH 19 110 0 22 Nov 2022
Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars Jingxiang Sun Xuanxia Wang Lizhen Wang Xiaoyu Li Yong Zhang Hongwen Zhang Yebin Liu 3DH 11 114 0 21 Nov 2022
State of the Art in Dense Monocular Non-Rigid 3D Reconstruction Edith Tretschk Navami Kairanda R. MallikarjunB. Rishabh Dabral Adam Kortylewski Bernhard Egger Marc Habermann Pascal Fua Christian Theobalt Vladislav Golyanik 3DH 15 34 0 27 Oct 2022
Photo-realistic 360 Head Avatars in the Wild Stanislaw Szymanowicz V. Estellers T. Baltrušaitis Matthew W. Johnson 6 2 0 20 Oct 2022
Reconstructing Personalized Semantic Facial NeRF Models From Monocular Video Xuan Gao Chenglai Zhong Jun Xiang Yang Hong Yudong Guo Juyong Zhang 3DH CVBM 58 126 0 12 Oct 2022
Capturing and Animation of Body and Clothing from Monocular Video Yao Feng Jinlong Yang Marc Pollefeys Michael J. Black Timo Bolkart 3DH 80 88 0 04 Oct 2022
Multi-NeuS: 3D Head Portraits from Single Image with Neural Implicit Functions Egor Burkov Ruslan Rakhimov Aleksandr Safin Evgeny Burnaev Victor Lempitsky 3DH 19 7 0 07 Sep 2022
VolTeMorph: Realtime, Controllable and Generalisable Animation of Volumetric Representations Stephan J. Garbin Marek Kowalski V. Estellers Stanislaw Szymanowicz Shideh Rezaeifar Jingjing Shen Matthew W. Johnson Julien P. C. Valentin 3DH AI4CE 14 39 0 01 Aug 2022
Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos P. Filntisis George Retsinas Foivos Paraperas-Papantoniou Athanasios Katsamanis A. Roussos Petros Maragos 3DH 10 27 0 22 Jul 2022
Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera Hongrui Cai Wanquan Feng Xuetao Feng Yan Wang Juyong Zhang 3DH 19 61 0 30 Jun 2022
Realistic One-shot Mesh-based Head Avatars Taras Khakhulin V. Sklyarova Victor Lempitsky Egor Zakharov 3DH 24 97 0 16 Jun 2022
DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes Jia-Wei Liu Yan-Pei Cao Weijia Mao Wenqiao Zhang David Junhao Zhang Jussi Keppo Ying Shan Xiaohu Qie Mike Zheng Shou 164 111 0 31 May 2022
KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypoints Marko Mihajlovic Aayush Bansal Michael Zollhoefer Siyu Tang Shunsuke Saito 3DH 17 86 0 10 May 2022
Towards Metrical Reconstruction of Human Faces Wojciech Zielonka Timo Bolkart Justus Thies CVBM 3DH 6 142 0 13 Apr 2022
I M Avatar: Implicit Morphable Head Avatars from Videos Yufeng Zheng Victoria Fernandez-Abrevaya Marcel C. Bühler Xu Chen Michael J. Black Otmar Hilliges 3DH 25 211 0 14 Dec 2021
Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans Sida Peng Yuanqing Zhang Yinghao Xu Qianqian Wang Qing Shuai Hujun Bao Xiaowei Zhou 3DH 195 681 0 31 Dec 2020