All Papers

Title

Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction

5 December 2020

G. Gafni

Justus Thies

Michael Zollhöfer

Matthias Nießner

3DH

ArXiv (abs)PDF HTML

Papers citing "Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction"

50 / 376 papers shown

Title
PSAvatar: A Point-based Shape Model for Real-Time Head Avatar Animation with 3D Gaussian Splatting Zhongyuan Zhao Zhenyu Bao Qing Li Guoping Qiu Kanglin Liu 3DGS 184 12 0 23 Jan 2024
GPAvatar: Generalizable and Precise Head Avatar from Image(s) Xuangeng Chu Yu Li Ailing Zeng Tianyu Yang Lijian Lin Yunfei Liu Tatsuya Harada 3DGS 140 33 0 18 Jan 2024
$Tri$^{2}$-plane: Thinking Head Avatar via Feature Pyramid$ Tri $^{2}$ -plane: Thinking Head Avatar via Feature Pyramid Luchuan Song Pinxin Liu Lele Chen Guojun Yin Chenliang Xu 3DH 110 11 0 17 Jan 2024
High-Quality Mesh Blendshape Generation from Face Videos via Neural Inverse Rendering Xin Ming Jiawei Li Jingwang Ling Libo Zhang Feng Xu 3DH 87 3 0 16 Jan 2024
RustNeRF: Robust Neural Radiance Field with Low-Quality Images Mengfei Li Ming Lu Xiaofang Li Shanghang Zhang 71 1 0 06 Jan 2024
Real-and-Present: Investigating the Use of Life-Size 2D Video Avatars in HMD-Based AR Teleconferencing Xuanyu Wang Weizhan Zhang Christian Sandor Hongbo Fu 66 2 0 04 Jan 2024
HISR: Hybrid Implicit Surface Representation for Photorealistic 3D Human Reconstruction Angtian Wang Yuanlu Xu N. Sarafianos Robert Maier Edmond Boyer Yaoyao Liu Tony Tung 3DH 106 4 0 28 Dec 2023
INFAMOUS-NeRF: ImproviNg FAce MOdeling Using Semantically-Aligned Hypernetworks with Neural Radiance Fields Andrew Hou Feng Liu Zhiyuan Ren Michel Sarkis Ning Bi Yiying Tong Xiaoming Liu CVBM 74 3 0 23 Dec 2023
HeadCraft: Modeling High-Detail Shape Variations for Animated 3DMMs Artem Sevastopolsky Philip-William Grassal Simon Giebenhain ShahRukh Athar Luisa Verdoliva Matthias Niessner 3DH 285 4 0 21 Dec 2023
NICP: Neural ICP for 3D Human Registration at Scale R. Marin Enric Corona Gerard Pons-Moll 3DH 136 12 0 21 Dec 2023
AE-NeRF: Audio Enhanced Neural Radiance Field for Few Shot Talking Head Synthesis Dongze Li Kang Zhao Wei Wang Bo Peng Yingya Zhang Jing Dong Tien-Ping Tan DiffM VGen 94 19 0 18 Dec 2023
Learning Dense Correspondence for NeRF-Based Face Reenactment Songlin Yang Wei Wang Yushi Lan Xiangyu Fan Bo Peng Lei Yang Jing Dong CVBM 3DH 88 7 0 16 Dec 2023
Attention-Based VR Facial Animation with Visual Mouth Camera Guidance for Immersive Telepresence Avatars Andre Rochow Max Schwarz Sven Behnke 3DH 108 3 0 15 Dec 2023
HeadRecon: High-Fidelity 3D Head Reconstruction from Monocular Video Xueying Wang Juyong Zhang 74 0 0 14 Dec 2023
A Local Appearance Model for Volumetric Capture of Diverse Hairstyle Ziyan Wang Giljoo Nam Aljaz Bozic Chen Cao Jason M. Saragih Michael Zollhoefer Jessica Hodgins 3DH 43 2 0 14 Dec 2023
NViST: In the Wild New View Synthesis from a Single Image with Transformers Wonbong Jang Lourdes Agapito ViT 109 15 0 13 Dec 2023
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models Shivangi Aneja Justus Thies Angela Dai Matthias Nießner DiffM VGen 183 42 0 13 Dec 2023
MonoNPHM: Dynamic Head Reconstruction from Monocular Videos Simon Giebenhain Tobias Kirschstein Markos Georgopoulos Martin Rünz Lourdes Agapito Matthias Nießner 3DH 128 21 0 11 Dec 2023
NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videos Jinxi Li Ziyang Song Bo Yang 3DH 85 20 0 11 Dec 2023
DisControlFace: Disentangled Control for Personalized Facial Image Editing Haozhe Jia Yan Li Hengfei Cui Di Xu Changpeng Yang Yuwang Wang Tao Yu DiffM 76 1 0 11 Dec 2023
CoGS: Controllable Gaussian Splatting Heng Yu Joel Julin Z. '. Milacski Koichiro Niinuma László A. Jeni 3DGS 95 28 0 09 Dec 2023
R2-Talker: Realistic Real-Time Talking Head Synthesis with Hash Grid Landmarks Encoding and Progressive Multilayer Conditioning Zhiling Ye LiangGuo Zhang Dingheng Zeng Quan Lu Ning Jiang 95 1 0 09 Dec 2023
360° Volumetric Portrait Avatar Jalees Nehvi Berna Kabadayi Julien P. C. Valentin Justus Thies 3DH 76 1 0 08 Dec 2023
TriHuman : A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis Heming Zhu Fangneng Zhan Christian Theobalt Marc Habermann 3DH 150 21 0 08 Dec 2023
VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactment Phong Tran Egor Zakharov Long-Nhat Ho Anh Tran Liwen Hu Hao Li 3DH 104 18 0 07 Dec 2023
MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatar Yufan Chen Lizhen Wang Qijing Li Hongjiang Xiao Shengping Zhang Hongxun Yao Yebin Liu 3DGS 103 69 0 07 Dec 2023
HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting Yuheng Jiang Zhehao Shen Penghao Wang Zhuo Su Yu Hong Yingliang Zhang Jingyi Yu Lan Xu 3DGS 134 60 0 06 Dec 2023
Artist-Friendly Relightable and Animatable Neural Heads Yingyan Xu Prashanth Chandran Sebastian Weiss Markus Gross Gaspard Zoss Derek Bradley 3DH 133 6 0 06 Dec 2023
Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing Yushi Lan Feitong Tan Di Qiu Qiangeng Xu Kyle Genova ... S. Fanello Rohit Pandey Thomas Funkhouser Chen Change Loy Yinda Zhang 3DGS 116 20 0 05 Dec 2023
HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting Helisa Dhamo Yinyu Nie Arthur Moreau Jifei Song Richard Shaw Yiren Zhou Eduardo Pérez-Pellitero 3DGS 107 38 0 05 Dec 2023
MyPortrait: Morphable Prior-Guided Personalized Portrait Generation Bo Ding Zhenfeng Fan Shuang Yang Shihong Xia 103 3 0 05 Dec 2023
Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians Yuelang Xu Benwang Chen Zhe Li Hongwen Zhang Lizhen Wang Zerong Zheng Yebin Liu 3DGS 116 34 0 05 Dec 2023
Instant Uncertainty Calibration of NeRFs Using a Meta-calibrator Niki Amini-Naieni Tomas Jakab Andrea Vedaldi Ronald Clark 135 2 0 04 Dec 2023
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians Shenhan Qian Tobias Kirschstein Liam Schoneveld Davide Davoli Simon Giebenhain Matthias Nießner 3DGS 163 153 0 04 Dec 2023
GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation Jie Wang Jiucheng Xie Xianyan Li Feng Xu Chi-Man Pun Hao Gao 3DGS 198 29 0 04 Dec 2023
InvertAvatar: Incremental GAN Inversion for Generalized Head Avatars Xiaochen Zhao Jingxiang Sun Lizhen Wang Jinli Suo Yebin Liu DiffM 147 4 0 03 Dec 2023
VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams Liao Wang Kaixin Yao Chengcheng Guo Zhirui Zhang Qiang Hu Jingyi Yu Lan Xu Minye Wu 3DH 98 15 0 03 Dec 2023
FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embedding Jun Xiang Xuan Gao Yudong Guo Juyong Zhang 3DGS 125 51 0 03 Dec 2023
3DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing Balamurugan Thambiraja S. Aliakbarian Darren Cosker Justus Thies DiffM VGen 163 13 0 01 Dec 2023
DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatars Tobias Kirschstein Simon Giebenhain Matthias Nießner 175 31 0 30 Nov 2023
CosAvatar: Consistent and Animatable Portrait Video Tuning with Text Prompt Haiyao Xiao Chenglai Zhong Xuan Gao Yudong Guo Juyong Zhang 90 0 0 30 Nov 2023
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis Ziqiao Peng Wentao Hu Yue Shi Xiangyu Zhu Xiaomei Zhang Hao Zhao Jun He Hongyan Liu Zhaoxin Fan 122 62 0 29 Nov 2023
GART: Gaussian Articulated Template Models Jiahui Lei Yufu Wang Georgios Pavlakos Lingjie Liu Kostas Daniilidis 3DGS 146 101 0 27 Nov 2023
GAN-Avatar: Controllable Personalized GAN-based Human Head Avatar Berna Kabadayi Wojciech Zielonka Bharat Lal Bhatnagar Gerard Pons-Moll Justus Thies 3DH 116 9 0 22 Nov 2023
Drivable 3D Gaussian Avatars Wojciech Zielonka Timur M. Bagautdinov Forrest Iandola Michael Zollhöfer Justus Thies Javier Romero 3DGS 204 115 0 14 Nov 2023
CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformer Haoyu Ma Tong Zhang Shanlin Sun Xiangyi Yan Kun Han Xiaohui Xie 106 13 0 11 Nov 2023
BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesis Hao-Bin Duan Miao Wang Jin-Chuan Shi Xu-Chuan Chen Yan-Pei Cao 3DH 121 22 0 09 Nov 2023
3D-Aware Talking-Head Video Motion Transfer Haomiao Ni Jiachen Liu Yuan Xue S. X. Huang DiffM 153 5 0 05 Nov 2023
FPO++: Efficient Encoding and Rendering of Dynamic Neural Radiance Fields by Analyzing and Enhancing Fourier PlenOctrees Saskia Rabich P. Stotko Reinhard Klein 91 6 0 31 Oct 2023
PERF: Panoramic Neural Radiance Field from a Single Panorama Guangcong Wang Peng Wang Zhaoxi Chen Wenping Wang Chen Change Loy Ziwei Liu MDE 137 39 0 25 Oct 2023

Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction

5 December 2020

G. Gafni

Justus Thies

Michael Zollhöfer

Matthias Nießner

3DH

ArXiv (abs)PDF HTML

Papers citing "Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction"

50 / 376 papers shown

Title
PSAvatar: A Point-based Shape Model for Real-Time Head Avatar Animation with 3D Gaussian Splatting Zhongyuan Zhao Zhenyu Bao Qing Li Guoping Qiu Kanglin Liu 3DGS 184 12 0 23 Jan 2024
GPAvatar: Generalizable and Precise Head Avatar from Image(s) Xuangeng Chu Yu Li Ailing Zeng Tianyu Yang Lijian Lin Yunfei Liu Tatsuya Harada 3DGS 140 33 0 18 Jan 2024
$Tri$^{2}$-plane: Thinking Head Avatar via Feature Pyramid$ Tri $^{2}$ -plane: Thinking Head Avatar via Feature Pyramid Luchuan Song Pinxin Liu Lele Chen Guojun Yin Chenliang Xu 3DH 110 11 0 17 Jan 2024
High-Quality Mesh Blendshape Generation from Face Videos via Neural Inverse Rendering Xin Ming Jiawei Li Jingwang Ling Libo Zhang Feng Xu 3DH 87 3 0 16 Jan 2024
RustNeRF: Robust Neural Radiance Field with Low-Quality Images Mengfei Li Ming Lu Xiaofang Li Shanghang Zhang 71 1 0 06 Jan 2024
Real-and-Present: Investigating the Use of Life-Size 2D Video Avatars in HMD-Based AR Teleconferencing Xuanyu Wang Weizhan Zhang Christian Sandor Hongbo Fu 66 2 0 04 Jan 2024
HISR: Hybrid Implicit Surface Representation for Photorealistic 3D Human Reconstruction Angtian Wang Yuanlu Xu N. Sarafianos Robert Maier Edmond Boyer Yaoyao Liu Tony Tung 3DH 106 4 0 28 Dec 2023
INFAMOUS-NeRF: ImproviNg FAce MOdeling Using Semantically-Aligned Hypernetworks with Neural Radiance Fields Andrew Hou Feng Liu Zhiyuan Ren Michel Sarkis Ning Bi Yiying Tong Xiaoming Liu CVBM 74 3 0 23 Dec 2023
HeadCraft: Modeling High-Detail Shape Variations for Animated 3DMMs Artem Sevastopolsky Philip-William Grassal Simon Giebenhain ShahRukh Athar Luisa Verdoliva Matthias Niessner 3DH 285 4 0 21 Dec 2023
NICP: Neural ICP for 3D Human Registration at Scale R. Marin Enric Corona Gerard Pons-Moll 3DH 136 12 0 21 Dec 2023
AE-NeRF: Audio Enhanced Neural Radiance Field for Few Shot Talking Head Synthesis Dongze Li Kang Zhao Wei Wang Bo Peng Yingya Zhang Jing Dong Tien-Ping Tan DiffM VGen 94 19 0 18 Dec 2023
Learning Dense Correspondence for NeRF-Based Face Reenactment Songlin Yang Wei Wang Yushi Lan Xiangyu Fan Bo Peng Lei Yang Jing Dong CVBM 3DH 88 7 0 16 Dec 2023
Attention-Based VR Facial Animation with Visual Mouth Camera Guidance for Immersive Telepresence Avatars Andre Rochow Max Schwarz Sven Behnke 3DH 108 3 0 15 Dec 2023
HeadRecon: High-Fidelity 3D Head Reconstruction from Monocular Video Xueying Wang Juyong Zhang 74 0 0 14 Dec 2023
A Local Appearance Model for Volumetric Capture of Diverse Hairstyle Ziyan Wang Giljoo Nam Aljaz Bozic Chen Cao Jason M. Saragih Michael Zollhoefer Jessica Hodgins 3DH 43 2 0 14 Dec 2023
NViST: In the Wild New View Synthesis from a Single Image with Transformers Wonbong Jang Lourdes Agapito ViT 109 15 0 13 Dec 2023
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models Shivangi Aneja Justus Thies Angela Dai Matthias Nießner DiffM VGen 183 42 0 13 Dec 2023
MonoNPHM: Dynamic Head Reconstruction from Monocular Videos Simon Giebenhain Tobias Kirschstein Markos Georgopoulos Martin Rünz Lourdes Agapito Matthias Nießner 3DH 128 21 0 11 Dec 2023
NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videos Jinxi Li Ziyang Song Bo Yang 3DH 85 20 0 11 Dec 2023
DisControlFace: Disentangled Control for Personalized Facial Image Editing Haozhe Jia Yan Li Hengfei Cui Di Xu Changpeng Yang Yuwang Wang Tao Yu DiffM 76 1 0 11 Dec 2023
CoGS: Controllable Gaussian Splatting Heng Yu Joel Julin Z. '. Milacski Koichiro Niinuma László A. Jeni 3DGS 95 28 0 09 Dec 2023
R2-Talker: Realistic Real-Time Talking Head Synthesis with Hash Grid Landmarks Encoding and Progressive Multilayer Conditioning Zhiling Ye LiangGuo Zhang Dingheng Zeng Quan Lu Ning Jiang 95 1 0 09 Dec 2023
360° Volumetric Portrait Avatar Jalees Nehvi Berna Kabadayi Julien P. C. Valentin Justus Thies 3DH 76 1 0 08 Dec 2023
TriHuman : A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis Heming Zhu Fangneng Zhan Christian Theobalt Marc Habermann 3DH 150 21 0 08 Dec 2023
VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactment Phong Tran Egor Zakharov Long-Nhat Ho Anh Tran Liwen Hu Hao Li 3DH 104 18 0 07 Dec 2023
MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatar Yufan Chen Lizhen Wang Qijing Li Hongjiang Xiao Shengping Zhang Hongxun Yao Yebin Liu 3DGS 103 69 0 07 Dec 2023
HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting Yuheng Jiang Zhehao Shen Penghao Wang Zhuo Su Yu Hong Yingliang Zhang Jingyi Yu Lan Xu 3DGS 134 60 0 06 Dec 2023
Artist-Friendly Relightable and Animatable Neural Heads Yingyan Xu Prashanth Chandran Sebastian Weiss Markus Gross Gaspard Zoss Derek Bradley 3DH 133 6 0 06 Dec 2023
Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing Yushi Lan Feitong Tan Di Qiu Qiangeng Xu Kyle Genova ... S. Fanello Rohit Pandey Thomas Funkhouser Chen Change Loy Yinda Zhang 3DGS 116 20 0 05 Dec 2023
HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting Helisa Dhamo Yinyu Nie Arthur Moreau Jifei Song Richard Shaw Yiren Zhou Eduardo Pérez-Pellitero 3DGS 107 38 0 05 Dec 2023
MyPortrait: Morphable Prior-Guided Personalized Portrait Generation Bo Ding Zhenfeng Fan Shuang Yang Shihong Xia 103 3 0 05 Dec 2023
Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians Yuelang Xu Benwang Chen Zhe Li Hongwen Zhang Lizhen Wang Zerong Zheng Yebin Liu 3DGS 116 34 0 05 Dec 2023
Instant Uncertainty Calibration of NeRFs Using a Meta-calibrator Niki Amini-Naieni Tomas Jakab Andrea Vedaldi Ronald Clark 135 2 0 04 Dec 2023
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians Shenhan Qian Tobias Kirschstein Liam Schoneveld Davide Davoli Simon Giebenhain Matthias Nießner 3DGS 163 153 0 04 Dec 2023
GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation Jie Wang Jiucheng Xie Xianyan Li Feng Xu Chi-Man Pun Hao Gao 3DGS 198 29 0 04 Dec 2023
InvertAvatar: Incremental GAN Inversion for Generalized Head Avatars Xiaochen Zhao Jingxiang Sun Lizhen Wang Jinli Suo Yebin Liu DiffM 147 4 0 03 Dec 2023
VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams Liao Wang Kaixin Yao Chengcheng Guo Zhirui Zhang Qiang Hu Jingyi Yu Lan Xu Minye Wu 3DH 98 15 0 03 Dec 2023
FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embedding Jun Xiang Xuan Gao Yudong Guo Juyong Zhang 3DGS 125 51 0 03 Dec 2023
3DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing Balamurugan Thambiraja S. Aliakbarian Darren Cosker Justus Thies DiffM VGen 163 13 0 01 Dec 2023
DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatars Tobias Kirschstein Simon Giebenhain Matthias Nießner 175 31 0 30 Nov 2023
CosAvatar: Consistent and Animatable Portrait Video Tuning with Text Prompt Haiyao Xiao Chenglai Zhong Xuan Gao Yudong Guo Juyong Zhang 90 0 0 30 Nov 2023
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis Ziqiao Peng Wentao Hu Yue Shi Xiangyu Zhu Xiaomei Zhang Hao Zhao Jun He Hongyan Liu Zhaoxin Fan 122 62 0 29 Nov 2023
GART: Gaussian Articulated Template Models Jiahui Lei Yufu Wang Georgios Pavlakos Lingjie Liu Kostas Daniilidis 3DGS 146 101 0 27 Nov 2023
GAN-Avatar: Controllable Personalized GAN-based Human Head Avatar Berna Kabadayi Wojciech Zielonka Bharat Lal Bhatnagar Gerard Pons-Moll Justus Thies 3DH 116 9 0 22 Nov 2023
Drivable 3D Gaussian Avatars Wojciech Zielonka Timur M. Bagautdinov Forrest Iandola Michael Zollhöfer Justus Thies Javier Romero 3DGS 204 115 0 14 Nov 2023
CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformer Haoyu Ma Tong Zhang Shanlin Sun Xiangyi Yan Kun Han Xiaohui Xie 106 13 0 11 Nov 2023
BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesis Hao-Bin Duan Miao Wang Jin-Chuan Shi Xu-Chuan Chen Yan-Pei Cao 3DH 121 22 0 09 Nov 2023
3D-Aware Talking-Head Video Motion Transfer Haomiao Ni Jiachen Liu Yuan Xue S. X. Huang DiffM 153 5 0 05 Nov 2023
FPO++: Efficient Encoding and Rendering of Dynamic Neural Radiance Fields by Analyzing and Enhancing Fourier PlenOctrees Saskia Rabich P. Stotko Reinhard Klein 91 6 0 31 Oct 2023
PERF: Panoramic Neural Radiance Field from a Single Panorama Guangcong Wang Peng Wang Zhaoxi Chen Wenping Wang Chen Change Loy Ziwei Liu MDE 137 39 0 25 Oct 2023