Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction

5 December 2020

G. Gafni

Justus Thies

Michael Zollhöfer

Matthias Nießner

3DH

ArXiv PDF HTML

Papers citing "Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction"

43 / 43 papers shown

Title
IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos Yuan Li Ziqian Bai Feitong Tan Zhaopeng Cui S. Fanello Yinda Zhang DiffM VGen 66 0 0 27 Apr 2025
Dual Audio-Centric Modality Coupling for Talking Head Generation Ao Fu Ziqi Ni Yi Zhou 75 1 0 26 Mar 2025
HRAvatar: High-Quality and Relightable Gaussian Head Avatar Dongbin Zhang Yunfei Liu Lijian Lin Ye Zhu Kangjie Chen Minghan Qin Yu Li Haoqian Wang 3DGS 57 0 0 11 Mar 2025
LAM: Large Avatar Model for One-shot Animatable Gaussian Head Yisheng He Xiaodong Gu Xiaodan Ye Chao Xu Zhengyi Zhao Yuan Dong Weihao Yuan Zilong Dong Liefeng Bo 3DGS 106 0 0 25 Feb 2025
MM-NeRF: Multimodal-Guided 3D Multi-Style Transfer of Neural Radiance Field Zijian Győző Yang Zhongwei Qiu Chang Xu Dongmei Fu 61 2 0 28 Jan 2025
Synthetic Prior for Few-Shot Drivable Head Avatar Inversion Wojciech Zielonka Stephan Garbin Alexandros Lattas George Kopanas Paulo F. U. Gotardo Thabo Beeler Justus Thies Timo Bolkart 74 2 0 12 Jan 2025
DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstruction Ben Kaye Tomas Jakab Shangzhe Wu Christian Rupprecht Andrea Vedaldi 3DPC 3DH 124 1 0 05 Dec 2024
FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Video Jiawei Zhang Zijian Wu Zhiyang Liang Yicheng Gong Dongfang Hu Yao Yao Xun Cao Hao Zhu 3DGS 119 1 0 23 Nov 2024
SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatars Jaeseong Lee Taewoong Kang Marcel C. Bühler M. Kim Sungwon Hwang J. Hyung Hyojin Jang Jaegul Choo 3DGS 69 1 0 15 Oct 2024
Single Image, Any Face: Generalisable 3D Face Generation Wenqing Wang Haosen Yang Josef Kittler Xiatian Zhu 3DH 92 0 0 25 Sep 2024
HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priors Xiaozheng Zheng Chao Wen Zhaohu Li Weiyi Zhang Zhuo Su ... Zheng Lv Xiaoyuan Zhang Yongjie Zhang Guidong Wang Lan Xu 3DGS 76 11 0 12 Aug 2024
Gaussian Splatting Lucas-Kanade Liuyue Xie Joel Julin Koichiro Niinuma László A. Jeni 3DGS 45 2 0 16 Jul 2024
Gaussian Eigen Models for Human Heads Wojciech Zielonka Timo Bolkart Thabo Beeler Justus Thies 3DGS 68 5 0 05 Jul 2024
3D Gaussian Splatting as Markov Chain Monte Carlo Shakiba Kheradmand Daniel Rebain Gopal Sharma Weiwei Sun Jeff Tseng Hossam N. Isack Abhishek Kar Andrea Tagliasacchi Kwang Moo Yi 3DGS 62 51 0 15 Apr 2024
Towards Geometric-Photometric Joint Alignment for Facial Mesh Registration Xizhi Wang Yaxiong Wang Mengjian Li 3DH 54 1 0 05 Mar 2024
HeadCraft: Modeling High-Detail Shape Variations for Animated 3DMMs Artem Sevastopolsky Philip-William Grassal Simon Giebenhain ShahRukh Athar Luisa Verdoliva Matthias Niessner 3DH 78 4 0 21 Dec 2023
GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation Jie Wang Jiucheng Xie Xianyan Li Feng Xu Chi-Man Pun Hao Gao 3DGS 55 24 0 04 Dec 2023
Drivable 3D Gaussian Avatars Wojciech Zielonka Timur M. Bagautdinov Shunsuke Saito Michael Zollhöfer Justus Thies Javier Romero 3DGS 91 98 0 14 Nov 2023
ID-Reveal: Identity-aware DeepFake Video Detection D. Cozzolino Andreas Rossler Justus Thies Matthias Nießner L. Verdoliva AAML 29 165 0 04 Dec 2020
NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections Ricardo Martín Brualla Noha Radwan Mehdi S. M. Sajjadi Jonathan T. Barron Alexey Dosovitskiy Daniel Duckworth 92 1,476 0 05 Aug 2020
Face2Face: Real-time Face Capture and Reenactment of RGB Videos Justus Thies Michael Zollhöfer Marc Stamminger Christian Theobalt Matthias Nießner 3DH PICV CVBM 13 1,911 0 29 Jul 2020
Neural Sparse Voxel Fields Lingjie Liu Jiatao Gu Kyaw Zaw Lin Tat-Seng Chua Christian Theobalt 226 1,258 0 22 Jul 2020
Generalized Zero and Few-Shot Transfer for Facial Forgery Detection Shivangi Aneja Matthias Nießner 40 42 0 21 Jun 2020
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains Matthew Tancik Pratul P. Srinivasan B. Mildenhall Sara Fridovich-Keil N. Raghavan Utkarsh Singhal R. Ramamoorthi Jonathan T. Barron Ren Ng 69 2,384 0 18 Jun 2020
Implicit Neural Representations with Periodic Activation Functions Vincent Sitzmann Julien N. P. Martel Alexander W. Bergman David B. Lindell Gordon Wetzstein AI4TS 72 2,516 0 17 Jun 2020
Deep 3D Portrait from a Single Image Sicheng Xu Jiaolong Yang Dong Chen Fang Wen Yu Deng Yunde Jia Xin Tong 3DH 29 57 0 24 Apr 2020
State of the Art on Neural Rendering A. Tewari Ohad Fried Justus Thies Vincent Sitzmann Stephen Lombardi ... Christian Theobalt Maneesh Agrawala Eli Shechtman Dan B. Goldman Michael Zollhöfer 3DH 3DV 53 466 0 08 Apr 2020
First Order Motion Model for Image Animation Aliaksandr Siarohin Stéphane Lathuilière Sergey Tulyakov Elisa Ricci N. Sebe VGen DiffM 48 918 0 29 Feb 2020
Media Forensics and DeepFakes: an overview L. Verdoliva 64 544 0 18 Jan 2020
Neural Voice Puppetry: Audio-driven Facial Reenactment Justus Thies Mohamed A. Elgharib A. Tewari Christian Theobalt Matthias Nießner VGen 3DH 56 369 0 11 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 21 42,038 0 03 Dec 2019
Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations Vincent Sitzmann Michael Zollhoefer Gordon Wetzstein 3DPC 3DV 122 1,274 0 04 Jun 2019
Few-Shot Adversarial Learning of Realistic Neural Talking Head Models Egor Zakharov Aliaksandra Shysheya Egor Burkov Victor Lempitsky 3DH 97 629 0 20 May 2019
FaceForensics++: Learning to Detect Manipulated Facial Images Andreas Rossler D. Cozzolino L. Verdoliva Christian Riess Justus Thies Matthias Nießner CVBM 48 2,058 0 25 Jan 2019
ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection D. Cozzolino Justus Thies Andreas Rossler Christian Riess Matthias Nießner L. Verdoliva AAML 44 267 0 06 Dec 2018
DeepVoxels: Learning Persistent 3D Feature Embeddings Vincent Sitzmann Justus Thies Felix Heide Matthias Nießner Gordon Wetzstein Michael Zollhöfer SSL 3DPC MDE 79 667 0 03 Dec 2018
Exposing DeepFake Videos By Detecting Face Warping Artifacts Yuezun Li Siwei Lyu AAML CVBM 32 903 0 01 Nov 2018
MesoNet: a Compact Facial Video Forgery Detection Network Darius Afchar Vincent Nozick Junichi Yamagishi Isao Echizen CVBM PICV 41 1,241 0 04 Sep 2018
Deep Video Portraits Hyeongwoo Kim Pablo Garrido A. Tewari Weipeng Xu Justus Thies Matthias Nießner P. Pérez Christian Richardt Michael Zollhöfer Christian Theobalt 3DH VGen 42 695 0 29 May 2018
FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces Andreas Rossler D. Cozzolino L. Verdoliva Christian Riess Justus Thies Matthias Nießner PICV AAML CVBM 65 375 0 24 Mar 2018
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Y. Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang EGVM 152 11,610 0 11 Jan 2018
Automatic Face Reenactment Pablo Garrido Levi Valgaerts Ole Rehmsen Thorsten Thormählen P. Pérez Christian Theobalt CVBM PICV 3DH 15 166 0 08 Feb 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 106 149,474 0 22 Dec 2014