Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis

18 July 2023

Papers citing "Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis"

39 / 39 papers shown

Title
Audio-Driven Talking Face Video Generation with Joint Uncertainty Learning Yifan Xie Fei Ma Yi Bin Ying He Fei Richard Yu 57 0 0 26 Apr 2025
BIGS: Bimanual Category-agnostic Interaction Reconstruction from Monocular Videos via 3D Gaussian Splatting Jeongwan On Kyeonghwan Gwak Gunyoung Kang Junuk Cha Soohyun Hwang Hyein Hwang Seungryul Baek 29 0 0 12 Apr 2025
SE4Lip: Speech-Lip Encoder for Talking Head Synthesis to Solve Phoneme-Viseme Alignment Ambiguity Yihuan Huang Jiajun Liu Yanzhen Ren Wuyang Liu Juhua Tang 19 0 0 08 Apr 2025
Dual Audio-Centric Modality Coupling for Talking Head Generation Ao Fu Ziqi Ni Yi Zhou 29 1 0 26 Mar 2025
MagicInfinite: Generating Infinite Talking Videos with Your Words and Voice Hongwei Yi Tian Ye Shitong Shao Xuancheng Yang Jiantong Zhao ... Zeke Xie Lei Zhu Wei Li Michael Lingelbach Daquan Zhou VGen 50 1 0 07 Mar 2025
FREAK: Frequency-modulated High-fidelity and Real-time Audio-driven Talking Portrait Synthesis Ziqi Ni Ao Fu Yi Zhou 61 0 0 06 Mar 2025
Personalized Generation In Large Model Era: A Survey Yiyan Xu Jinghao Zhang Alireza Salemi Xinting Hu W. Wang Fuli Feng Hamed Zamani Xiangnan He Tat-Seng Chua 3DV 75 2 0 04 Mar 2025
InsTaG: Learning Personalized 3D Talking Head from Few-Second Video Jiahe Li Jiawei Zhang Xiao Bai Jin Zheng J. Zhou L. Gu 57 0 0 27 Feb 2025
DEGSTalk: Decomposed Per-Embedding Gaussian Fields for Hair-Preserving Talking Face Synthesis Kaijun Deng Dezhi Zheng Jindong Xie Jinbao Wang Weicheng Xie L. Shen Siyang Song 3DGS 27 0 0 31 Dec 2024
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes Zhenhui Ye Tianyun Zhong Yi Ren Ziyue Jiang Jiawei Huang ... Chen Zhang Zehan Wang Xize Chen Xiang Yin Zhou Zhao VGen 31 3 0 09 Oct 2024
EmoGene: Audio-Driven Emotional 3D Talking-Head Generation Wenqing Wang Yun Fu VGen 71 0 0 07 Oct 2024
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details Jian Yang Xukun Wang Wentao Wang Guoming Li Qihang Fang Ruihong Yuan Tianyang Wang Jason Zhaoxin Fan Yeying Jin Zhaoxin Fan VGen 41 1 0 01 Oct 2024
PersonaTalk: Bring Attention to Your Persona in Visual Dubbing Longhao Zhang Shuang Liang Zhipeng Ge Tianshu Hu DiffM VGen 18 5 0 09 Sep 2024
MegActor- $Σ$ : Unlocking Flexible Mixed-Modal Control in Portrait Animation with Diffusion Transformer Shurong Yang Huadong Li Juhao Wu Minhao Jing Linze Li Renhe Ji Jiajun Liang Haoqiang Fan Jin Wang VGen DiffM 35 9 0 27 Aug 2024
S^3D-NeRF: Single-Shot Speech-Driven Neural Radiance Field for High Fidelity Talking Head Synthesis Dongze Li Kang Zhao Wei Wang Yifeng Ma Bo Peng Yingya Zhang Jing Dong 3DH CVBM 22 2 0 18 Aug 2024
EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Head Qianyun He Xinya Ji Ruichen Zheng Yuanxun Lu Zhengyu Diao ... Songcen Xu Xiaofei Wu Zixiao Zhang Xun Cao Hao Zhu 26 4 0 01 Aug 2024
FAGhead: Fully Animate Gaussian Head from Monocular Videos Yixin Xuan Xinyang Li Gongxin Yao Shiwei Zhou Donghui Sun Xiaoxin Chen Yu Pan 3DGS 29 1 0 27 Jun 2024
A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editing Ming Meng Yufei Zhao Bo Zhang Yonggui Zhu Weimin Shi Maxwell Wen Zhaoxin Fan VGen 34 1 0 15 Jun 2024
NeRFFaceSpeech: One-shot Audio-driven 3D Talking Head Synthesis via Generative Prior Gihoon Kim Kwanggyoon Seo Sihun Cha Junyong Noh DiffM 3DH 26 1 0 09 May 2024
GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting Bo Chen Shoukang Hu Qi Chen Chenpeng Du Ran Yi Yanmin Qian Xie Chen 3DGS 13 7 0 29 Apr 2024
TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splatting Jiahe Li Jiawei Zhang Xiao Bai Jin Zheng Xin Ning Jun Zhou Lin Gu 3DGS 46 14 0 23 Apr 2024
GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting Hongyun Yu Zhan Qu Qihang Yu Jianchuan Chen Zhonghua Jiang ... Shengyu Zhang Jimin Xu Fei Wu Chengfei Lv Gang Yu 3DGS 20 12 0 22 Apr 2024
Neural Radiance Field-based Visual Rendering: A Comprehensive Review Mingyuan Yao Yukang Huo Yang Ran Qingbin Tian Ruifeng Wang Haihua Wang AI4CE 27 7 0 31 Mar 2024
Talk3D: High-Fidelity Talking Portrait Synthesis via Personalized 3D Generative Prior Jaehoon Ko Kyusun Cho Joungbin Lee Heeji Yoon Sangmin Lee Sangjun Ahn Seungryong Kim 26 2 0 29 Mar 2024
MUTE-SLAM: Real-Time Neural SLAM with Multiple Tri-Plane Hash Representations Yifan Yan Ruomin He Zhenghua Liu 19 1 0 26 Mar 2024
AlignMiF: Geometry-Aligned Multimodal Implicit Field for LiDAR-Camera Joint Synthesis Tao Tang Guangrun Wang Yixing Lao Peng Chen Jie Liu Liang Lin Kaicheng Yu Xiaodan Liang 36 8 0 27 Feb 2024
Learning Dynamic Tetrahedra for High-Quality Talking Head Synthesis Zicheng Zhang Ruobing Zheng Ziwen Liu Congying Han Tianqi Li Meng Wang Tiande Guo Jingdong Chen Bonan Li Ming Yang 3DH 24 5 0 27 Feb 2024
$Tri$^{2}$-plane: Thinking Head Avatar via Feature Pyramid$ Tri $^{2}$ -plane: Thinking Head Avatar via Feature Pyramid Luchuan Song Pinxin Liu Lele Chen Guojun Yin Chenliang Xu 3DH 23 6 0 17 Jan 2024
Learning Dense Correspondence for NeRF-Based Face Reenactment Songlin Yang Wei Wang Yushi Lan Xiangyu Fan Bo Peng Lei Yang Jing Dong CVBM 3DH 21 6 0 16 Dec 2023
R2-Talker: Realistic Real-Time Talking Head Synthesis with Hash Grid Landmarks Encoding and Progressive Multilayer Conditioning Zhiling Ye LiangGuo Zhang Dingheng Zeng Quan Lu Ning Jiang 19 0 0 09 Dec 2023
GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation Jie Wang Jiucheng Xie Xianyan Li Feng Xu Chi-Man Pun Hao Gao 3DGS 34 23 0 04 Dec 2023
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis Ziqiao Peng Wentao Hu Yue Shi Xiangyu Zhu Xiaomei Zhang Hao Zhao Jun He Hongyan Liu Zhaoxin Fan 22 38 0 29 Nov 2023
CorrTalk: Correlation Between Hierarchical Speech and Facial Activity Variances for 3D Animation Zhaojie Chu K. Guo Xiaofen Xing Yilin Lan Bolun Cai Xiangmin Xu 28 5 0 17 Oct 2023
DT-NeRF: Decomposed Triplane-Hash Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis Yaoyu Su Shaohui Wang Haoqian Wang CVBM 20 2 0 14 Sep 2023
RADIO: Reference-Agnostic Dubbing Video Synthesis Dongyeun Lee Chaewon Kim Sangjoon Yu Jaejun Yoo Gyeong-Moon Park VGen DiffM 13 1 0 05 Sep 2023
A Comprehensive Multi-scale Approach for Speech and Dynamics Synchrony in Talking Head Generation Louis Airale Dominique Vaufreydaz Xavier Alameda-Pineda 11 1 0 04 Jul 2023
Memories are One-to-Many Mapping Alleviators in Talking Face Generation Anni Tang Tianyu He Xuejiao Tan Jun Ling Liang Song CVBM 8 23 0 09 Dec 2022
NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields Liangchen Song Anpei Chen Zhong Li Z. Chen Lele Chen Junsong Yuan Yi Tian Xu Andreas Geiger 125 124 0 28 Oct 2022
Fast Dynamic Radiance Fields with Time-Aware Neural Voxels Jiemin Fang Taoran Yi Xinggang Wang Lingxi Xie Xiaopeng Zhang Wenyu Liu Matthias Nießner Qi Tian VGen 151 288 0 30 May 2022