Text-based Editing of Talking-head Video

4 June 2019

Michael Zollhöfer

Papers citing "Text-based Editing of Talking-head Video"

50 / 129 papers shown

Title
RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion Dacheng Yin Chuanxin Tang Yanqing Liu Xiaoqiang Wang Zhiyuan Zhao Yucheng Zhao Zhiwei Xiong Sheng Zhao Chong Luo 83 12 0 28 Jun 2022
Cross-Forgery Analysis of Vision Transformers and CNNs for Deepfake Image Detection D. Coccomini R. Caldelli Fabrizio Falchi Claudio Gennaro Giuseppe Amato ViT 347 31 0 28 Jun 2022
Face-Dubbing++: Lip-Synchronous, Voice Preserving Translation of Videos Alexander Waibel M. Behr Fevziye Irem Eyiokur Dogucan Yaman Tuan-Nam Nguyen Carlos Mullov Mehmet Arif Demirtas Alperen Kantarci Stefan Constantin H. K. Ekenel CVBM 69 16 0 09 Jun 2022
FlexLip: A Controllable Text-to-Lip System Dan Oneaţă Beáta Lőrincz Adriana Stan H. Cucu 55 3 0 07 Jun 2022
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model Xinya Ji Hang Zhou Kaisiyuan Wang Qianyi Wu Wayne Wu Feng Xu Xun Cao CVBM 150 167 0 30 May 2022
F3A-GAN: Facial Flow for Face Animation with Generative Adversarial Networks Xintian Wu Qihang Zhang Yiming Wu Huanyu Wang Songyuan Li Lingyun Sun Xi Li CVBM 3DH 86 7 0 12 May 2022
Few-shot Forgery Detection via Guided Adversarial Interpolation Haonan Qiu Siyu Chen Bei Gan Kunze Wang Huafeng Shi Jing Shao Ziwei Liu AAML 118 6 0 12 Apr 2022
Expressive Talking Head Video Encoding in StyleGAN2 Latent-Space Trevine Oorloff Yaser Yacoob VGen 67 3 0 28 Mar 2022
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN Fei Yin Yong Zhang Xiaodong Cun Ming Cao Yanbo Fan Xuanxia Wang Qingyan Bai Baoyuan Wu Jue Wang Yujiu Yang CVBM 119 175 0 08 Mar 2022
Freeform Body Motion Generation from Speech Jing-Fen Xu Wei Zhang Yalong Bai Qi-Biao Sun Tao Mei SLR 90 18 0 04 Mar 2022
FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment Y. Nirkin Y. Keller Tal Hassner PICV CVBM 105 41 0 25 Feb 2022
Robust Deepfake On Unrestricted Media: Generation And Detection Trung-Nghia Le H. Nguyen Junichi Yamagishi Isao Echizen 97 7 0 13 Feb 2022
Towards Realistic Visual Dubbing with Heterogeneous Sources Tianyi Xie Liucheng Liao Cheng Bi Benlai Tang Xiang Yin Jianfei Yang Mingjie Wang Jiali Yao Yang Zhang Zejun Ma VGen 53 41 0 17 Jan 2022
Audio-Driven Talking Face Video Generation with Dynamic Convolution Kernels Zipeng Ye Mengfei Xia Ran Yi Juyong Zhang Yu-kun Lai Xuanteng Huang Guoxin Zhang Yong Liu CVBM 76 40 0 16 Jan 2022
Semantic Communications: Principles and Challenges Zhijin Qin Xiaoming Tao Jianhua Lu Wen Tong Geoffrey Ye Li 143 350 0 30 Dec 2021
Generalizing Interactive Backpropagating Refinement for Dense Prediction Fanqing Lin Brigham Young Tony R. Martinez 64 7 0 21 Dec 2021
Watch Those Words: Video Falsification Detection Using Word-Conditioned Facial Motion S. Agarwal Liwen Hu Evonne Ng Trevor Darrell Hao Li Anna Rohrbach AAML 48 19 0 21 Dec 2021
ForgeryNet -- Face Forgery Analysis Challenge 2021: Methods and Results Yinan He Lu Sheng Jing Shao Ziwei Liu Zhaofan Zou ... Mingwen Zhang Zhiheng Wang Zhenhang Huang Tianming Zhang Ningning Zhao CVBM 135 2 0 15 Dec 2021
VirtualCube: An Immersive 3D Video Communication System Yizhong Zhang Jiaolong Yang Zhen Liu Ruicheng Wang Guojun Chen Xin Tong B. Guo 65 45 0 13 Dec 2021
FaceFormer: Speech-Driven 3D Facial Animation with Transformers Yingruo Fan Zhaojiang Lin Jun Saito Wenping Wang Taku Komura CVBM 149 205 0 10 Dec 2021
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields Can Wang Menglei Chai Mingming He Dongdong Chen Jing Liao CLIP 145 388 0 09 Dec 2021
One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning Suzhe Wang Lincheng Li Yueqing Ding Xin Yu CVBM 128 119 0 06 Dec 2021
More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speech Michael Hassid Michelle Tadmor Ramanovich Brendan Shillingford Miaosen Wang Ye Jia Tal Remez DiffM 72 18 0 19 Nov 2021
Fine-grained Identity Preserving Landmark Synthesis for Face Reenactment Haichao Zhang Youcheng Ben Weixiao Zhang Tao Chen Gang Yu Bin-Bin Fu CVBM 23 2 0 10 Oct 2021
Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation Yuanxun Lu Jinxiang Chai Xun Cao 95 89 0 22 Sep 2021
Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration Chuanxin Tang Chong Luo Zhiyuan Zhao Dacheng Yin Yucheng Zhao Wenjun Zeng 66 9 0 12 Sep 2021
Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis Tong Sha Wei Zhang T. Shen Zhoujun Li Tao Mei 80 39 0 05 Sep 2021
Sparse to Dense Motion Transfer for Face Image Animation Ruiqi Zhao Tianyi Wu Guodong Guo 3DH CVBM 84 28 0 01 Sep 2021
Learning to Cut by Watching Movies Alejandro Pardo Fabian Caba Heilbron Juan Carlos León Alcázar Ali K. Thabet Guohao Li VGen 125 20 0 09 Aug 2021
Neural Relighting and Expression Transfer On Video Portraits Youjia Wang Taotao Zhou Minzhang Li Teng Xu Minye Wu Lan Xu Jingyi Yu 3DH 31 0 0 30 Jul 2021
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion Suzhe Wang Lincheng Li Yu-qiong Ding Changjie Fan Xin Yu VGen 107 166 0 20 Jul 2021
Parallel and High-Fidelity Text-to-Lip Generation Jinglin Liu Zhiying Zhu Yi Ren Wencan Huang Baoxing Huai N. Yuan Zhou Zhao 55 10 0 14 Jul 2021
Egocentric Videoconferencing Mohamed A. Elgharib Mohit Mendiratta Justus Thies Matthias Nießner Hans-Peter Seidel A. Tewari Vladislav Golyanik Christian Theobalt EgoV 63 17 0 07 Jul 2021
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields Keunhong Park U. Sinha Peter Hedman Jonathan T. Barron Sofien Bouaziz Dan B. Goldman Ricardo Martín Brualla S. M. Seitz 91 229 0 24 Jun 2021
LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization A. Lahiri Vivek Kwatra C. Frueh J. P. Lewis C. Bregler 3DH 86 102 0 08 Jun 2021
Automatic Non-Linear Video Editing Transfer Nathan Frey Peggy Chi Weilong Yang Irfan Essa DiffM 134 9 0 14 May 2021
Text2Video: Text-driven Talking-head Video Synthesis with Personalized Phoneme-Pose Dictionary Sibo Zhang Jiahong Yuan Miao Liao Liangjun Zhang 77 34 0 29 Apr 2021
Learned Spatial Representations for Few-shot Talking-Head Synthesis Moustafa Meshry Saksham Suri Larry S. Davis Abhinav Shrivastava 80 44 0 29 Apr 2021
Cross-Domain and Disentangled Face Manipulation with 3D Guidance Can Wang Menglei Chai Mingming He Dongdong Chen Jing Liao CVBM 199 26 0 22 Apr 2021
Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation Lilin Cheng Suzhe Wang Zhimeng Zhang Yu-qiong Ding Yixing Zheng Xin Yu Changjie Fan VGen 45 71 0 16 Apr 2021
M3L: Language-based Video Editing via Multi-Modal Multi-Level Transformers Tsu-Jui Fu Xinze Wang Scott T. Grafton Miguel P. Eckstein Wenjie Wang 122 9 0 02 Apr 2021
Video-Specific Autoencoders for Exploring, Editing and Transmitting Videos Kevin Wang Deva Ramanan Aayush Bansal VGen 39 1 0 31 Mar 2021
ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis Yinan He Bei Gan Siyu Chen Yichun Zhou Guojun Yin Luchuan Song Lu Sheng Jing Shao Ziwei Liu AAML 121 137 0 09 Mar 2021
Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward Momina Masood M. Nawaz K. Malik A. Javed Aun Irtaza AAML 202 323 0 25 Feb 2021
One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing Ting-Chun Wang Arun Mallya Xuan Li 3DH 168 489 0 30 Nov 2020
Nerfies: Deformable Neural Radiance Fields Keunhong Park U. Sinha Jonathan T. Barron Sofien Bouaziz Dan B. Goldman S. M. Seitz Ricardo Martín Brualla 3DH 230 1,146 0 25 Nov 2020
Iterative Text-based Editing of Talking-heads Using Neural Retargeting Xinwei Yao Ohad Fried Kayvon Fatahalian Maneesh Agrawala VGen 68 34 0 21 Nov 2020
Large-scale multilingual audio visual dubbing Yi Yang Brendan Shillingford Yannis Assael Miaosen Wang Wendi Liu ... Eren Sezener Luis C. Cobo Misha Denil Y. Aytar Nando de Freitas 70 21 0 06 Nov 2020
Decentralized Attribution of Generative Models Changhoon Kim Yi Ren Yezhou Yang 65 19 0 27 Oct 2020
Intuitive Facial Animation Editing Based On A Generative RNN Framework Eloïse Berson Catherine Soladié Nicolas Stoiber 3DH CVBM 56 7 0 12 Oct 2020