v1v2 (latest)

Layered Neural Rendering for Retiming People in Video

ACM Transactions on Graphics (TOG), 2020

16 September 2020

William T. Freeman

Michael Rubinstein

3DH

ArXiv (abs)PDF HTML

Papers citing "Layered Neural Rendering for Retiming People in Video"

50 / 51 papers shown

Title
MILD: Multi-Layer Diffusion Strategy for Complex and Precise Multi-IP Aware Human Erasing Jinghan Yu Junhao Xiao Zhiyuan Ma Yue Ma Kaiqi Liu Yuhan Wang Daizong Liu Xianghao Meng Jianjun Li DiffM 128 0 0 05 Aug 2025
Deep Reinforcement Learning via Object-Centric Attention Johannes Czech Cedric Derstroff Bjarne Gregori Elisabeth Dillies Quentin Delfosse Kristian Kersting OCL 252 0 0 03 Apr 2025
OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Models Dvir Samuel Matan Levy N. Darshan Gal Chechik Rami Ben-Ari DiffM 268 0 0 23 Mar 2025
Surface-SOS: Self-Supervised Object Segmentation via Neural Surface RepresentationIEEE Transactions on Image Processing (TIP), 2024 Xiaoyun Zheng Liwei Liao Jianbo Jiao Feng Gao Ronggang Wang 280 7 0 20 Jan 2025
InterDyn: Controllable Interactive Dynamics with Video Diffusion ModelsComputer Vision and Pattern Recognition (CVPR), 2024 Rick Akkerman Haiwen Feng M. Black Dimitrios Tzionas Victoria Fernandez-Abrevaya VGen AI4CE 534 5 0 16 Dec 2024
Generative Omnimatte: Learning to Decompose Video into LayersComputer Vision and Pattern Recognition (CVPR), 2024 Yao-Chih Lee Erika Lu Sarah Rumbley Michal Geyer Jia-Bin Huang Tali Dekel Forrester Cole DiffM VGen 394 12 0 25 Nov 2024
SeedLM: Compressing LLM Weights into Seeds of Pseudo-Random Generators Rasoul Shafipour David Harrison Maxwell Horton Jeffrey Marker Houman Bedayat Sachin Mehta Mohammad Rastegari Mahyar Najibi Saman Naderiparizi MQ 311 2 0 14 Oct 2024
Splatter a Video: Video Gaussian Representation for Versatile Processing Yang-tian Sun Yi-Hua Huang Lin Ma Xiaoyang Lyu Yan-Pei Cao Xiaojuan Qi 3DGS 251 22 0 19 Jun 2024
NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editing Ting-Hsuan Chen Jiewen Chan Hau-Shiang Shiu Shih-Han Yen Chang-Han Yeh Yu-Lun Liu VGen DiffM 230 6 0 10 Jun 2024
Move Anything with Layered Scene DiffusionComputer Vision and Pattern Recognition (CVPR), 2024 Jiawei Ren Mengmeng Xu Jui-Chieh Wu Ziwei Liu Tao Xiang Antoine Toisoul 199 13 0 10 Apr 2024
MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image GenerationComputer Vision and Pattern Recognition (CVPR), 2024 Petru-Daniel Tudosiu Yongxin Yang Shifeng Zhang Fei Chen Jingyu Sun Gerasimos Lampouras Ignacio Iacobacci Sarah Parisot 226 23 0 03 Apr 2024
Context-aware Talking Face Video Generation Meidai Xuanyuan Yuwang Wang Honglei Guo Qionghai Dai DiffM 130 0 0 28 Feb 2024
A Survey on Generative AI and LLM for Video Generation, Understanding, and Streaming Pengyuan Zhou Lin Wang Zhi Liu Yanbin Hao Pan Hui Sasu Tarkoma J. Kangasharju VGen 205 46 0 30 Jan 2024
GenDeF: Learning Generative Deformation Field for Video Generation Wen Wang Kecheng Zheng Qiuyu Wang Hao Chen Zifan Shi Ceyuan Yang Yujun Shen Chunhua Shen VGen DiffM 159 2 0 07 Dec 2023
DiffusionAtlas: High-Fidelity Consistent Diffusion Video Editing Shao-Yu Chang Hwann-Tzong Chen Tyng-Luh Liu DiffM VGen 182 3 0 05 Dec 2023
Editing Motion Graphics Video via Motion Vectorization and TransformationACM Transactions on Graphics (TOG), 2023 Sharon Zhang Jiaju Ma Jiajun Wu Daniel E. Ritchie Maneesh Agrawala VGen 155 14 0 26 Sep 2023
Hashing Neural Video Decomposition with Multiplicative Residuals in Space-TimeIEEE International Conference on Computer Vision (ICCV), 2023 Cheng-Hung Chan Chengtao Yuan Cheng Sun Hwann-Tzong Chen 142 5 0 25 Sep 2023
GenLayNeRF: Generalizable Layered Representations with 3D Model Alignment for Multi-Human View Synthesis Youssef Abdelkareem Shady Shehata Fakhri Karray 3DH 144 0 0 20 Sep 2023
OmnimatteRF: Robust Omnimatte with 3D Background ModelingIEEE International Conference on Computer Vision (ICCV), 2023 Geng Lin Chen Gao Jia-Bin Huang Changil Kim Yipeng Wang Matthias Zwicker Ayush Saraf 228 13 0 14 Sep 2023
StableVideo: Text-driven Consistency-aware Diffusion Video EditingIEEE International Conference on Computer Vision (ICCV), 2023 Wenhao Chai Xun Guo Gaoang Wang Yang Lu VGen DiffM 185 200 0 18 Aug 2023
CoDeF: Content Deformation Fields for Temporally Consistent Video ProcessingComputer Vision and Pattern Recognition (CVPR), 2023 Ouyang Hao Qiuyu Wang Yuxi Xiao Qingyan Bai Juntao Zhang Kecheng Zheng Xiaowei Zhou Qifeng Chen Yujun Shen DiffM VGen 197 110 0 15 Aug 2023
PAPR: Proximity Attention Point RenderingNeural Information Processing Systems (NeurIPS), 2023 Yanshun Zhang Shichong Peng Alireza Moazeni Ke Li 3DPC DiffM 145 13 0 20 Jul 2023
Deep Image Matting: A Comprehensive Survey Jizhizi Li Jing Zhang Dacheng Tao VLM 219 17 0 10 Apr 2023
Pix2Video: Video Editing using Image DiffusionIEEE International Conference on Computer Vision (ICCV), 2023 Duygu Ceylan C. Huang Niloy J. Mitra DiffM VGen 358 329 0 22 Mar 2023
Normal-guided Garment UV Prediction for Human Re-texturingComputer Vision and Pattern Recognition (CVPR), 2023 Yasamin Jafarian Tuanfeng Y. Wang Duygu Ceylan Jimei Yang N. Carr Yi Zhou Hyunjung Park 3DH 159 13 0 11 Mar 2023
Collage DiffusionIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023 Vishnu Sarukkai Linden Li Arden Ma Christopher Ré Kayvon Fatahalian DiffM 164 34 0 01 Mar 2023
Neural Congealing: Aligning Images to a Joint Semantic AtlasComputer Vision and Pattern Recognition (CVPR), 2023 Dolev Ofri-Amar Michal Geyer Yoni Kasten Tali Dekel 260 30 0 08 Feb 2023
Shape-aware Text-driven Layered Video EditingComputer Vision and Pattern Recognition (CVPR), 2023 Yao-Chih Lee Ji-Ze Jang Yi-Ting Chen Elizabeth Qiu Jia-Bin Huang VGen DiffM 189 59 0 30 Jan 2023
DynIBaR: Neural Dynamic Image-Based RenderingComputer Vision and Pattern Recognition (CVPR), 2022 Zhengqi Li Qianqian Wang Forrester Cole Richard Tucker Noah Snavely VGen 403 249 0 20 Nov 2022
FactorMatte: Redefining Video Matting for Re-Composition TasksACM Transactions on Graphics (TOG), 2022 Zeqi Gu Wenqi Xian Noah Snavely Abe Davis 151 13 0 03 Nov 2022
Segmenting Moving Objects via an Object-Centric Layered RepresentationNeural Information Processing Systems (NeurIPS), 2022 Jun Xie Weidi Xie Andrew Zisserman VOS OCL 219 62 0 05 Jul 2022
APES: Articulated Part Extraction from Sprite SheetsComputer Vision and Pattern Recognition (CVPR), 2022 Zhan Xu Matthew Fisher Yang Zhou Deepali Aneja Rushikesh Dudhat Li Yi E. Kalogerakis 202 2 0 04 Jun 2022
Deformable Sprites for Unsupervised Video DecompositionComputer Vision and Pattern Recognition (CVPR), 2022 Vickie Ye Zhengqi Li Richard Tucker Angjoo Kanazawa Noah Snavely OCL 191 73 0 14 Apr 2022
Text2LIVE: Text-Driven Layered Image and Video EditingEuropean Conference on Computer Vision (ECCV), 2022 Omer Bar-Tal Dolev Ofri-Amar Rafail Fridman Yoni Kasten Tali Dekel VGen DiffM 255 367 0 05 Apr 2022
NeuVV: Neural Volumetric Videos with Immersive Rendering and Editing Jiakai Zhang Liao Wang Xinhang Liu Fuqiang Zhao Minzhang Li Haizhao Dai Boyuan Zhang Wei Yang Lan Xu Jingyi Yu 3DH 185 13 0 12 Feb 2022
Neural Point Light Fields Julian Ost I. Laradji Alejandro Newell Yuval Bahat Felix Heide 231 58 0 02 Dec 2021
The Emergence of Objectness: Learning Zero-Shot Segmentation from VideosNeural Information Processing Systems (NeurIPS), 2021 Runtao Liu Zhirong Wu Stella X. Yu Stephen Lin VOS 195 56 0 11 Nov 2021
Layered Neural Atlases for Consistent Video EditingACM Transactions on Graphics (TOG), 2021 Yoni Kasten Dolev Ofri-Amar Oliver Wang Tali Dekel VGen 393 180 0 23 Sep 2021
Self-supervised Tumor Segmentation through Layer Decomposition Xiaoman Zhang Weidi Xie Chaoqin Huang Yanfeng Wang Ya Zhang Xin Chen Qi Tian 181 7 0 07 Sep 2021
View Synthesis of Dynamic Scenes based on Deep 3D Mask VolumeIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 Kai-En Lin Guowei Yang Lei Xiao Yifan Zhang R. Ramamoorthi VGen 119 1 0 30 Aug 2021
Consistent Depth of Moving Objects in Video Zhoutong Zhang Forrester Cole Richard Tucker William T. Freeman Tali Dekel MDE 123 75 0 02 Aug 2021
Omnimatte: Associating Objects and Their Effects in VideoComputer Vision and Pattern Recognition (CVPR), 2021 Erika Lu Forrester Cole Tali Dekel Andrew Zisserman William T. Freeman Michael Rubinstein DiffM VOS 202 58 0 14 May 2021
Editable Free-viewpoint Video Using a Layered Neural RepresentationACM Transactions on Graphics (TOG), 2021 Jiakai Zhang Xinhang Liu Xinyi Ye Fuqiang Zhao Yanshun Zhang Minye Wu Yingliang Zhang Lan Xu Jingyi Yu VGen 188 190 0 30 Apr 2021
MarioNette: Self-Supervised Sprite LearningNeural Information Processing Systems (NeurIPS), 2021 Dmitriy Smirnov Michael Gharbi Matthew Fisher Vitor Campagnolo Guizilini Alexei A. Efros Justin Solomon SSL OCL 318 40 0 29 Apr 2021
Hierarchical Motion Understanding via Motion ProgramsComputer Vision and Pattern Recognition (CVPR), 2021 Sumith Kulal Jiayuan Mao A. Aiken Jiajun Wu 123 18 0 22 Apr 2021
Self-supervised Video Object Segmentation by Motion GroupingIEEE International Conference on Computer Vision (ICCV), 2021 Charig Yang Hala Lamdouar Erika Lu Andrew Zisserman Weidi Xie VOS OCL 186 180 0 15 Apr 2021
Video-Specific Autoencoders for Exploring, Editing and Transmitting Videos Kevin Wang Deva Ramanan Aayush Bansal VGen 80 1 0 31 Mar 2021
Dynamic Neural GarmentsACM Transactions on Graphics (TOG), 2021 Meng Zhang Duygu Ceylan Tuanfeng Y. Wang Niloy J. Mitra 3DH AI4CE 167 46 0 23 Feb 2021
Hybrid Neural Fusion for Full-frame Video StabilizationIEEE International Conference on Computer Vision (ICCV), 2021 Yu-Lun Liu Wei-Sheng Lai Ming-Hsuan Yang Yung-Yu Chuang Jia-Bin Huang 174 55 0 11 Feb 2021
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic ScenesComputer Vision and Pattern Recognition (CVPR), 2020 Zhengqi Li Simon Niklaus Noah Snavely Oliver Wang 468 935 0 26 Nov 2020