Decomposing Motion and Content for Natural Video Sequence Prediction

25 June 2017

Papers citing "Decomposing Motion and Content for Natural Video Sequence Prediction"

50 / 89 papers shown

Title
Unsupervised Representation Learning from Sparse Transformation Analysis Yue Song Thomas Anderson Keller Yisong Yue Pietro Perona Max Welling DRL 29 0 0 07 Oct 2024
Action-conditioned video data improves predictability Meenakshi Sarkar Debasish Ghose VGen 33 0 0 08 Apr 2024
Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning Jialong Wu Haoyu Ma Chao Deng Mingsheng Long OffRL 24 24 0 29 May 2023
PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Prediction Hao Wu Wei Xion Fan Xu Xian-Sheng Hua C. L. Philip Chen Xiansheng Hua AI4TS 14 27 0 19 May 2023
Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models A. Blattmann Robin Rombach Huan Ling Tim Dockhorn Seung Wook Kim Sanja Fidler Karsten Kreis 3DGS VGen 72 1,010 0 18 Apr 2023
Affordances from Human Videos as a Versatile Representation for Robotics Shikhar Bahl Russell Mendonca Lili Chen Unnat Jain Deepak Pathak 30 160 0 17 Apr 2023
Prior based Sampling for Adaptive LiDAR Amit Shomer S. Avidan 3DV 3DPC MDE 27 1 0 14 Apr 2023
DNeRV: Modeling Inherent Dynamics via Difference Neural Representation for Videos Qi Zhao M. Salman Asif Zhan Ma 18 31 0 13 Apr 2023
Multifactor Sequential Disentanglement via Structured Koopman Autoencoders Nimrod Berman Ilana D Naiman Omri Azencot CoGe 19 21 0 30 Mar 2023
Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works Chao Tao Ji Qi Mingning Guo Qing Zhu Haifeng Li SSL 19 56 0 15 Nov 2022
A unified model for continuous conditional video prediction Xi Ye Guillaume-Alexandre Bilodeau AI4TS 32 7 0 11 Oct 2022
Enhancing Spatiotemporal Prediction Model using Modular Design and Beyond Haoyu Pan Hao Wu Tan Yang AI4TS 20 0 0 04 Oct 2022
Temporal View Synthesis of Dynamic Scenes through 3D Object Motion Estimation with Multi-Plane Images Nagabhushan Somraj Pranali Sancheti R. Soundararajan 27 4 0 19 Aug 2022
InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Images Zhengqi Li Qianqian Wang Noah Snavely Angjoo Kanazawa VGen 22 59 0 22 Jul 2022
E-NeRV: Expedite Neural Video Representation with Disentangled Spatial-Temporal Context Zizhang Li Mengmeng Wang Huaijin Pi Kechun Xu Jianbiao Mei Yong Liu 18 70 0 17 Jul 2022
Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning Cheng Tan Zhangyang Gao Lirong Wu Yongjie Xu Jun-Xiong Xia Siyuan Li Stan Z. Li 25 107 0 24 Jun 2022
Learning to Refactor Action and Co-occurrence Features for Temporal Action Localization Kun Xia Le Wang Sanping Zhou Nanning Zheng Wei Tang 26 36 0 23 Jun 2022
SimVP: Simpler yet Better Video Prediction Zhangyang Gao Cheng Tan Lirong Wu Stan Z. Li 23 210 0 09 Jun 2022
Cascaded Video Generation for Videos In-the-Wild Lluis Castrejon Nicolas Ballas Aaron Courville VGen 24 0 0 01 Jun 2022
Synthetic Data -- what, why and how? James Jordon Lukasz Szpruch F. Houssiau M. Bottarelli Giovanni Cherubin Carsten Maple Samuel N. Cohen Adrian Weller 35 109 0 06 May 2022
STAU: A SpatioTemporal-Aware Unit for Video Prediction and Beyond Zheng Chang Xinfeng Zhang Shanshe Wang Siwei Ma Wen Gao 28 1 0 20 Apr 2022
When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learning Chuizheng Meng Sungyong Seo Defu Cao Sam Griesemer Yan Liu PINN AI4CE 34 54 0 31 Mar 2022
VPTR: Efficient Transformers for Video Prediction Xi Ye Guillaume-Alexandre Bilodeau ViT 19 18 0 29 Mar 2022
Diffusion Probabilistic Modeling for Video Generation Ruihan Yang Prakhar Srivastava Stephan Mandt DiffM VGen 32 255 0 16 Mar 2022
Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks Sihyun Yu Jihoon Tack Sangwoo Mo Hyunsu Kim Junho Kim Jung-Woo Ha Jinwoo Shin DiffM VGen 18 199 0 21 Feb 2022
FREGAN : an application of generative adversarial networks in enhancing the frame rate of videos Rishik Mishra Neeraj Gupta Nitya Shukla 37 0 0 01 Nov 2021
Contrastively Disentangled Sequential Variational Autoencoder M. Kiener Weiran Wang Michael Gerndt CoGe DRL 6 40 0 22 Oct 2021
Wide and Narrow: Video Prediction from Context and Motion Jaehoon Cho Jiyoung Lee Changjae Oh Wonil Song K. Sohn 10 1 0 22 Oct 2021
LARNet: Latent Action Representation for Human Action Synthesis Naman Biyani A. J. Rana Shruti Vyas Y. S. Rawat 11 4 0 21 Oct 2021
Pose-guided Generative Adversarial Net for Novel View Action Synthesis Xianhang Li Junhao Zhang Kunchang Li Shruti Vyas Y. S. Rawat GAN 47 3 0 15 Oct 2021
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 224 1,018 0 13 Oct 2021
A Hierarchical Variational Neural Uncertainty Model for Stochastic Video Prediction Moitreya Chatterjee N. Ahuja A. Cherian UQCV VGen BDL 29 17 0 06 Oct 2021
Diverse Generation from a Single Video Made Possible Niv Haim Ben Feinstein Niv Granot Assaf Shocher Shai Bagon Tali Dekel Michal Irani DiffM VGen 34 18 0 17 Sep 2021
Conditional Temporal Variational AutoEncoder for Action Video Prediction Xiaogang Xu Yi Wang Liwei Wang Bei Yu Jiaya Jia VGen 24 5 0 12 Aug 2021
Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization Rui Qian Yuxi Li Huabin Liu John See Shuangrui Ding Xian Liu Dian Li Weiyao Lin 21 42 0 04 Aug 2021
Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting Martine Toering Ioannis Gatopoulos M. Stol Vincent Tao Hu SSL 22 11 0 18 Jun 2021
Hierarchical Video Generation for Complex Data Lluis Castrejon Nicolas Ballas Aaron Courville VGen 12 4 0 04 Jun 2021
A Good Image Generator Is What You Need for High-Resolution Video Synthesis Yu Tian Jian Ren Menglei Chai Kyle Olszewski Xi Peng Dimitris N. Metaxas Sergey Tulyakov VGen 37 183 0 30 Apr 2021
Learning Semantic-Aware Dynamics for Video Prediction Xinzhu Bei Yanchao Yang Stefano Soatto VGen 19 31 0 20 Apr 2021
Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning Sangmin Lee Hak Gu Kim Dae Hwi Choi Hyungil Kim Yong Man Ro 20 102 0 02 Apr 2021
Self-Supervision by Prediction for Object Discovery in Videos Beril Besbinar P. Frossard SSL 19 7 0 09 Mar 2021
DMotion: Robotic Visuomotor Control with Unsupervised Forward Model Learned from Videos Haoqi Yuan Ruihai Wu Andrew Zhao Hanwang Zhang Zihan Ding Hao Dong 19 3 0 07 Mar 2021
Predicting Video with VQVAE Jacob Walker Ali Razavi Aaron van den Oord DRL 16 66 0 02 Mar 2021
Meta-Learning Dynamics Forecasting Using Task Inference Rui Wang Robin G. Walters Rose Yu OOD AI4TS AI4CE 19 31 0 20 Feb 2021
MoNet: Motion-based Point Cloud Prediction Network Fan Lu Guang Chen Yinlong Liu Zhijun Li Sanqing Qu Tianpei Zou 3DPC 19 33 0 21 Nov 2020
ConvTransformer: A Convolutional Transformer Network for Video Frame Synthesis Zhouyong Liu S. Luo Wubin Li Jingben Lu Yufan Wu Shilei Sun Chunguo Li Luxi Yang ViT 12 79 0 20 Nov 2020
Mutual Information Based Method for Unsupervised Disentanglement of Video Representation Aditya Sreekar Ujjwal Tiwari A. Namboodiri DRL 11 4 0 17 Nov 2020
Learning World Transition Model for Socially Aware Robot Navigation Yuxiang Cui Haodong Zhang Yue Wang R. Xiong 15 17 0 08 Nov 2020
Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications Ming-Yu Liu Xun Huang Jiahui Yu Ting-Chun Wang Arun Mallya GAN 26 153 0 06 Aug 2020
Learning Long-term Visual Dynamics with Region Proposal Interaction Networks Haozhi Qi Xiaolong Wang Deepak Pathak Yi-An Ma Jitendra Malik 25 56 0 05 Aug 2020