Generating Videos with Scene Dynamics

8 September 2016

Carl Vondrick

Antonio Torralba

Papers citing "Generating Videos with Scene Dynamics"

50 / 739 papers shown

Title
Deep Generative Modeling-based Data Augmentation with Demonstration using the BFBT Benchmark Void Fraction Datasets Farah Alsafadi Xuehui Wu 17 3 0 19 Aug 2023
Scalable Video Object Segmentation with Simplified Framework Qiangqiang Wu Tianyu Yang WU Wei Antoni B. Chan VOS 19 23 0 19 Aug 2023
SimDA: Simple Diffusion Adapter for Efficient Video Generation Zhen Xing Qi Dai Hang-Rui Hu Zuxuan Wu Yu-Gang Jiang VGen DiffM 24 81 0 18 Aug 2023
Dual-Stream Diffusion Net for Text-to-Video Generation Binhui Liu Xin Liu Anbo Dai Zhiyong Zeng Dan Wang Zhen Cui Jian Yang DiffM VGen 18 9 0 16 Aug 2023
Real-Time Neural Video Recovery and Enhancement on Mobile Devices Zhaoyuan He Yifan Yang Lili Qiu Kyoungjun Park 13 2 0 22 Jul 2023
Language-based Action Concept Spaces Improve Video Self-Supervised Learning Kanchana Ranasinghe Michael S. Ryoo SSL VLM 26 12 0 20 Jul 2023
Enabling Real-time Neural Recovery for Cloud Gaming on Mobile Devices Zhaoyuan He Yifan Yang Shuozhe Li Diyuan Dai Lili Qiu Yuqing Yang 14 0 0 15 Jul 2023
Animate-A-Story: Storytelling with Retrieval-Augmented Video Generation Yin-Yin He Menghan Xia Haoxin Chen Xiaodong Cun Yuan Gong ... Yong Zhang Xintao Wang Chao-Liang Weng Ying Shan Qifeng Chen DiffM VGen 14 74 0 13 Jul 2023
GD-VDM: Generated Depth for better Diffusion-based Video Generation Ariel Lapid Idan Achituve Lior Bracha Ethan Fetaya DiffM VGen 79 6 0 19 Jun 2023
A Large-Scale Analysis on Self-Supervised Video Representation Learning Akash Kumar Ashlesha Kumar Vibhav Vineet Y. S. Rawat SSL 16 3 0 09 Jun 2023
The Age of Synthetic Realities: Challenges and Opportunities J. P. Cardenuto Jing Yang Rafael Padilha Renjie Wan Daniel Moreira Haoliang Li Shiqi Wang Fernanda A. Andaló Sébastien Marcel Anderson de Rezende Rocha DeLMO 42 29 0 09 Jun 2023
Video Diffusion Models with Local-Global Context Guidance Si-hang Yang Lu Zhang Yu Liu Zhizhuo Jiang You He VGen DiffM 17 13 0 05 Jun 2023
HomE: Homography-Equivariant Video Representation Learning Anirudh Sriram Adrien Gaidon Jiajun Wu Juan Carlos Niebles L. Fei-Fei Ehsan Adeli SSL AI4TS 18 2 0 02 Jun 2023
Learning by Aligning 2D Skeleton Sequences and Multi-Modality Fusion Quoc-Huy Tran Muhammad Ahmed Murad Popattia M. Hassan Ahmed Andrey Konin M. Zeeshan AI4TS 19 3 0 31 May 2023
VDT: General-purpose Video Diffusion Transformers via Mask Modeling Haoyu Lu Guoxing Yang Nanyi Fei Yuqi Huo Zhiwu Lu Ping Luo Mingyu Ding DiffM VGen 20 56 0 22 May 2023
Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generation Wenjing Wang Huan Yang Zixi Tuo Huiguo He Junchen Zhu Jianlong Fu Jiaying Liu DiffM VGen 40 114 0 18 May 2023
Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models Songwei Ge Seungjun Nah Guilin Liu Tyler Poon Andrew Tao Bryan Catanzaro David Jacobs Jia-Bin Huang Ming-Yu Liu Yogesh Balaji DiffM VGen 35 252 0 17 May 2023
Self-Supervised Video Representation Learning via Latent Time Navigation Di Yang Yaohui Wang Quan Kong A. Dantcheva Lorenzo Garattoni Gianpiero Francesca F. Brémond SSL AI4TS 41 10 0 10 May 2023
LEO: Generative Latent Image Animator for Human Video Synthesis Yaohui Wang Xin Ma Xinyuan Chen A. Dantcheva Bo Dai Yu Qiao DiffM 59 30 0 06 May 2023
Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models A. Blattmann Robin Rombach Huan Ling Tim Dockhorn Seung Wook Kim Sanja Fidler Karsten Kreis 3DGS VGen 63 1,010 0 18 Apr 2023
Video Generation Beyond a Single Clip Hsin-Ping Huang Yu-Chuan Su Ming Yang VLM DiffM VGen 16 3 0 15 Apr 2023
MoStGAN-V: Video Generation with Temporal Motion Styles Xiaoqian Shen Xiang Li Mohamed Elhoseiny VGen 28 29 0 05 Apr 2023
Sounding Video Generator: A Unified Framework for Text-guided Sounding Video Generation Jiawei Liu Weining Wang Sihan Chen Xinxin Zhu J. Liu DiffM VGen 20 13 0 29 Mar 2023
Information-Theoretic GAN Compression with Variational Energy-based Model Minsoo Kang Hyewon Yoo Eunhee Kang Sehwan Ki Hyong-Euk Lee Bohyung Han GAN 16 3 0 28 Mar 2023
Model-Based Reinforcement Learning with Isolated Imaginations Minting Pan Xiangming Zhu Yitao Zheng Yunbo Wang Xiaokang Yang 10 0 0 27 Mar 2023
Spatial Latent Representations in Generative Adversarial Networks for Image Generation Maciej Sypetkowski GAN 26 1 0 25 Mar 2023
Persistent Nature: A Generative Model of Unbounded 3D Worlds Lucy Chai Richard Tucker Zhengqi Li Phillip Isola Noah Snavely VGen 24 30 0 23 Mar 2023
NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation Sheng-Siang Yin Chenfei Wu Huan Yang Jianfeng Wang Xiaodong Wang ... Gong Ming Lijuan Wang Zicheng Liu Houqiang Li Nan Duan VGen 7 125 0 22 Mar 2023
A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need? Chaoning Zhang Chenshuang Zhang Sheng Zheng Yu Qiao Chenghao Li ... Lik-Hang Lee Yang Yang Heng Tao Shen In So Kweon Choong Seon Hong 75 159 0 21 Mar 2023
Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transformers Jaehoon Yoo Semin Kim Doyup Lee Chiheon Kim Seunghoon Hong 21 3 0 20 Mar 2023
VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation Zhengxiong Luo Dayou Chen Yingya Zhang Yan Huang Liangsheng Wang Yujun Shen Deli Zhao Jinren Zhou Tien-Ping Tan DiffM VGen 132 308 0 15 Mar 2023
Controllable Video Generation by Learning the Underlying Dynamical System with Neural ODE Yucheng Xu Nanbo Li A. Goel Zijian Guo Zonghai Yao H. Kasaei Mohammad-Sajad Kasaei Zhibin Li 36 5 0 09 Mar 2023
MOSO: Decomposing MOtion, Scene and Object for Video Prediction M. Sun Weining Wang Xinxin Zhu Jing Liu 13 14 0 07 Mar 2023
MotionVideoGAN: A Novel Video Generator Based on the Motion Space Learned from Image Pairs Jin Zhu Huimin Ma Jiansheng Chen Jian Yuan VGen 28 4 0 06 Mar 2023
Video Probabilistic Diffusion Models in Projected Latent Space Sihyun Yu Kihyuk Sohn Subin Kim Jinwoo Shin VGen DiffM 37 160 0 15 Feb 2023
Weakly-supervised Representation Learning for Video Alignment and Analysis Guy Bar-Shalom G. Leifman Michael Elad Ehud Rivlin 21 2 0 08 Feb 2023
Structure and Content-Guided Video Synthesis with Diffusion Models Patrick Esser Johnathan Chiu Parmida Atighehchian Jonathan Granskog Anastasis Germanidis DiffM VGen 50 506 0 06 Feb 2023
GANExplainer: GAN-based Graph Neural Networks Explainer Yiqiao Li Jianlong Zhou Boyuan Zheng Fang Chen LLMAG 29 4 0 30 Dec 2022
Predictive Coding Based Multiscale Network with Encoder-Decoder LSTM for Video Prediction Chaofan Ling Junpei Zhong Wei-Hong Li 26 3 0 22 Dec 2022
Hybrid Quantum-Classical Generative Adversarial Network for High Resolution Image Generation S. Tsang Maxwell T. West S. Erfani Muhammad Usman GAN 8 32 0 22 Dec 2022
Towards Smooth Video Composition Qihang Zhang Ceyuan Yang Yujun Shen Yinghao Xu Bolei Zhou VGen 31 14 0 14 Dec 2022
PV3D: A 3D Generative Model for Portrait Video Generation Eric Xu Jianfeng Zhang Jun Hao Liew Wenqing Zhang Song Bai Jiashi Feng Mike Zheng Shou VGen 32 20 0 13 Dec 2022
Video Prediction by Efficient Transformers Xi Ye Guillaume-Alexandre Bilodeau ViT 28 33 0 12 Dec 2022
Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection Junke Wang Zhenxin Li Chao Zhang Jingjing Chen Zuxuan Wu Larry S. Davis Yueping Jiang AAML 30 5 0 12 Dec 2022
MAGVIT: Masked Generative Video Transformer Lijun Yu Yong Cheng Kihyuk Sohn José Lezama Han Zhang ... Alexander G. Hauptmann Ming-Hsuan Yang Yuan Hao Irfan Essa Lu Jiang DiffM VGen 22 223 0 10 Dec 2022
VIDM: Video Implicit Diffusion Models Kangfu Mei Vishal M. Patel DiffM VGen 22 78 0 01 Dec 2022
WALDO: Future Video Synthesis using Object Layer Decomposition and Parametric Flow Prediction G. L. Moing Jean Ponce Cordelia Schmid 19 6 0 25 Nov 2022
Make-A-Story: Visual Memory Conditioned Consistent Story Generation Tanzila Rahman Hsin-Ying Lee Jian Ren Sergey Tulyakov Shweta Mahajan Leonid Sigal DiffM 16 68 0 23 Nov 2022
Latent Video Diffusion Models for High-Fidelity Long Video Generation Yin-Yin He Tianyu Yang Yong Zhang Ying Shan Qifeng Chen DiffM VGen 16 202 0 23 Nov 2022
Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation Tsu-jui Fu Licheng Yu Ning Zhang Cheng-Yang Fu Jong-Chyi Su William Yang Wang Sean Bell VGen 40 37 0 23 Nov 2022