Towards Accurate Generative Models of Video: A New Metric & Challenges

3 December 2018

Thomas Unterthiner

Sjoerd van Steenkiste

Papers citing "Towards Accurate Generative Models of Video: A New Metric & Challenges"

41 / 141 papers shown

Title
Autoregressive GAN for Semantic Unconditional Head Motion Generation Louis Airale Xavier Alameda-Pineda Stéphane Lathuilière Dominique Vaufreydaz 17 3 0 02 Nov 2022
Phenaki: Variable Length Video Generation From Open Domain Textual Description Ruben Villegas Mohammad Babaeizadeh Pieter-Jan Kindermans Hernan Moraldo Han Zhang M. Saffar Santiago Castro Julius Kunze D. Erhan DiffM VGen 48 371 0 05 Oct 2022
Modelling Latent Dynamics of StyleGAN using Neural ODEs Weihao Xia Yujiu Yang Jing-Hao Xue 19 0 0 23 Aug 2022
NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis Chenfei Wu Jian Liang Xiaowei Hu Zhe Gan Jianfeng Wang Lijuan Wang Zicheng Liu Yuejian Fang Nan Duan VGen 12 72 0 20 Jul 2022
Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis Long Zhuo Guangcong Wang Shikai Li Wayne Wu Ziwei Liu VGen 53 20 0 11 Jul 2022
3D-Aware Video Generation Sherwin Bahmani Jeong Joon Park Despoina Paschalidou H. Tang Gordon Wetzstein Leonidas J. Guibas Luc Van Gool Radu Timofte 26 20 0 29 Jun 2022
MaskViT: Masked Visual Pre-Training for Video Prediction Agrim Gupta Stephen Tian Yunzhi Zhang Jiajun Wu Roberto Martín-Martín Li Fei-Fei 100 110 0 23 Jun 2022
Cascaded Video Generation for Videos In-the-Wild Lluis Castrejon Nicolas Ballas Aaron Courville VGen 29 0 0 01 Jun 2022
CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers Wenyi Hong Ming Ding Wendi Zheng Xinghan Liu Jie Tang DiffM 248 565 0 29 May 2022
MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation Vikram S. Voleti Alexia Jolicoeur-Martineau Christopher Pal DiffM VGen 13 290 0 19 May 2022
STAU: A SpatioTemporal-Aware Unit for Video Prediction and Beyond Zheng Chang Xinfeng Zhang Shanshe Wang Siwei Ma Wen Gao 30 1 0 20 Apr 2022
Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer Songwei Ge Thomas Hayes Harry Yang Xiaoyue Yin Guan Pang David Jacobs Jia-Bin Huang Devi Parikh ViT 43 214 0 07 Apr 2022
Video Diffusion Models Jonathan Ho Tim Salimans Alexey A. Gritsenko William Chan Mohammad Norouzi David J. Fleet DiffM VGen 32 1,504 0 07 Apr 2022
FoV-Net: Field-of-View Extrapolation Using Self-Attention and Uncertainty Liqian Ma Stamatios Georgoulis Xu Jia Luc Van Gool 24 6 0 04 Apr 2022
Stochastic Video Prediction with Structure and Motion Adil Kaan Akan Sadra Safadoust Fatma Guney VGen 21 9 0 20 Mar 2022
Transframer: Arbitrary Frame Prediction with Generative Models C. Nash João Carreira Jacob Walker Iain Barr Andrew Jaegle Mateusz Malinowski Peter W. Battaglia ViT 19 37 0 17 Mar 2022
Diffusion Probabilistic Modeling for Video Generation Ruihan Yang Prakhar Srivastava Stephan Mandt DiffM VGen 34 255 0 16 Mar 2022
Playable Environments: Video Manipulation in Space and Time Willi Menapace Stéphane Lathuilière Aliaksandr Siarohin Christian Theobalt Sergey Tulyakov Vladislav Golyanik Elisa Ricci VGen 21 22 0 03 Mar 2022
Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks Sihyun Yu Jihoon Tack Sangwoo Mo Hyunsu Kim Junho Kim Jung-Woo Ha Jinwoo Shin DiffM VGen 18 199 0 21 Feb 2022
NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion Chenfei Wu Jian Liang Lei Ji Fan Yang Yuejian Fang Daxin Jiang Nan Duan ViT VGen 16 292 0 24 Nov 2021
Image Comes Dancing with Collaborative Parsing-Flow Video Synthesis Bowen Wu Zhenyu Xie Xiaodan Liang Yubei Xiao Haoye Dong Liang Lin 3DH 23 6 0 27 Oct 2021
LARNet: Latent Action Representation for Human Action Synthesis Naman Biyani A. J. Rana Shruti Vyas Y. S. Rawat 11 4 0 21 Oct 2021
Pose-guided Generative Adversarial Net for Novel View Action Synthesis Xianhang Li Junhao Zhang Kunchang Li Shruti Vyas Y. S. Rawat GAN 47 3 0 15 Oct 2021
Physical Context and Timing Aware Sequence Generating GANs Hayato Futase Tomoki Tsujimura Tetsuya Kajimoto Hajime Kawarazaki Toshiyuki Suzuki Makoto Miwa Yutaka Sasaki GAN 33 0 0 28 Sep 2021
DVC-P: Deep Video Compression with Perceptual Optimizations Saiping Zhang M. Mrak Luis Herranz Marc Górriz Shuai Wan Fuzheng Yang 16 5 0 22 Sep 2021
Conditional Temporal Variational AutoEncoder for Action Video Prediction Xiaogang Xu Yi Wang Liwei Wang Bei Yu Jiaya Jia VGen 24 5 0 12 Aug 2021
Hierarchical Video Generation for Complex Data Lluis Castrejon Nicolas Ballas Aaron Courville VGen 12 4 0 04 Jun 2021
A Good Image Generator Is What You Need for High-Resolution Video Synthesis Yu Tian Jian Ren Menglei Chai Kyle Olszewski Xi Peng Dimitris N. Metaxas Sergey Tulyakov VGen 45 183 0 30 Apr 2021
A Shape-Aware Retargeting Approach to Transfer Human Motion and Appearance in Monocular Videos Thiago L. Gomes Renato Martins João Ferreira Rafael Azevedo Guilherme Torres Erickson R. Nascimento 3DH 16 16 0 29 Mar 2021
Conditional Frechet Inception Distance Michael Soloveitchik Tzvi Diskin E. Morin A. Wiesel EGVM 19 33 0 21 Mar 2021
Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction Bohan Wu Suraj Nair Roberto Martin-Martin Li Fei-Fei Chelsea Finn DRL 16 99 0 06 Mar 2021
Predicting Video with VQVAE Jacob Walker Ali Razavi Aaron van den Oord DRL 22 66 0 02 Mar 2021
Game Plan: What AI can do for Football, and What Football can do for AI K. Tuyls Shayegan Omidshafiei Paul Muller Zhe Wang Jerome T. Connor ... Simon Bouton Nathalie Beauguerlange Jackson Broshear T. Graepel Demis Hassabis 33 78 0 18 Nov 2020
Head2Head++: Deep Facial Attributes Re-Targeting M. Doukas Mohammad Rami Koujan V. Sharmanska A. Roussos CVBM 3DH 17 45 0 17 Jun 2020
Stochastic Latent Residual Video Prediction Jean-Yves Franceschi E. Delasalles Mickaël Chen Sylvain Lamprier Patrick Gallinari VGen 26 159 0 21 Feb 2020
High Fidelity Video Prediction with Large Stochastic Recurrent Neural Networks Ruben Villegas Arkanath Pathak Harini Kannan D. Erhan Quoc V. Le Honglak Lee VGen 16 136 0 05 Nov 2019
Markov Decision Process for Video Generation V. Yushchenko Nikita Araslanov Stefan Roth VGen 23 20 0 26 Sep 2019
Adversarial Video Generation on Complex Datasets Aidan Clark Jeff Donahue Karen Simonyan VGen GAN 27 74 0 15 Jul 2019
Unsupervised Learning of Object Structure and Dynamics from Videos Matthias Minderer Chen Sun Ruben Villegas Forrester Cole Kevin Patrick Murphy Honglak Lee 19 149 0 19 Jun 2019
Improved Conditional VRNNs for Video Prediction Lluis Castrejon Nicolas Ballas Aaron Courville VGen DRL 13 161 0 27 Apr 2019
VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generation Manoj Kumar Mohammad Babaeizadeh D. Erhan Chelsea Finn Sergey Levine Laurent Dinh Durk Kingma VGen 25 131 0 04 Mar 2019