Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving

29 November 2023

Papers citing "Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving"

42 / 92 papers shown

Title
EVA: An Embodied World Model for Future Video Anticipation Xiaowei Chi Hengyuan Zhang Chun-Kai Fan Xingqun Qi Rongyu Zhang ... Chi-Min Chan Wei Xue Wenhan Luo Shanghang Zhang Yike Guo VGen 33 5 0 20 Oct 2024
DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation Guosheng Zhao Chaojun Ni Xiaofeng Wang Zheng Zhu X. Zhang ... Xinze Chen Boyuan Wang Youyi Zhang Wenjun Mei Xingang Wang VGen 83 24 0 17 Oct 2024
PIVOT-R: Primitive-Driven Waypoint-Aware World Model for Robotic Manipulation K. Zhang Pengzhen Ren Bingqian Lin Junfan Lin Shikui Ma Hang Xu Xiaodan Liang 18 0 0 14 Oct 2024
Asymptotic Analysis of Sample-averaged Q-learning Saunak Kumar Panda Ruiqi Liu Yisha Xiang OnRL 52 8 0 14 Oct 2024
SyntheOcc: Synthesize Geometric-Controlled Street View Images through 3D Semantic MPIs Leheng Li Weichao Qiu Yingjie Cai Xu Yan Qing Lian Bingbing Liu Ying-Cong Chen DiffM 26 3 0 01 Oct 2024
Learning Multiple Probabilistic Decisions from Latent World Model in Autonomous Driving Lingyu Xiao Jiang-Jiang Liu Sen Yang Xiaofan Li Xiaoqing Ye Wankou Yang Jingdong Wang 34 0 0 24 Sep 2024
MyGo: Consistent and Controllable Multi-View Driving Video Generation with Camera Control Yining Yao Xi Guo C. Ding Wei Yu Wu VGen 29 2 0 10 Sep 2024
DriveScape: Towards High-Resolution Controllable Multi-View Driving Video Generation Wei Yu Wu Xi Guo Weixuan Tang Tingxuan Huang Chiyu Wang Dongyue Chen C. Ding VGen 30 6 0 09 Sep 2024
DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenes Jianbiao Mei Yukai Ma Xuemeng Yang Licheng Wen Tiantian Wei Min Dou Yukai Ma Min Dou Botian Shi Yong Liu DiffM VGen 62 3 0 06 Sep 2024
OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving Julong Wei Shanshuai Yuan Pengfei Li Qingda Hu Zhongxue Gan Wenchao Ding VLM 27 17 0 05 Sep 2024
How Could Generative AI Support Compliance with the EU AI Act? A Review for Safe Automated Driving Perception Mert Keser Youssef Shoeb Alois Knoll 32 2 0 30 Aug 2024
Learning 2D Invariant Affordance Knowledge for 3D Affordance Grounding Xianqiang Gao Pingrui Zhang Delin Qu Dong Wang Zhigang Wang Yan Ding Bin Zhao Xuelong Li 21 5 0 23 Aug 2024
DriveDiTFit: Fine-tuning Diffusion Transformers for Autonomous Driving Jiahang Tu Wei Ji Han Zhao Chao Zhang Roger Zimmermann Hui Qian 36 5 0 22 Jul 2024
General Geometry-aware Weakly Supervised 3D Object Detection Guowen Zhang Junsong Fan Liyi Chen Zhaoxiang Zhang Zhen Lei Lei Zhang 3DPC 45 2 0 18 Jul 2024
UrbanWorld: An Urban World Model for 3D City Generation Yu Shang Jiansheng Chen Hangyu Fan Jingtao Ding J. Feng Yong Li 51 6 0 16 Jul 2024
PerlDiff: Controllable Street View Synthesis Using Perspective-Layout Diffusion Models Jinhua Zhang Hualian Sheng Sijia Cai Bing Deng Qiao Liang Wen Li Ying Fu Jieping Ye Shuhang Gu DiffM 32 2 0 08 Jul 2024
End-to-End Autonomous Driving without Costly Modularization and 3D Manual Annotation Mingzhe Guo Zhipeng Zhang Yuan He Ke Wang Liping Jing 26 6 0 25 Jun 2024
SimGen: Simulator-conditioned Driving Scene Generation Yunsong Zhou Michael Simon Zhenghao Peng Sicheng Mo Hongzi Zhu Minyi Guo Bolei Zhou VGen 44 11 0 13 Jun 2024
Pandora: Towards General World Model with Natural Language Actions and Video States Jiannan Xiang Guangyi Liu Yi Gu Qiyue Gao Yuting Ning ... Shibo Hao Yemin Shi Zhengzhong Liu Eric P. Xing Zhiting Hu VGen 54 35 0 12 Jun 2024
Enhancing End-to-End Autonomous Driving with Latent World Model Yingyan Li Lue Fan Jiawei He Yuqi Wang Yuntao Chen Zhaoxiang Zhang Tieniu Tan 70 8 0 12 Jun 2024
Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation Enhui Ma Lijun Zhou Tao Tang Zhan Zhang Dong Han ... Peng Jia Xianpeng Lang Haiyang Sun Di Lin Kaicheng Yu VGen 18 20 0 03 Jun 2024
Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability Shenyuan Gao Jiazhi Yang Li Chen Kashyap Chitta Yihang Qiu Andreas Geiger Jun Zhang Hongyang Li 60 75 0 27 May 2024
MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenes Ruiyuan Gao Kai Chen Zhihao Li Lanqing Hong Zhenguo Li Qiang Xu VGen 27 26 0 23 May 2024
Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond Zheng Zhu Xiaofeng Wang Wangbo Zhao Chen Min Nianchen Deng ... Dawei Zhao Liang Xiao Jian-jun Zhao Jiwen Lu Guan Huang VGen LM&Ro 79 36 0 06 May 2024
Generalized Predictive Model for Autonomous Driving Jiazhi Yang Shenyuan Gao Yihang Qiu Li Chen Tianyu Li ... Ping Luo Jun Zhang Andreas Geiger Yu Qiao Hongyang Li VGen 64 57 0 14 Mar 2024
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation Guosheng Zhao Xiaofeng Wang Zheng Zhu Xinze Chen Guan Huang Xiaoyi Bao Xingang Wang VGen 33 14 0 11 Mar 2024
World Models for Autonomous Driving: An Initial Survey Yanchen Guan Haicheng Liao Zhenning Li Jia Hu Runze Yuan Yunjian Li Guohui Zhang Chengzhong Xu 32 31 0 05 Mar 2024
Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives Sheng Luo Wei-Neng Chen Wanxin Tian Rui Liu Luanxuan Hou ... Ling Shao Yi Yang Bojun Gao Qun Li Guobin Wu 47 13 0 05 Feb 2024
Hybrid-Prediction Integrated Planning for Autonomous Driving Haochen Liu Zhiyu Huang Wenhui Huang Haohan Yang Xiaoyu Mo Chen Lv 21 5 0 04 Feb 2024
LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving Daocheng Fu Wenjie Lei Licheng Wen Pinlong Cai Song Mao Min Dou Botian Shi Yu Qiao 38 27 0 02 Feb 2024
WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens Xiaofeng Wang Zheng Zhu Guan Huang Boyuan Wang Xinze Chen Jiwen Lu VGen 27 32 0 18 Jan 2024
Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities Xu Yan Haiming Zhang Yingjie Cai Jingming Guo Weichao Qiu ... Lihui Jiang Wei Zhang Hongbo Zhang Dengxin Dai Bingbing Liu 51 17 0 16 Jan 2024
Prospective Role of Foundation Models in Advancing Autonomous Vehicles Jianhua Wu B. Gao Jincheng Gao Jianhao Yu Hongqing Chu ... Xun Gong Yi Chang H. E. Tseng Hong Chen Jie Chen 33 3 0 08 Dec 2023
Towards Knowledge-driven Autonomous Driving Xin Li Yeqi Bai Pinlong Cai Licheng Wen Daocheng Fu ... Yikang Li Botian Shi Yong-Jin Liu Liang He Yu Qiao 32 26 0 07 Dec 2023
WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generation Jiachen Lu Ze Huang Zeyu Yang Jiahui Zhang Li Zhang VGen 8 39 0 05 Dec 2023
LLM4Drive: A Survey of Large Language Models for Autonomous Driving Zhenjie Yang Xiaosong Jia Hongyang Li Junchi Yan ELM 24 94 0 02 Nov 2023
End-to-end Autonomous Driving: Challenges and Frontiers Li Chen Peng Wu Kashyap Chitta Bernhard Jaeger Andreas Geiger Hongyang Li 3DV 34 261 0 29 Jun 2023
VAD: Vectorized Scene Representation for Efficient Autonomous Driving Bo Jiang Shaoyu Chen Qing Xu Bencheng Liao Jiajie Chen Helong Zhou Qian Zhang Wenyu Liu Chang Huang Xinggang Wang 108 193 0 21 Mar 2023
Model-Based Imitation Learning for Urban Driving Anthony Hu Gianluca Corrado Nicolas Griffiths Zak Murez Corina Gurau Hudson Yeo Alex Kendall R. Cipolla Jamie Shotton 104 135 0 14 Oct 2022
Flexible Diffusion Modeling of Long Videos William Harvey Saeid Naderiparizi Vaden Masrani Christian Weilbach Frank D. Wood DiffM BDL VGen 174 285 0 23 May 2022
StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGAN Gereon Fox A. Tewari Mohamed A. Elgharib Christian Theobalt 163 51 0 15 Jul 2021
VideoGPT: Video Generation using VQ-VAE and Transformers Wilson Yan Yunzhi Zhang Pieter Abbeel A. Srinivas ViT VGen 245 484 0 20 Apr 2021