Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving

29 November 2023

Papers citing "Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving"

50 / 92 papers shown

Title
M3CAD: Towards Generic Cooperative Autonomous Driving Benchmark Morui Zhu Yongqi Zhu Yihao Zhu Qi Chen Deyuan Qu Song Fu Q. Yang 16 0 0 10 May 2025
PADriver: Towards Personalized Autonomous Driving Genghua Kou Fan Jia Weixin Mao Y. Liu Yucheng Zhao Ziheng Zhang Osamu Yoshie Tiancai Wang Y. Li X. Zhang 47 0 0 08 May 2025
DualDiff: Dual-branch Diffusion Model for Autonomous Driving with Semantic Fusion Haoteng Li Zhao Yang Zezhong Qian Gongpeng Zhao Yuqi Huang Jun-chen Yu Huazheng Zhou Longjun Liu 66 1 0 03 May 2025
PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depth Bu Jin Weize Li Baihan Yang Zhenxin Zhu Junpeng Jiang ... Kun Zhan Hengtong Hu X. Zhang Peng Jia Hao Zhao VGen 81 0 0 03 May 2025
A Survey of Interactive Generative Video Jiwen Yu Yiran Qin Haoxuan Che Quande Liu X. Wang Pengfei Wan Di Zhang Kun Gai Hao Chen Xihui Liu VGen 53 0 0 30 Apr 2025
DiVE: Efficient Multi-View Driving Scenes Generation Based on Video Diffusion Transformer Junpeng Jiang Gangyi Hong Miao Zhang Hengtong Hu Kun Zhan Rui Shao Liqiang Nie VGen 51 0 0 28 Apr 2025
NoiseController: Towards Consistent Multi-view Video Generation via Noise Decomposition and Collaboration Haotian Dong X. Wang D. Lin Yipeng Wu Qin Chen R. Liu Kairui Yang Ping Li Qing-Wu Guo VGen 42 0 0 25 Apr 2025
DriVerse: Navigation World Model for Driving Simulation via Multimodal Trajectory Prompting and Motion Alignment X. Li Chenming Wu Zhao Yang Zhihao Xu Dingkang Liang Y. Zhang Ji Wan J. Wang VGen 67 1 0 22 Apr 2025
End-to-End Driving with Online Trajectory Evaluation via BEV World Model Yingyan Li Yuqi Wang Yang Liu Jiawei He Lue Fan Zhaoxiang Zhang OffRL 93 0 0 02 Apr 2025
Improved Visual-Spatial Reasoning via R1-Zero-Like Training Zhenyi Liao Qingsong Xie Yanhao Zhang Zijian Kong Haonan Lu Zhenyu Yang Zhijie Deng ReLM VLM LRM 101 0 1 01 Apr 2025
CoGen: 3D Consistent Video Generation via Adaptive Conditioning for Autonomous Driving Yishen Ji Ziyue Zhu Zhenxin Zhu Kaixin Xiong Ming Lu Zhiqi Li Lijun Zhou Haiyang Sun Bing Wang Tong Lu VGen 53 1 0 28 Mar 2025
Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap Tong Nie Jian-jun Sun Wei Ma 58 1 0 27 Mar 2025
AccidentSim: Generating Physically Realistic Vehicle Collision Videos from Real-World Accident Reports X. Zhang Qian Zhang Longfei Han Qiang Qu Xiaoming Chen VGen 62 0 0 26 Mar 2025
DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulation Jiangran Lyu Ziming Li Xuesong Shi Chaoyi Xu Yizhou Wang He Wang 47 0 0 21 Mar 2025
MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Driving Haiguang Wang Daqi Liu Hongwei Xie Haisong Liu Enhui Ma Kaicheng Yu Limin Wang Bing Wang VGen 67 0 0 20 Mar 2025
FusDreamer: Label-efficient Remote Sensing World Model for Multimodal Data Classification J. Wang Weiwei Song Hao Chen J. Ren Huimin Zhao 62 0 0 18 Mar 2025
Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey Liewen Liao Weihao Yan Ming Yang Songan Zhang 3DV 84 0 0 17 Mar 2025
Seeing the Future, Perceiving the Future: A Unified Driving World Model for Future Generation and Perception Dingkang Liang Dingyuan Zhang Xin Zhou Sifan Tu Tianrui Feng Xiaofan Li Yumeng Zhang Mingyang Du Xiao Tan Xiang Bai 65 2 0 17 Mar 2025
MuDG: Taming Multi-modal Diffusion with Gaussian Splatting for Urban Scene Reconstruction Yingshuang Zou Yikang Ding Chuanrui Zhang Jiazhe Guo Bohan Li Xiaoyang Lyu Feiyang Tan Xiaojuan Qi Haoqian Wang 3DGS 49 0 0 13 Mar 2025
RoCo-Sim: Enhancing Roadside Collaborative Perception through Foreground Simulation Yuwen Du Anning Hu Zichen Chao Yifan Lu Junhao Ge Genjia Liu Weitao Wu Lanjun Wang Siheng Chen 60 0 0 13 Mar 2025
Other Vehicle Trajectories Are Also Needed: A Driving World Model Unifies Ego-Other Vehicle Trajectories in Video Latent Space Jian Zhu Zhengyu Jia Tian Gao Jiaxin Deng Shidi Li Fu Liu Peng Jia Xianpeng Lang Xiaolong Sun VGen 104 0 0 12 Mar 2025
Temporal Triplane Transformers as Occupancy World Models Haoran Xu Peixi Peng Guang Tan Yiqian Chang Yisen Zhao Yonghong Tian 41 0 0 10 Mar 2025
FuseChat-3.0: Preference Optimization Meets Heterogeneous Model Fusion Ziyi Yang Fanqi Wan Longguang Zhong Canbin Huang Guosheng Liang Xiaojun Quan MoMe 90 0 0 06 Mar 2025
DualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidance Zhao Yang Zezhong Qian Xiaofan Li Weixiang Xu Gongpeng Zhao Ruohong Yu Lingsi Zhu Longjun Liu DiffM VGen 63 1 0 05 Mar 2025
BEVDiffuser: Plug-and-Play Diffusion Model for BEV Denoising with Ground-Truth Guidance Xin Ye Burhaneddin Yaman Sheng Cheng Feng Tao Abhirup Mallik Liu Ren DiffM 63 1 0 27 Feb 2025
Glad: A Streaming Scene Generator for Autonomous Driving Bin Xie Yingfei Liu Tiancai Wang Jiale Cao X. Zhang 3DGS VGen 44 1 0 26 Feb 2025
RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learning Hao Gao Shaoyu Chen Bo Jiang Bencheng Liao Yiang Shi ... Xinbang Zhang Y. Zhang Wenyu Liu Qian Zhang Xinggang Wang 76 5 0 18 Feb 2025
MaskGWM: A Generalizable Driving World Model with Video Mask Reconstruction Jingcheng Ni Yuxin Guo Yichen Liu Rui Chen Lewei Lu Z. Wu DiffM VGen 59 3 0 17 Feb 2025
GLAM: Global-Local Variation Awareness in Mamba-based World Model Qian He Wenqi Liang Chunhui Hao Gan Sun Jiandong Tian 41 0 0 21 Jan 2025
Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving Yu Yang Jianbiao Mei Yukai Ma Siliang Du Wenqing Chen Yijie Qian Yuxiang Feng Yong-jin Liu 84 11 0 20 Jan 2025
DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT Xiaotao Hu Wei Yin Mingkai Jia Junyuan Deng Xiaoyang Guo Qian Zhang Xiaoxiao Long Ping Tan VGen 34 10 0 31 Dec 2024
DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers Yuntao Chen Yuqi Wang Zhaoxiang Zhang 89 7 0 24 Dec 2024
An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training Haiming Zhang Ying Xue Xu Yan Jiacheng Zhang Weichao Qiu Dongfeng Bai Bingbing Liu Shuguang Cui Z. Li 68 5 0 18 Dec 2024
GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Control Mariam Hassan Sebastian Stapf Ahmad Rahimi Pedro M B Rezende Yasaman Haghighi ... Mathieu Salzmann Davide Scaramuzza Marc Pollefeys Paolo Favaro Alexandre Alahi VLM VGen 69 5 0 15 Dec 2024
OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation Bohan Li Xin Jin J. Wang Yukai Shi Yasheng Sun ... Zhuang Ma Baao Xie Chao Ma Xiaokang Yang Wenjun Zeng DiffM 110 1 0 15 Dec 2024
InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models Yifan Lu Xuanchi Ren Jiawei Yang Tianchang Shen Zhangjie Wu ... Y. Wang Siheng Chen Mike Chen Sanja Fidler Jiahui Huang VGen 98 5 0 05 Dec 2024
World-consistent Video Diffusion with Explicit 3D Modeling Qihang Zhang Shuangfei Zhai Miguel Angel Bautista Kevin Miao Alexander Toshev J. Susskind Jiatao Gu VGen 75 8 0 02 Dec 2024
Driving Scene Synthesis on Free-form Trajectories with Generative Prior Zeyu Yang Zijie Pan Yuankun Yang Xiatian Zhu L. Zhang VGen 67 1 0 02 Dec 2024
InfinityDrive: Breaking Time Limits in Driving World Models Xi Guo C. Ding Haoxuan Dou Xin Zhang Weixuan Tang Wei Yu Wu VGen 81 5 0 02 Dec 2024
HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Driving Z. Wu Jingcheng Ni Xiaodong Wang Yuxin Guo Rui Chen Lewei Lu Jifeng Dai Yuwen Xiong 72 6 0 02 Dec 2024
ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restoration Chaojun Ni Guosheng Zhao Xiaofeng Wang Zheng Hua Zhu Wenkang Qin ... Kun Zhan Peng Jia Xianpeng Lang Xingang Wang Wenjun Mei VGen 101 6 0 29 Nov 2024
CoA: Chain-of-Action for Generative Semantic Labels Meng Wei Zhongnian Li Peng Ying Xinzheng Xu VLM 64 0 0 26 Nov 2024
DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving Bencheng Liao Shaoyu Chen Haoran Yin Bo Jiang Cheng Wang ... Xinbang Zhang Xiangyu Li Y. Zhang Qian Zhang Xinggang Wang 102 14 0 22 Nov 2024
LaVida Drive: Vision-Text Interaction VLM for Autonomous Driving with Token Selection, Recovery and Enhancement Siwen Jiao Yangyi Fang Baoyun Peng Wangqun Chen Bharadwaj Veeravalli 76 4 0 20 Nov 2024
DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulation Tianyi Yan Dongming Wu Wencheng Han Junpeng Jiang Xia Zhou Kun Zhan Cheng-Zhong Xu Jianbing Shen 30 3 0 18 Nov 2024
EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation Xiaofeng Wang Kang Zhao F. Liu Jiayu Wang Guosheng Zhao Xiaoyi Bao Zheng Hua Zhu Yingya Zhang Xingang Wang VGen 56 6 0 13 Nov 2024
World Models: The Safety Perspective Zifan Zeng Chongzhe Zhang Feng Liu Joseph Sifakis Qunli Zhang Shiming Liu Peng Wang KELM LLMAG 40 1 0 12 Nov 2024
FreeVS: Generative View Synthesis on Free Driving Trajectory Qitai Wang Lue Fan Yuqi Wang Yuntao Chen Zhaoxiang Zhang VGen 48 7 0 23 Oct 2024
X-MOBILITY: End-To-End Generalizable Navigation via World Modeling Wei Liu Huihua Zhao Chenran Li Joydeep Biswas Billy Okal Pulkit Goyal Yan Chang Soha Pouya 16 4 0 23 Oct 2024
LASER: Script Execution by Autonomous Agents for On-demand Traffic Simulation Hao Gao Jingyue Wang Wenyang Fang Jingwei Xu Yunpeng Huang Taolue Chen Xiaoxing Ma 27 1 0 21 Oct 2024