LMDrive: Closed-Loop End-to-End Driving with Large Language Models

12 December 2023

Steven L. Waslander

Papers citing "LMDrive: Closed-Loop End-to-End Driving with Large Language Models"

50 / 86 papers shown

Title
LVLM-MPC Collaboration for Autonomous Driving: A Safety-Aware and Task-Scalable Control Architecture Kazuki Atsuta Kohei Honda H. Okuda Tatsuya Suzuki 43 0 0 08 May 2025
StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistant Haibo Wang Bo Feng Zhengfeng Lai Mingze Xu Shiyu Li Weifeng Ge Afshin Dehghan Meng Cao Ping-Chia Huang OffRL 36 3 0 08 May 2025
PADriver: Towards Personalized Autonomous Driving Genghua Kou Fan Jia Weixin Mao Y. Liu Yucheng Zhao Ziheng Zhang Osamu Yoshie Tiancai Wang Y. Li X. Zhang 31 0 0 08 May 2025
X-Driver: Explainable Autonomous Driving with Vision-Language Models Wei Liu J. A. Zhang Binxiong Zheng Yufeng Hu Yingzhan Lin Zengfeng Zeng VLM LRM 40 0 0 08 May 2025
DriveAgent: Multi-Agent Structured Reasoning with LLM and Multimodal Sensor Fusion for Autonomous Driving Xinmeng Hou Wuqi Wang Long Yang Hao Lin Jinglun Feng Haigen Min Xiangmo Zhao 24 0 0 04 May 2025
V3LMA: Visual 3D-enhanced Language Model for Autonomous Driving Jannik Lübberstedt Esteban Rivera Nico Uhlemann Markus Lienkamp MLLM 51 0 0 30 Apr 2025
Sky-Drive: A Distributed Multi-Agent Simulation Platform for Socially-Aware and Human-AI Collaborative Future Transportation Zilin Huang Zihao Sheng Zhengyang Wan Yansong Qu Yuhao Luo ... Jiancong Chen Keke Long Jiayi Meng Yue Leng Sikai Chen 50 0 0 25 Apr 2025
Can Vision-Language Models Understand and Interpret Dynamic Gestures from Pedestrians? Pilot Datasets and Exploration Towards Instructive Nonverbal Commands for Cooperative Autonomous Vehicles Tonko E. W. Bossen Andreas Møgelmose Ross Greer 21 0 0 15 Apr 2025
CAFE-AD: Cross-Scenario Adaptive Feature Enhancement for Trajectory Planning in Autonomous Driving Junrui Zhang Chenjie Wang Jie Peng Haoyu Li Jianmin Ji Yu Zhang Y. Zhang 28 0 0 09 Apr 2025
Planning Safety Trajectories with Dual-Phase, Physics-Informed, and Transportation Knowledge-Driven Large Language Models Rui Gan Pei Li Keke Long Bocheng An Junwei You Keshu Wu Bin Ran 26 0 0 06 Apr 2025
Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarios Jingzheng Li X. Liu Shikui Wei Zhijun Chen B. Li Qing-Wu Guo Xianqi Yang Yanjun Pu Jiakai Wang AAML ELM 54 0 0 31 Mar 2025
Task-Aware Parameter-Efficient Fine-Tuning of Large Pre-Trained Models at the Edge Senkang Hu Yanan Ma Yihang Tao Zhengru Fang Zihan Fang Yiqin Deng Sam Kwong Yuguang Fang 21 0 0 29 Mar 2025
Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving Yue Li Meng Tian Zhenyu Lin Jiangtong Zhu Dechang Zhu Haiqiang Liu Zining Wang Yueyi Zhang Zhiwei Xiong Xinhai Zhao CoGe VLM 78 0 0 27 Mar 2025
ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generation Haoyu Fu Diankun Zhang Zongchuang Zhao Jianfeng Cui Dingkang Liang Chong Zhang Dingyuan Zhang Hongwei Xie Bing Wang Xiang Bai 36 1 0 25 Mar 2025
Tracking Meets Large Multimodal Models for Driving Scenario Understanding Ayesha Ishaq Jean Lahoud F. Khan Salman Khan Hisham Cholakkal Rao Muhammad Anwer 54 0 0 18 Mar 2025
RAD: Retrieval-Augmented Decision-Making of Meta-Actions with Vision-Language Models in Autonomous Driving Yujin Wang Quanfeng Liu Zhengxin Jiang Tianyi Wang Junfeng Jiao Hongqing Chu B. Gao Hong Chen 56 1 0 18 Mar 2025
Can Large Vision Language Models Read Maps Like a Human? Shuo Xing Zezhou Sun Shuangyu Xie Kaiyuan Chen Yanjia Huang Yuping Wang Jiachen Li Dezhen Song Zhengzhong Tu 56 2 0 18 Mar 2025
InsightDrive: Insight Scene Representation for End-to-End Autonomous Driving Ruiqi Song Xianda Guo Hangbin Wu Qinggong Wei Long Chen 58 1 0 17 Mar 2025
Attention Reallocation: Towards Zero-cost and Controllable Hallucination Mitigation of MLLMs Chongjun Tu Peng Ye Dongzhan Zhou Lei Bai Gang Yu Tao Chen Wanli Ouyang 56 0 0 13 Mar 2025
SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment Katrin Renz Long Chen Elahe Arani Oleg Sinavski MLLM 62 0 0 12 Mar 2025
CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Driving Changxing Liu Genjia Liu Z. Wang Jinchang Yang Siheng Chen 59 0 0 11 Mar 2025
FASIONAD++ : Integrating High-Level Instruction and Information Bottleneck in FAt-Slow fusION Systems for Enhanced Safety in Autonomous Driving with Adaptive Feedback Kangan Qian Ziang Luo Sicong Jiang Zilin Huang Jinyu Miao ... Jiangbo Yu Xinyu Jiao Mengmeng Yang Kun Jiang D. Yang 57 0 0 11 Mar 2025
VisRL: Intention-Driven Visual Perception via Reinforced Reasoning Zhangquan Chen Xufang Luo Dongsheng Li OffRL LRM 53 3 0 10 Mar 2025
Combating Partial Perception Deficit in Autonomous Driving with Multimodal LLM Commonsense Yuting Hu Chenhui Xu Ruiyang Qin Dancheng Liu Amir Nassereldine Yiyu Shi Jinjun Xiong 37 0 0 10 Mar 2025
Evaluation of Safety Cognition Capability in Vision-Language Models for Autonomous Driving Enming Zhang Peizhe Gong Xingyuan Dai Yisheng Lv Q. Miao MLLM ELM 60 0 0 09 Mar 2025
BEVDriver: Leveraging BEV Maps in LLMs for Robust Closed-Loop Driving Katharina Winter Mark Azer Fabian B. Flohr 53 0 0 05 Mar 2025
Towards Effective and Efficient Context-aware Nucleus Detection in Histopathology Whole Slide Images Zhongyi Shui Ruizhe Guo Honglin Li Yuxuan Sun Yunlong Zhang Chenglu Zhu Jiatong Cai Pingyi Chen Yanzhou Su Lin Yang 44 0 0 04 Mar 2025
VaViM and VaVAM: Autonomous Driving through Video Generative Modeling Florent Bartoccioni Elias Ramzi Victor Besnier Shashanka Venkataramanan Tuan-Hung Vu ... Mickael Chen Éloi Zablocki Andrei Bursuc Eduardo Valle Matthieu Cord VGen 68 1 0 24 Feb 2025
Large Language Models for Autonomous Driving (LLM4AD): Concept, Benchmark, Experiments, and Challenges Can Cui Yunsheng Ma Zichong Yang Yupeng Zhou Peiran Liu ... Jitesh Panchal Amr Abdelraouf Rohit Gupta Kyungtae Han Ziran Wang 33 1 0 21 Feb 2025
Vision-Integrated LLMs for Autonomous Driving Assistance : Human Performance Comparison and Trust Evaluation Namhee Kim Woojin Park 38 0 0 06 Feb 2025
DriveLM: Driving with Graph Visual Question Answering Chonghao Sima Katrin Renz Kashyap Chitta L. Chen Hanxue Zhang Chengen Xie Jens Beißwenger Ping Luo Andreas Geiger Hongyang Li 68 159 0 17 Jan 2025
Visual Large Language Models for Generalized and Specialized Applications Yifan Li Zhixin Lai Wentao Bao Zhen Tan Anh Dao Kewei Sui Jiayi Shen Dong Liu Huan Liu Yu Kong VLM 83 10 0 06 Jan 2025
Large Language Model guided Deep Reinforcement Learning for Decision Making in Autonomous Driving Hao Pang Zhenpo Wang Guoqiang Li 29 1 0 24 Dec 2024
doScenes: An Autonomous Driving Dataset with Natural Language Instruction for Human Interaction and Vision-Language Navigation Parthib Roy Srinivasa Perisetla Shashank Shriram Harsha Krishnaswamy Aryan Keskar Ross Greer VGen 65 2 0 08 Dec 2024
FASIONAD : FAst and Slow FusION Thinking Systems for Human-Like Autonomous Driving with Adaptive Feedback Kangan Qian Zhikun Ma Yangfan He Ziang Luo Tianyu Shi ... Zheng Fu Xinyu Jiao Kun Jiang D. Yang Takafumi Matsumaru AI4CE 64 0 0 27 Nov 2024
Generating Out-Of-Distribution Scenarios Using Language Models Erfan Aasi Phat Nguyen Shiva Sreeram Guy Rosman S. Karaman Daniela Rus OODD 76 4 0 25 Nov 2024
Is 'Right' Right? Enhancing Object Orientation Understanding in Multimodal Large Language Models through Egocentric Instruction Tuning Ji Hyeok Jung Eun Tae Kim S. Kim Joo Ho Lee Bumsoo Kim Buru Chang VLM 84 0 0 24 Nov 2024
DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulation Tianyi Yan Dongming Wu Wencheng Han Junpeng Jiang Xia Zhou Kun Zhan Cheng-Zhong Xu Jianbing Shen 24 3 0 18 Nov 2024
CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLM Jingwei Xu Chenyu Wang Zibo Zhao Wen Liu Yi-An Ma Shenghua Gao 42 11 0 07 Nov 2024
WorldSimBench: Towards Video Generation Models as World Simulators Yiran Qin Zhelun Shi Jiwen Yu Xijun Wang Enshen Zhou ... Lu Sheng Jing Shao Lei Bai Wanli Ouyang Ruimao Zhang EGVM VGen 113 364 0 23 Oct 2024
LASER: Script Execution by Autonomous Agents for On-demand Traffic Simulation Hao Gao Jingyue Wang Wenyang Fang Jingwei Xu Yunpeng Huang Taolue Chen Xiaoxing Ma 19 1 0 21 Oct 2024
SmartPretrain: Model-Agnostic and Dataset-Agnostic Representation Learning for Motion Prediction Yang Zhou Hao Shao Letian Wang Steven L. Waslander Hongsheng Li Yu Liu 26 2 0 11 Oct 2024
Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodology X. Wang Donglin Yang Ziqin Wang Hohin Kwan Jinyu Chen Wenjun Wu Hongsheng Li Yue Liao Si Liu 18 0 0 09 Oct 2024
HE-Drive: Human-Like End-to-End Driving with Vision Language Models Junming Wang Xingyu Zhang Zebin Xing Songen Gu Xiaoyang Guo Yang Hu Ziying Song Qian Zhang Xiaoxiao Long Wei Yin 33 0 0 07 Oct 2024
Can LLMs plan paths with extra hints from solvers? Erik Wu Sayan Mitra LRM 16 0 0 07 Oct 2024
DualAD: Dual-Layer Planning for Reasoning in Autonomous Driving Dingrui Wang Marc Kaufeld Johannes Betz 21 0 0 26 Sep 2024
LFP: Efficient and Accurate End-to-End Lane-Level Planning via Camera-LiDAR Fusion Guoliang You Xiaomeng Chu Yifan Duan Xingchen Li Sha Zhang Jianmin Ji Yanyong Zhang 31 0 0 21 Sep 2024
Hey Robot! Personalizing Robot Navigation through Model Predictive Control with a Large Language Model Diego Martínez Baselga O. de Groot Luzia Knoedler Javier Alonso-Mora L. Riazuelo Luis Montano LM&Ro 37 0 0 20 Sep 2024
Video Token Sparsification for Efficient Multimodal LLMs in Autonomous Driving Yunsheng Ma Amr Abdelraouf Rohit Gupta Ziran Wang Kyungtae Han 21 3 0 16 Sep 2024
Making Large Language Models Better Planners with Reasoning-Decision Alignment Zhijian Huang Tao Tang Shaoxiang Chen Sihao Lin Zequn Jie Lin Ma Guangrun Wang Xiaodan Liang 32 8 0 25 Aug 2024