Drive Like a Human: Rethinking Autonomous Driving with Large Language Models

14 July 2023

Daocheng Fu

Xin Li

Licheng Wen

Yu Qiao

Papers citing "Drive Like a Human: Rethinking Autonomous Driving with Large Language Models"

50 / 105 papers shown

Title
Probing Multimodal LLMs as World Models for Driving Shiva Sreeram T. Wang Alaa Maalouf Guy Rosman S. Karaman Daniela Rus 20 7 0 09 May 2024
ESP: Extro-Spective Prediction for Long-term Behavior Reasoning in Emergency Scenarios Dingrui Wang Zheyuan Lai Yuda Li Yi Wu Yuexin Ma Johannes Betz Ruigang Yang Wei Li 19 1 0 07 May 2024
WDMoE: Wireless Distributed Large Language Models with Mixture of Experts Nan Xue Yaping Sun Zhiyong Chen Meixia Tao Xiaodong Xu Liang Qian Shuguang Cui Ping Zhang MoE 23 9 0 06 May 2024
Physical Backdoor Attack can Jeopardize Driving with Vision-Large-Language Models Zhenyang Ni Rui Ye Yuxian Wei Zhen Xiang Yanfeng Wang Siheng Chen AAML 32 9 0 19 Apr 2024
Octopus v3: Technical Report for On-device Sub-billion Multimodal AI Agent Wei Chen Zhiyuan Li LLMAG 17 3 0 17 Apr 2024
Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generation Hanlin Tian Kethan Reddy Yuxiang Feng Mohammed Quddus Y. Demiris Panagiotis Angeloudis 22 10 0 12 Apr 2024
Can Vehicle Motion Planning Generalize to Realistic Long-tail Scenarios? Marcel Hallgarten Julian Zapata Martin Stoll Katrin Renz Andreas Zell 27 10 0 11 Apr 2024
AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learning Senkang Hu Zhengru Fang Zihan Fang Yiqin Deng Xianhao Chen Yuguang Fang 54 31 0 09 Apr 2024
TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenes Bu Jin Yupeng Zheng Pengfei Li Weize Li Yuhang Zheng ... Kun Zhan Peng Jia Xiaoxiao Long Yilun Chen Hao Zhao 3DV 50 14 0 28 Mar 2024
DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving Tianqi Wang Enze Xie Ruihang Chu Zhenguo Li Ping Luo LRM 32 15 0 25 Mar 2024
Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Driving Shahin Atakishiyev Mohammad Salameh Randy Goebel 58 6 0 18 Mar 2024
Driving Style Alignment for LLM-powered Driver Agent Ruoxuan Yang Xinyue Zhang Anais Fernandez-Laaksonen Xin Ding Jiangtao Gong 30 10 0 17 Mar 2024
LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environments Maonan Wang Aoyu Pang Yuheng Kan Man-On Pun Chung Shue Chen Bo Huang 16 18 0 13 Mar 2024
LG-Traj: LLM Guided Pedestrian Trajectory Prediction Pranav Singh Chib Pravendra Singh 30 11 0 12 Mar 2024
HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices Xuanlei Zhao Bin Jia Hao Zhou Ziming Liu Shenggan Cheng Yang You 14 4 0 02 Mar 2024
NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation Jiazhao Zhang Kunyu Wang Rongtao Xu Gengze Zhou Yicong Hong Xiaomeng Fang Qi Wu Zhizheng Zhang Wang He LM&Ro 27 44 0 24 Feb 2024
Large Multimodal Agents: A Survey Junlin Xie Zhihong Chen Ruifei Zhang Xiang Wan Guanbin Li LM&Ro LLMAG 37 38 0 23 Feb 2024
Hybrid Reasoning Based on Large Language Models for Autonomous Car Driving Mehdi Azarafza M. Nayyeri Charles Steinmetz Steffen Staab A. Rettberg LRM 30 9 0 21 Feb 2024
VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning Shaoyu Chen Bo Jiang Hao Gao Bencheng Liao Qing Xu Qian Zhang Chang Huang Wenyu Liu Xinggang Wang BDL 43 41 0 20 Feb 2024
All Language Models Large and Small Zhixun Chen Yali Du D. Mguni 19 0 0 19 Feb 2024
Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives Sheng Luo Wei-Neng Chen Wanxin Tian Rui Liu Luanxuan Hou ... Ling Shao Yi Yang Bojun Gao Qun Li Guobin Wu 47 13 0 05 Feb 2024
LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving Daocheng Fu Wenjie Lei Licheng Wen Pinlong Cai Song Mao Min Dou Botian Shi Yu Qiao 36 27 0 02 Feb 2024
Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities Xu Yan Haiming Zhang Yingjie Cai Jingming Guo Weichao Qiu ... Lihui Jiang Wei Zhang Hongbo Zhang Dengxin Dai Bingbing Liu 51 16 0 16 Jan 2024
A Survey on 3D Gaussian Splatting Guikun Chen Wenguan Wang 3DGS 28 169 0 08 Jan 2024
Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectives Chen Gao Xiaochong Lan Nian Li Yuan Yuan Jingtao Ding Zhilun Zhou Fengli Xu Yong Li LLMAG AI4CE LM&Ro 29 97 0 19 Dec 2023
Personalized Autonomous Driving with Large Language Models: Field Experiments Can Cui Zichong Yang Yupeng Zhou Yunsheng Ma Juanwu Lu Lingxi Li Yaobin Chen Jitesh Panchal Ziran Wang 51 16 0 14 Dec 2023
NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotations Yuichi Inoue Yuki Yada Kotaro Tanahashi Yu Yamaguchi 21 17 0 11 Dec 2023
Evaluation of Large Language Models for Decision Making in Autonomous Driving Kotaro Tanahashi Yuichi Inoue Yu Yamaguchi Hidetatsu Yaginuma Daiki Shiotsuka ... Koki Igari Tsukasa Horinouchi Kento Tokuhiro Yugo Tokuchi Shunsuke Aoki 8 11 0 11 Dec 2023
Prospective Role of Foundation Models in Advancing Autonomous Vehicles Jianhua Wu B. Gao Jincheng Gao Jianhao Yu Hongqing Chu ... Xun Gong Yi Chang H. E. Tseng Hong Chen Jie Chen 31 3 0 08 Dec 2023
LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs Yunsheng Ma Can Cui Xu Cao Wenqian Ye Peiran Liu ... Rohit Gupta Kyungtae Han Aniket Bera James M. Rehg Ziran Wang 21 42 0 07 Dec 2023
Towards Knowledge-driven Autonomous Driving Xin Li Yeqi Bai Pinlong Cai Licheng Wen Daocheng Fu ... Yikang Li Botian Shi Yong-Jin Liu Liang He Yu Qiao 32 26 0 07 Dec 2023
Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving Ming-Jun Nie Renyuan Peng Chunwei Wang Xinyue Cai Jianhua Han Hang Xu Li Zhang LRM 27 44 0 06 Dec 2023
Dolphins: Multimodal Language Model for Driving Yingzi Ma Yulong Cao Jiachen Sun Marco Pavone Chaowei Xiao MLLM 21 49 0 01 Dec 2023
LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning Sijin Chen Xin Chen C. Zhang Mingsheng Li Gang Yu Hao Fei Hongyuan Zhu Jiayuan Fan Tao Chen MLLM 24 76 0 30 Nov 2023
Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorld Yijun Yang Tianyi Zhou Kanxue Li Dapeng Tao Lusong Li Li Shen Xiaodong He Jing Jiang Yuhui Shi LLMAG LM&Ro 8 34 0 28 Nov 2023
Empowering Autonomous Driving with Large Language Models: A Safety Perspective Yixuan Wang Ruochen Jiao Sinong Simon Zhan Chengtian Lang Chao Huang Zhaoran Wang Zhuoran Yang Qi Zhu 19 26 0 28 Nov 2023
A Survey on Multimodal Large Language Models for Autonomous Driving Can Cui Yunsheng Ma Xu Cao Wenqian Ye Yang Zhou ... Xinrui Yan Shuqi Mei Jianguo Cao Ziran Wang Chao Zheng 36 248 0 21 Nov 2023
Applications of Large Scale Foundation Models for Autonomous Driving Yu Huang Yue Chen Zhu Li ELM AI4CE LRM ALM LM&Ro 46 14 0 20 Nov 2023
A Language Agent for Autonomous Driving Jiageng Mao Junjie Ye Yuxi Qian Marco Pavone Yue Wang LM&Ro LRM 12 90 0 17 Nov 2023
Human-Centric Autonomous Systems With LLMs for User Command Reasoning Yi Yang Qingwen Zhang Ci Li Daniel Simoes Marta Nazre Batool John Folkesson LRM 59 28 0 14 Nov 2023
On the Road with GPT-4V(ision): Early Explorations of Visual-Language Model on Autonomous Driving Licheng Wen Xuemeng Yang Daocheng Fu Xiaofeng Wang Pinlong Cai ... Xinyu Cai Min Dou Shuanglu Hu Botian Shi Yu Qiao VLM 18 79 0 09 Nov 2023
LLM4Drive: A Survey of Large Language Models for Autonomous Driving Zhenjie Yang Xiaosong Jia Hongyang Li Junchi Yan ELM 24 92 0 02 Nov 2023
Vision Language Models in Autonomous Driving: A Survey and Outlook Xingcheng Zhou Mingyu Liu Ekim Yurtsever B. L. Žagar Walter Zimmer Hu Cao Alois C. Knoll VLM 17 33 0 22 Oct 2023
LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving Hao Sha Yao Mu Yuxuan Jiang Li Chen Chenfeng Xu Ping Luo Shengbo Eben Li Masayoshi Tomizuka Wei Zhan Mingyu Ding 105 159 0 04 Oct 2023
GPT-Driver: Learning to Drive with GPT Jiageng Mao Yuxi Qian Junjie Ye Hang Zhao Yue Wang LRM 17 199 0 02 Oct 2023
DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Model Zhenhua Xu Yujia Zhang Enze Xie Zhen Zhao Yong Guo Kwan-Yee. K. Wong Zhenguo Li Hengshuang Zhao MLLM 18 250 0 02 Oct 2023
LANCAR: Leveraging Language for Context-Aware Robot Locomotion in Unstructured Environments Chak Lam Shek Xiyang Wu Wesley A. Suttle Carl E. Busart Erin Zaroukian Dinesh Manocha Pratap Tokekar Amrit Singh Bedi LLMAG 41 8 0 30 Sep 2023
DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models Licheng Wen Daocheng Fu Xin Li Xinyu Cai Tengyu Ma Pinlong Cai Min Dou Botian Shi Liang He Yu Qiao 21 146 0 28 Sep 2023
SurrealDriver: Designing Generative Driver Agent Simulation Framework in Urban Contexts based on Large Language Model Ye Jin Xiaoxi Shen Huiling Peng Xiaoan Liu Jingli Qin Jiayang Li Jintao Xie Peizhong Gao Guyue Zhou Jiangtao Gong LLMAG 31 8 0 22 Sep 2023
Generative Agents: Interactive Simulacra of Human Behavior J. Park Joseph C. O'Brien Carrie J. Cai Meredith Ringel Morris Percy Liang Michael S. Bernstein LM&Ro AI4CE 215 1,701 0 07 Apr 2023