Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2312.09245
Cited By
DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
14 December 2023
Wenhai Wang
Jiangwei Xie
ChuanYang Hu
Haoming Zou
Jianan Fan
Wenwen Tong
Yang Wen
Silei Wu
Hanming Deng
Zhiqi Li
Hao Tian
Lewei Lu
Xizhou Zhu
Xiaogang Wang
Yu Qiao
Jifeng Dai
Re-assign community
ArXiv
PDF
HTML
Papers citing
"DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving"
50 / 100 papers shown
Title
OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving
Julong Wei
Shanshuai Yuan
Pengfei Li
Qingda Hu
Zhongxue Gan
Wenchao Ding
VLM
16
17
0
05 Sep 2024
How Could Generative AI Support Compliance with the EU AI Act? A Review for Safe Automated Driving Perception
Mert Keser
Youssef Shoeb
Alois Knoll
27
2
0
30 Aug 2024
Making Large Language Models Better Planners with Reasoning-Decision Alignment
Zhijian Huang
Tao Tang
Shaoxiang Chen
Sihao Lin
Zequn Jie
Lin Ma
Guangrun Wang
Xiaodan Liang
46
8
0
25 Aug 2024
Edge-Cloud Collaborative Motion Planning for Autonomous Driving with Large Language Models
Jiao Chen
Suyan Dai
Fangfang Chen
Zuohong Lv
Jianhua Tang
27
1
0
19 Aug 2024
CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Driving
Hidehisa Arai
Keita Miwa
Kento Sasaki
Yu Yamaguchi
Kohei Watanabe
Shunsuke Aoki
Issei Yamamoto
35
9
0
19 Aug 2024
DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving
Xuemeng Yang
Licheng Wen
Yukai Ma
Jianbiao Mei
Xin Li
...
Min Dou
Botian Shi
Liang He
Yong-Jin Liu
Yu Qiao
VGen
27
6
0
01 Aug 2024
Large Language Models for Human-like Autonomous Driving: A Survey
Yun Li
Kai Katsumata
Ehsan Javanmardi
Manabu Tsukada
LM&MA
29
5
0
27 Jul 2024
Exploring the Causality of End-to-End Autonomous Driving
Jiankun Li
Hao Li
Jiangjiang Liu
Zhikang Zou
Xiaoqing Ye
F. Wang
Jizhou Huang
Hua-Hong Wu
Haifeng Wang
LRM
35
4
0
09 Jul 2024
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey
Guanqiao Qu
Qiyuan Chen
Wei Wei
Zheng Lin
Xianhao Chen
Kaibin Huang
31
37
0
09 Jul 2024
Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Driving
Ran Tian
Boyi Li
Xinshuo Weng
Yuxiao Chen
Edward Schmerling
Yue Wang
B. Ivanovic
Marco Pavone
24
13
0
01 Jul 2024
SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
Zheng Lin
Xuanjie Hu
Yuxin Zhang
Zhe Chen
Zihan Fang
Xianhao Chen
Ang Li
Praneeth Vepakomma
Yue Gao
39
28
0
01 Jul 2024
Asynchronous Large Language Model Enhanced Planner for Autonomous Driving
Yuan-Hsin Chen
Zi-han Ding
Ziqin Wang
Yan Wang
Lijun Zhang
Si Liu
58
9
0
20 Jun 2024
Using Multimodal Large Language Models for Automated Detection of Traffic Safety Critical Events
M. Tami
Huthaifa I. Ashqar
Mohammed Elhenawy
32
3
0
19 Jun 2024
CarLLaVA: Vision language models for camera-only closed-loop driving
Katrin Renz
Long Chen
Ana-Maria Marcu
Jan Hünermann
Benoît Hanotte
Alice Karnsund
Jamie Shotton
Elahe Arani
Oleg Sinavski
VLM
28
16
0
14 Jun 2024
SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding
Junwei Luo
Zhen Pang
Yongjun Zhang
Tingzhu Wang
Linlin Wang
...
Jiangwei Lao
Jian Wang
Jingdong Chen
Yihua Tan
Yansheng Li
28
20
0
14 Jun 2024
A Superalignment Framework in Autonomous Driving with Large Language Models
Xiangrui Kong
Thomas Braunl
Marco Fahmi
Yue Wang
21
9
0
09 Jun 2024
AD-H: Autonomous Driving with Hierarchical Agents
Zaibin Zhang
Shiyu Tang
Yuanhang Zhang
Talas Fu
Yifan Wang
Yang Liu
Dong Wang
Jing Shao
Lijun Wang
H. Lu
42
3
0
05 Jun 2024
DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences
Yidong Huang
Jacob Sansom
Ziqiao Ma
Felix Gervits
Joyce Chai
36
17
0
05 Jun 2024
Is a 3D-Tokenized LLM the Key to Reliable Autonomous Driving?
Yifan Bai
Dongming Wu
Yingfei Liu
Fan Jia
Weixin Mao
...
Yucheng Zhao
Jianbing Shen
Xing Wei
Tiancai Wang
Xiangyu Zhang
MLLM
16
9
0
28 May 2024
Continuously Learning, Adapting, and Improving: A Dual-Process Approach to Autonomous Driving
Jianbiao Mei
Yukai Ma
Xuemeng Yang
Licheng Wen
Xinyu Cai
...
Min Dou
Botian Shi
Liang He
Yong-Jin Liu
Yu Qiao
35
9
0
24 May 2024
OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning
Shihao Wang
Zhiding Yu
Xiaohui Jiang
Shiyi Lan
Min Shi
Nadine Chang
Jan Kautz
Ying Li
Jose M. Alvarez
LRM
26
47
0
02 May 2024
Can Vehicle Motion Planning Generalize to Realistic Long-tail Scenarios?
Marcel Hallgarten
Julian Zapata
Martin Stoll
Katrin Renz
Andreas Zell
24
10
0
11 Apr 2024
Scaling Multi-Camera 3D Object Detection through Weak-to-Strong Eliciting
Hao Lu
Jiaqi Tang
Xinli Xu
Xu Cao
Yunpeng Zhang
Guoqing Wang
Dalong Du
Hao Chen
Ying Chen
22
3
0
10 Apr 2024
Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous Driving
Akshay Gopalkrishnan
Ross Greer
Mohan M. Trivedi
VLM
33
21
0
28 Mar 2024
Assessment of Multimodal Large Language Models in Alignment with Human Values
Zhelun Shi
Zhipin Wang
Hongxing Fan
Zaibin Zhang
Lijun Li
Yongting Zhang
Zhen-fei Yin
Lu Sheng
Yu Qiao
Jing Shao
27
14
0
26 Mar 2024
DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving
Tianqi Wang
Enze Xie
Ruihang Chu
Zhenguo Li
Ping Luo
LRM
32
12
0
25 Mar 2024
Driving Style Alignment for LLM-powered Driver Agent
Ruoxuan Yang
Xinyue Zhang
Anais Fernandez-Laaksonen
Xin Ding
Jiangtao Gong
24
10
0
17 Mar 2024
Large Language Models Powered Context-aware Motion Prediction
Xiaoji Zheng
Lixiu Wu
Zhijie Yan
Yuanrong Tang
Hao Zhao
Chen Zhong
Bokui Chen
Jiangtao Gong
39
7
0
17 Mar 2024
DrPlanner: Diagnosis and Repair of Motion Planners Using Large Language Models
Yuanfei Lin
Chenran Li
Mingyu Ding
Masayoshi Tomizuka
Wei Zhan
Matthias Althoff
33
4
0
12 Mar 2024
VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning
Shaoyu Chen
Bo Jiang
Hao Gao
Bencheng Liao
Qing Xu
Qian Zhang
Chang Huang
Wenyu Liu
Xinggang Wang
BDL
29
40
0
20 Feb 2024
RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Model
Jianhao Yuan
Shuyang Sun
Daniel Omeiza
Bo-Lu Zhao
Paul Newman
Lars Kunze
Matthew Gadd
LRM
14
47
0
16 Feb 2024
Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives
Sheng Luo
Wei-Neng Chen
Wanxin Tian
Rui Liu
Luanxuan Hou
...
Ling Shao
Yi Yang
Bojun Gao
Qun Li
Guobin Wu
47
3
0
05 Feb 2024
LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving
Daocheng Fu
Wenjie Lei
Licheng Wen
Pinlong Cai
Song Mao
Min Dou
Botian Shi
Yu Qiao
36
6
0
02 Feb 2024
A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlook
Mingyu Liu
Ekim Yurtsever
Jonathan Fossaert
Xingcheng Zhou
Walter Zimmer
Yuning Cui
B. L. Žagar
Alois C. Knoll
40
34
0
02 Jan 2024
Prospective Role of Foundation Models in Advancing Autonomous Vehicles
Jianhua Wu
B. Gao
Jincheng Gao
Jianhao Yu
Hongqing Chu
...
Xun Gong
Yi Chang
H. E. Tseng
Hong Chen
Jie Chen
31
3
0
08 Dec 2023
LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs
Yunsheng Ma
Can Cui
Xu Cao
Wenqian Ye
Peiran Liu
...
Rohit Gupta
Kyungtae Han
Aniket Bera
James M. Rehg
Ziran Wang
15
42
0
07 Dec 2023
LLM4Drive: A Survey of Large Language Models for Autonomous Driving
Zhenjie Yang
Xiaosong Jia
Hongyang Li
Junchi Yan
ELM
24
92
0
02 Nov 2023
ControlLLM: Augment Language Models with Tools by Searching on Graphs
Zhaoyang Liu
Zeqiang Lai
Zhangwei Gao
Erfei Cui
Ziheng Li
...
Lewei Lu
Qifeng Chen
Yu Qiao
Jifeng Dai
Wenhai Wang
MLLM
123
20
0
26 Oct 2023
Vision Language Models in Autonomous Driving: A Survey and Outlook
Xingcheng Zhou
Mingyu Liu
Ekim Yurtsever
B. L. Žagar
Walter Zimmer
Hu Cao
Alois C. Knoll
VLM
15
33
0
22 Oct 2023
LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving
Hao Sha
Yao Mu
Yuxuan Jiang
Li Chen
Chenfeng Xu
Ping Luo
Shengbo Eben Li
Masayoshi Tomizuka
Wei Zhan
Mingyu Ding
99
154
0
04 Oct 2023
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality
Qinghao Ye
Haiyang Xu
Guohai Xu
Jiabo Ye
Ming Yan
...
Junfeng Tian
Qiang Qi
Ji Zhang
Feiyan Huang
Jingren Zhou
VLM
MLLM
201
883
0
27 Apr 2023
Car-Following Models: A Multidisciplinary Review
T. Zhang
Ph.D.
Peter J. Jin
Ph.D.
Sean T. McQuade
Ph.D.
Alexandre M. Bayen
Ph.D.
B. Piccoli
16
3
0
14 Apr 2023
Generative Agents: Interactive Simulacra of Human Behavior
J. Park
Joseph C. O'Brien
Carrie J. Cai
Meredith Ringel Morris
Percy Liang
Michael S. Bernstein
LM&Ro
AI4CE
206
1,701
0
07 Apr 2023
VAD: Vectorized Scene Representation for Efficient Autonomous Driving
Bo Jiang
Shaoyu Chen
Qing Xu
Bencheng Liao
Jiajie Chen
Helong Zhou
Qian Zhang
Wenyu Liu
Chang Huang
Xinggang Wang
108
190
0
21 Mar 2023
Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Review
Yining Shi
Kun Jiang
Jiusi Li
Zelin Qian
Jun Wen
Mengmeng Yang
Ke Wang
Diange Yang
61
25
0
02 Mar 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
Junnan Li
Dongxu Li
Silvio Savarese
Steven C. H. Hoi
VLM
MLLM
244
4,186
0
30 Jan 2023
TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving
Kashyap Chitta
Aditya Prakash
Bernhard Jaeger
Zehao Yu
Katrin Renz
Andreas Geiger
ViT
81
291
0
31 May 2022
Training language models to follow instructions with human feedback
Long Ouyang
Jeff Wu
Xu Jiang
Diogo Almeida
Carroll L. Wainwright
...
Amanda Askell
Peter Welinder
Paul Christiano
Jan Leike
Ryan J. Lowe
OSLM
ALM
301
11,730
0
04 Mar 2022
Learning to drive from a world on rails
Di Chen
V. Koltun
Philipp Krahenbuhl
92
99
0
03 May 2021
SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Driving
Ming Zhou
Jun-Jie Luo
Julian Villela
Yaodong Yang
David Rusu
...
H. Ammar
Hongbo Zhang
Wulong Liu
Jianye Hao
Jun Wang
125
192
0
19 Oct 2020
Previous
1
2