Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

19 April 2021

Papers citing "Multi-Modal Fusion Transformer for End-to-End Autonomous Driving"

50 / 55 papers shown

Title
End-to-End Driving with Online Trajectory Evaluation via BEV World Model Yingyan Li Yuqi Wang Yang Liu Jiawei He Lue Fan Zhaoxiang Zhang OffRL 63 0 0 02 Apr 2025
HisTrackMap: Global Vectorized High-Definition Map Construction via History Map Tracking Jing Yang Sen Yang Xiao Tan Hanli Wang 48 1 0 13 Mar 2025
CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Driving Changxing Liu Genjia Liu Z. Wang Jinchang Yang Siheng Chen 62 0 0 11 Mar 2025
Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Driving Ziying Song Caiyan Jia Lin Liu Hongyu Pan Y. Zhang Junming Wang X. Zhang Shaoqing Xu Lei Yang Yadan Luo 58 1 0 05 Mar 2025
A Survey of World Models for Autonomous Driving Tuo Feng Wenguan Wang Y. Yang VGen 72 5 0 20 Jan 2025
DriveLM: Driving with Graph Visual Question Answering Chonghao Sima Katrin Renz Kashyap Chitta L. Chen Hanxue Zhang Chengen Xie Jens Beißwenger Ping Luo Andreas Geiger Hongyang Li 81 160 0 17 Jan 2025
Mitigating Covariate Shift in Imitation Learning for Autonomous Vehicles Using Latent Space Generative World Models A. Popov Alperen Degirmenci David Wehr Shashank Hegde Ryan Oldja ... David Nistér Urs Muller Ruchi Bhargava Stan Birchfield Nikolai Smolyanskiy 75 9 0 25 Sep 2024
Robust Long-Range Perception Against Sensor Misalignment in Autonomous Vehicles Zi-Xiang Xia Sudeep Fadadu Yi Shi Louis Foucard AAML 28 0 0 20 Aug 2024
Enhancing End-to-End Autonomous Driving with Latent World Model Yingyan Li Lue Fan Jiawei He Yuqi Wang Yuntao Chen Zhaoxiang Zhang Tieniu Tan 67 8 0 12 Jun 2024
Towards Collaborative Autonomous Driving: Simulation Platform and End-to-End System Genjia Liu Yue Hu Chenxin Xu Weibo Mao Junhao Ge ... Yifan Lu Yinda Xu Junkai Xia Yafei Wang Siheng Chen 66 7 0 15 Apr 2024
Guided Masked Self-Distillation Modeling for Distributed Multimedia Sensor Event Analysis Masahiro Yasuda Noboru Harada Yasunori Ohishi Shoichiro Saito Akira Nakayama Nobutaka Ono 29 3 0 12 Apr 2024
Context-aware LLM-based Safe Control Against Latent Risks Quang Khanh Luu Xiyu Deng Anh Van Ho Yorie Nakahira 51 4 0 18 Mar 2024
Unleashing the Power of CNN and Transformer for Balanced RGB-Event Video Recognition Xiao Wang Yao Rong Shiao Wang Yuan Chen Zhe Wu Bowei Jiang Yonghong Tian Jin Tang ViT 76 3 0 18 Dec 2023
LMDrive: Closed-Loop End-to-End Driving with Large Language Models Hao Shao Yuxuan Hu Letian Wang Steven L. Waslander Yu Liu Hongsheng Li ELM 30 109 0 12 Dec 2023
ADriver-I: A General World Model for Autonomous Driving Fan Jia Weixin Mao Yingfei Liu Yucheng Zhao Yuqing Wen Chi Zhang Xiangyu Zhang Tiancai Wang 22 63 0 22 Nov 2023
LeTFuser: Light-weight End-to-end Transformer-Based Sensor Fusion for Autonomous Driving with Multi-Task Learning Pedram Agand Mohammad Mahdavian Manolis Savva Mo Chen ViT 21 4 0 19 Oct 2023
Cognitive TransFuser: Semantics-guided Transformer-based Sensor Fusion for Improved Waypoint Prediction Hwan-Soo Choi Jong-Lyul Jeong Young Cho Kuk-Jin Yoon Jong-hwan Kim 6 1 0 04 Aug 2023
DeepIPCv2: LiDAR-powered Robust Environmental Perception and Navigational Control for Autonomous Vehicle Oskar Natan J. Miura 3DPC 16 1 0 13 Jul 2023
TADIL: Task-Agnostic Domain-Incremental Learning through Task-ID Inference using Transformer Nearest-Centroid Embeddings Gusseppe Bravo Rocca Peini Liu Jordi Guitart Ajay Dholakia David Ellison 8 1 0 21 Jun 2023
Energy-Based Models for Cross-Modal Localization using Convolutional Transformers Alan Wu Michael S. Ryoo 16 3 0 06 Jun 2023
$β$ -Variational autoencoders and transformers for reduced-order modelling of fluid flows Alberto Solera-Rico Carlos Sanmiguel Vila Miguel Gómez-López Yuning Wang Abdulrahman Almashjary Scott T. M. Dawson Ricardo Vinuesa DRL 11 73 0 07 Apr 2023
Integrated Behavior Planning and Motion Control for Autonomous Vehicles with Traffic Rules Compliance Haichao Liu Kai Chen Yuling Li Zhen Huang Jianghua Duan Jun Ma 8 11 0 03 Apr 2023
Penalty-Based Imitation Learning With Cross Semantics Generation Sensor Fusion for Autonomous Driving Hongkuan Zhou Aifen Sui Letian Shi Yinxian Li 23 2 0 21 Mar 2023
PlanT: Explainable Planning Transformers via Object-Level Representations Katrin Renz Kashyap Chitta Otniel-Bogdan Mercea A. Sophia Koepke Zeynep Akata Andreas Geiger ViT 19 94 0 25 Oct 2022
Exploring Contextual Representation and Multi-Modality for End-to-End Autonomous Driving Shoaib Azam Farzeen Munir Ville Kyrki M. Jeon Witold Pedrycz 32 1 0 13 Oct 2022
Toward Edge-Efficient Dense Predictions with Synergistic Multi-Task Neural Architecture Search Thanh Vu Yan-Quan Zhou Chun-Yung Wen Yueqi Li Jan-Michael Frahm 16 4 0 04 Oct 2022
From One to Many: Dynamic Cross Attention Networks for LiDAR and Camera Fusion Rui Wan Shuangjie Xu Wei Wu Xiaoyi Zou Tongyi Cao 3DPC 10 4 0 25 Sep 2022
Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection Xiang Zhang Huiyuan Yang Taoyue Wang Xiaotian Li L. Yin 19 7 0 25 Sep 2022
FFPA-Net: Efficient Feature Fusion with Projection Awareness for 3D Object Detection Chaokang Jiang Guangming Wang Jinxing Wu Yanzi Miao Hesheng Wang 3DPC 24 5 0 15 Sep 2022
Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer Hao Shao Letian Wang Ruobing Chen Hongsheng Li Y. Liu 25 194 0 28 Jul 2022
MMFN: Multi-Modal-Fusion-Net for End-to-End Driving Qingwen Zhang Mingkai Tang R. Geng Feiyi Chen Ren Xin Lujia Wang 22 32 0 01 Jul 2022
Level 2 Autonomous Driving on a Single Device: Diving into the Devils of Openpilot Li Chen Tutian Tang Zhitian Cai Yang Li Peng Wu Hongyang Li Jianping Shi Junchi Yan Yu Qiao VLM 15 13 0 16 Jun 2022
Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline Peng Wu Xiaosong Jia Li Chen Junchi Yan Hongyang Li Yu Qiao 22 181 0 16 Jun 2022
Multimodal Learning with Transformers: A Survey P. Xu Xiatian Zhu David A. Clifton ViT 41 518 0 13 Jun 2022
TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving Kashyap Chitta Aditya Prakash Bernhard Jaeger Zehao Yu Katrin Renz Andreas Geiger ViT 87 291 0 31 May 2022
Multi-Task Learning with Multi-Query Transformer for Dense Prediction Yangyang Xu Xiangtai Li Haobo Yuan Yibo Yang Lefei Zhang ViT 13 45 0 28 May 2022
Emergent Visual Sensors for Autonomous Vehicles You Li Julien Moreau J. Ibañez-Guzmán 38 26 0 19 May 2022
POViT: Vision Transformer for Multi-objective Design and Characterization of Nanophotonic Devices Xinyu Chen Renjie Li Yueyao Yu Yuanwen Shen Wenye Li Zhaoyu Zhang Yin Zhang ViT 6 1 0 17 May 2022
Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing Jonathan M Francis Bingqing Chen Siddha Ganju Sidharth Kathpal Jyotish Poonganam ... Ivan Zhukov Max Kumskoy Anirudh Koul Jean Oh Eric Nyberg 11 11 0 05 May 2022
COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles Jiaxun Cui Hang Qiu Dian Chen Peter Stone Yuke Zhu 17 109 0 04 May 2022
End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agent Oskar Natan J. Miura 12 34 0 12 Apr 2022
Learning from All Vehicles Dian Chen Philipp Krahenbuhl 17 175 0 22 Mar 2022
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers Jiaming Zhang Huayao Liu Kailun Yang Xinxin Hu Ruiping Liu Rainer Stiefelhagen ViT 21 292 0 09 Mar 2022
Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Information Lingfeng Yang Xiang Li Renjie Song Borui Zhao J. Tao Shihao Zhou Jiajun Liang Jian Yang 11 37 0 07 Mar 2022
Video Transformers: A Survey Javier Selva A. S. Johansen Sergio Escalera Kamal Nasrollahi T. Moeslund Albert Clapés ViT 20 101 0 16 Jan 2022
TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions Jeya Maria Jose Valanarasu R. Yasarla Vishal M. Patel ViT 34 274 0 29 Nov 2021
ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks Hua Qi Zhijie Wang Qing-Wu Guo Jianlang Chen Felix Juefei Xu L. Ma Jianjun Zhao AAML AI4CE 19 16 0 26 Nov 2021
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Zhongchao Shi Jianping Fan Zhiqiang He 3DGS ViT 66 325 0 11 Nov 2021
Deep Federated Learning for Autonomous Driving A. Nguyen Tuong Khanh Long Do Minh-Ngoc Tran Binh X. Nguyen C. Duong T. Phan Erman Tjiputra Quang-Dieu Tran FedML 18 107 0 12 Oct 2021
Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers Ruihan Yang Minghao Zhang Nicklas Hansen Huazhe Xu Xiaolong Wang OffRL 11 99 0 08 Jul 2021