Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges

21 February 2019

Di Feng

Christian Haase-Schuetz

Klaus C. J. Dietmayer

3DPC

ArXiv PDF HTML

Papers citing "Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges"

50 / 77 papers shown

Title
A multi-scale vision transformer-based multimodal GeoAI model for mapping Arctic permafrost thaw Wenwen Li Chia-Yu Hsu Sizhe Wang Zhining Gu Yili Yang Brendan M. Rogers A. Liljedahl 57 0 0 23 Apr 2025
MS-Occ: Multi-Stage LiDAR-Camera Fusion for 3D Semantic Occupancy Prediction Zhiqiang Wei Lianqing Zheng J. Liu Tao Huang Qing-Long Han Wenwen Zhang Fengdeng Zhang 22 0 0 22 Apr 2025
Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustness Chenfei Liao Kaiyu Lei Xu Zheng Junha Moon Zhixiong Wang Y. Wang Danda Pani Paudel Luc Van Gool Xuming Hu VLM 68 2 0 24 Mar 2025
AnywhereDoor: Multi-Target Backdoor Attacks on Object Detection Jialin Lu Junjie Shan Ziqi Zhao Ka-Ho Chow AAML 51 0 0 09 Mar 2025
Optimizing Estimators of Squared Calibration Errors in Classification Sebastian G. Gruber Francis Bach 69 1 0 24 Feb 2025
A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions Elisa Negrini Yuxuan Liu Liu Yang Stanley Osher Hayden Schaeffer AI4CE 86 0 0 09 Feb 2025
Point2RBox-v2: Rethinking Point-supervised Oriented Object Detection with Spatial Layout Among Instances Yi Yu Botao Ren Peiyuan Zhang Mingxin Liu Junwei Luo Shaofeng Zhang Feipeng Da Junchi Yan Xue Yang 3DPC 114 1 0 06 Feb 2025
Static Segmentation by Tracking: A Frustratingly Label-Efficient Approach to Fine-Grained Segmentation Zhenyang Feng Zihe Wang Saul Ibaven Bueno Tomasz Frelek Advikaa Ramesh ... Hilmar Lapp Charles V. Stewart T. Berger-Wolf Yu-Chuan Su Wei-Lun Chao 44 0 0 12 Jan 2025
Multi-Scale Grouped Prototypes for Interpretable Semantic Segmentation Hugo Porta Emanuele Dalsasso Diego Marcos D. Tuia 93 0 0 14 Sep 2024
A Generative Adversarial Network-based Method for LiDAR-Assisted Radar Image Enhancement Thakshila Thilakanayake Oscar De Silva Thumeera R. Wanasinghe George K. Mann Awantha Jayasiri GAN 35 1 0 30 Aug 2024
Learning Autonomous Race Driving with Action Mapping Reinforcement Learning Yuanda Wang Xin Yuan Changyin Sun 29 1 0 21 Jun 2024
Explainable AI (XAI) in Image Segmentation in Medicine, Industry, and Beyond: A Survey Rokas Gipiškis Chun-Wei Tsai Olga Kurasova 52 5 0 02 May 2024
BoostRad: Enhancing Object Detection by Boosting Radar Reflections Yuval Haitman Oded Bialer 19 3 0 27 Apr 2024
CLIP-GS: CLIP-Informed Gaussian Splatting for Real-time and View-consistent 3D Semantic Understanding Guibiao Liao Jiankun Li Zhenyu Bao Xiaoqing Ye Jingdong Wang Qing Li Kanglin Liu 3DGS 38 14 0 22 Apr 2024
Image-Text Co-Decomposition for Text-Supervised Semantic Segmentation Ji-Jia Wu Andy Chia-Hao Chang Chieh-Yu Chuang Chun-Pei Chen Yu-Lun Liu Min-Hung Chen Hou-Ning Hu Yung-Yu Chuang Yen-Yu Lin VLM 38 9 0 05 Apr 2024
Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Review Shanliang Yao Runwei Guan Zitian Peng Chenhang Xu Yilu Shi ... Hyungjoon Seo Ka Lok Man Jieming Ma Xiaohui Zhu Yutao Yue 44 5 0 08 Dec 2023
GP-NeRF: Generalized Perception NeRF for Context-Aware 3D Scene Understanding Hao Li Dingwen Zhang Yalun Dai Nian Liu Lechao Cheng Jingfeng Li Jingdong Wang Junwei Han 19 13 0 20 Nov 2023
LeTFuser: Light-weight End-to-end Transformer-Based Sensor Fusion for Autonomous Driving with Multi-Task Learning Pedram Agand Mohammad Mahdavian Manolis Savva Mo Chen ViT 21 4 0 19 Oct 2023
Robust Navigation with Cross-Modal Fusion and Knowledge Transfer Wenzhe Cai Guangran Cheng Lingyue Kong Lu Dong Changyin Sun 21 1 0 23 Sep 2023
OccluTrack: Rethinking Awareness of Occlusion for Enhancing Multiple Pedestrian Tracking Jianjun Gao Yi Wang Kim-Hui Yap Kratika Garg Bo Han 79 1 0 19 Sep 2023
Q-YOLO: Efficient Inference for Real-time Object Detection Mingze Wang H. Sun Jun Shi Xuhui Liu Baochang Zhang Xianbin Cao ObjD 28 8 0 01 Jul 2023
MILD: Modeling the Instance Learning Dynamics for Learning with Noisy Labels Chuanyan Hu Shipeng Yan Zhitong Gao Xuming He NoLa 16 4 0 20 Jun 2023
Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review Shanliang Yao Runwei Guan Xiaoyu Huang Zhuoxiao Li Xiangyu Sha ... Eng Gee Lim H. Seo Ka Lok Man Xiaohui Zhu Yutao Yue 25 91 0 20 Apr 2023
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys Long Chen Yuchen Li Chao Huang Bai Li Yang Xing ... Chen Lv Jinjun Wang Dongpu Cao N. Zheng Feiyue Wang 33 294 0 30 Mar 2023
Semantic Ray: Learning a Generalizable Semantic Field with Cross-Reprojection Attention F. Liu Chubing Zhang Yu Zheng Yueqi Duan 19 27 0 23 Mar 2023
CAFS: Class Adaptive Framework for Semi-Supervised Semantic Segmentation Jingi Ju Hyeoncheol Noh Yooseung Wang Min-seok Seo Dong-Geol Choi 24 4 0 21 Mar 2023
MECPformer: Multi-estimations Complementary Patch with CNN-Transformers for Weakly Supervised Semantic Segmentation Chunmeng Liu Guang-pu Li Yao Shen Ruiqi Wang ViT 22 7 0 19 Mar 2023
Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges Yushan Han Hui Zhang Huifang Li Yi Jin Congyan Lang Yidong Li 16 100 0 16 Jan 2023
X-MAS: Extremely Large-Scale Multi-Modal Sensor Dataset for Outdoor Surveillance in Real Environments Dong-Ki Noh Chan-Yong Sung Teayoung Uhm Wooju Lee Hyungtae Lim ... Ho-Yong Shin MinJung Kim Hyoung-Rock Kim Seung-Ming Baek Hyun Myung 23 5 0 30 Dec 2022
DExT: Detector Explanation Toolkit Deepan Padmanabhan Paul G. Plöger Octavio Arriaga Matias Valdenegro-Toro 25 2 0 21 Dec 2022
Learning Robotic Navigation from Experience: Principles, Methods, and Recent Results Sergey Levine Dhruv Shah SSL 16 21 0 13 Dec 2022
Vision Transformer Computation and Resilience for Dynamic Inference Kavya Sreedhar Jason Clemons Rangharajan Venkatesan S. Keckler M. Horowitz 16 2 0 06 Dec 2022
Handling Image and Label Resolution Mismatch in Remote Sensing Scott Workman Armin Hadzic M. U. Rafique 30 5 0 28 Nov 2022
Harmonizing output imbalance for defect segmentation on extremely-imbalanced photovoltaic module cells images Jianye Yi Xiaopin Zhong Weixiang Liu Zongze Wu Yuanlong Deng Zhengguang Wu 19 0 0 10 Nov 2022
MMRNet: Improving Reliability for Multimodal Object Detection and Segmentation for Bin Picking via Multimodal Redundancy Yuhao Chen Hayden Gunraj E. Z. Zeng Robbie Meyer Maximilian Gilles Alexander Wong 31 1 0 19 Oct 2022
Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey Huiyun Cao Wenlong Zou Yinkun Wang Ting Song Mengjun Liu AAML 35 4 0 19 Oct 2022
Dual-Curriculum Teacher for Domain-Inconsistent Object Detection in Autonomous Driving L. Yu Yifan Zhang Lanqing Hong Fei Chen Zhenguo Li 27 3 0 17 Oct 2022
Learning Across Domains and Devices: Style-Driven Source-Free Domain Adaptation in Clustered Federated Learning Donald Shenaj Eros Fani Marco Toldo Debora Caldarola A. Tavera Umberto Michieli Marco Ciccone Pietro Zanuttigh Barbara Caputo FedML 21 39 0 05 Oct 2022
MLink: Linking Black-Box Models from Multiple Domains for Collaborative Inference Mu Yuan Lan Zhang Zimu Zheng Yi-Nan Zhang Xiang-Yang Li 9 2 0 28 Sep 2022
Uncertainty-aware Perception Models for Off-road Autonomous Unmanned Ground Vehicles Zhaoyuan Yang Y. Tan Shiraj Sen Johan Reimann John N. Karigiannis Mohammed A. Yousefhussien Nurali Virani 16 4 0 22 Sep 2022
Dispersed Pixel Perturbation-based Imperceptible Backdoor Trigger for Image Classifier Models Yulong Wang Minghui Zhao Shenghong Li Xinnan Yuan W. Ni 16 15 0 19 Aug 2022
CENet: Toward Concise and Efficient LiDAR Semantic Segmentation for Autonomous Driving Huimin Cheng Xian-Feng Han Guoqiang Xiao 3DPC 3DV 25 63 0 26 Jul 2022
YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors Chien-Yao Wang Alexey Bochkovskiy H. Liao ObjD 20 6,169 0 06 Jul 2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation Matt Deitke Eli VanderBilt Alvaro Herrasti Luca Weihs Jordi Salvador ... Winson Han Eric Kolve Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 25 233 0 14 Jun 2022
Multimodal Learning with Transformers: A Survey P. Xu Xiatian Zhu David A. Clifton ViT 41 522 0 13 Jun 2022
Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification Shuai Wang Chengyang Li Derrick Wing Kwan Ng Yonina C. Eldar H. Vincent Poor Qi Hao Chengzhong Xu FedML 13 58 0 03 Jun 2022
Distilling Inter-Class Distance for Semantic Segmentation Zheng Zhang Chunluan Zhou Zhigang Tu VLM 28 26 0 07 May 2022
Accurate Fruit Localisation for Robotic Harvesting using High Resolution LiDAR-Camera Fusion Hanwen Kang Xing Wang Chao Chen 11 37 0 01 May 2022
Understanding the Domain Gap in LiDAR Object Detection Networks Jasmine Richter F. Faion Di Feng Paul Benedikt Becker Piotr Sielecki Claudius Glaeser 3DPC 8 4 0 21 Apr 2022
End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agent Oskar Natan J. Miura 20 34 0 12 Apr 2022