Choosing Smartly: Adaptive Multimodal Fusion for Object Detection in Changing Environments

18 July 2017

Wolfram Burgard

Papers citing "Choosing Smartly: Adaptive Multimodal Fusion for Object Detection in Changing Environments"

42 / 42 papers shown

Title
Evaluation Framework for Sensor Configuration Impact on Deep Learning-Based Perception A Gamage V Donzella 34 0 0 07 Mar 2025
Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learning Moritz Reuss Jyothish Pari Pulkit Agrawal Rudolf Lioutikov DiffM MoE 76 5 0 17 Dec 2024
Cocoon: Robust Multi-Modal Perception with Uncertainty-Aware Sensor Fusion Minkyoung Cho Yulong Cao Jiachen Sun Qingzhao Zhang Marco Pavone Jeong Joon Park Heng Yang Z. Morley Mao 23 0 0 16 Oct 2024
The Ingredients for Robotic Diffusion Transformers Sudeep Dasari Oier Mees Sebastian Zhao M. K. Srirama Sergey Levine 48 20 0 14 Oct 2024
When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Dataset Yi Zhang Wang Zeng Sheng Jin Chao Qian Ping Luo Wentao Liu 34 4 0 14 Jul 2024
LDTrack: Dynamic People Tracking by Service Robots using Diffusion Models Angus Fung B. Benhabib G. Nejat 29 4 0 13 Feb 2024
Exploring Model Learning Heterogeneity for Boosting Ensemble Robustness Yanzhao Wu Ka-Ho Chow Wenqi Wei Ling Liu FedML AAML UQCV 21 8 0 03 Oct 2023
Uncertainty-Encoded Multi-Modal Fusion for Robust Object Detection in Autonomous Driving Yang Lou Qun Song Qian Xu Rui Tan Jianping Wang 6 1 0 30 Jul 2023
Informative Data Selection with Uncertainty for Multi-modal Object Detection X. Zhang Zhiwei Li Zhenhong Zou Xinchen Gao Yijin Xiong Dafeng Jin Jun Li Huaping Liu 18 5 0 23 Apr 2023
Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts, Datasets and Metrics F. M. Barbosa Fernando Santos Osório 16 6 0 08 Mar 2023
Detecting Humans in RGB-D Data with CNNs Kaiyang Zhou A. Paiement Majid Mirmehdi 3DH 14 22 0 17 Jul 2022
Defending Multimodal Fusion Models against Single-Source Adversaries Karren D. Yang Wan-Yi Lin M. Barman Filipe Condessa Zico Kolter AAML 13 30 0 25 Jun 2022
TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving Kashyap Chitta Aditya Prakash Bernhard Jaeger Zehao Yu Katrin Renz Andreas Geiger ViT 91 295 0 31 May 2022
Pay "Attention" to Adverse Weather: Weather-aware Attention-based Object Detection Saket S. Chaturvedi Lan Zhang Xiaoyong Yuan 11 17 0 22 Apr 2022
DBF: Dynamic Belief Fusion for Combining Multiple Object Detectors Hyungtae Lee H. Kwon FedML 16 18 0 06 Apr 2022
Training-Free Robust Multimodal Learning via Sample-Wise Jacobian Regularization Zhengqi Gao Sucheng Ren Zihui Xue Siting Li Hang Zhao 19 3 0 05 Apr 2022
An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions George Eskandar Robert A. Marsden Pavithran Pandiyan Mario Döbler Karim Guirguis B. Yang 22 7 0 07 Mar 2022
Robots Autonomously Detecting People: A Multimodal Deep Contrastive Learning Method Robust to Intraclass Variations Angus Fung B. Benhabib G. Nejat 19 12 0 01 Mar 2022
TinyM $^2$ Net: A Flexible System Algorithm Co-designed Multimodal Learning Framework for Tiny Devices Hasib-Al Rashid Pretom Roy Ovi Carl E. Busart A. Gangopadhyay T. Mohsenin 22 11 0 09 Feb 2022
CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks Oier Mees Lukás Hermann Erick Rosete-Beas Wolfram Burgard LM&Ro 14 239 0 06 Dec 2021
Predicting the Future from First Person (Egocentric) Vision: A Survey Ivan Rodin Antonino Furnari Dimitrios Mavroeidis G. Farinella EgoV 21 42 0 28 Jul 2021
Improving Multi-Modal Learning with Uni-Modal Teachers Chenzhuang Du Tingle Li Yichen Liu Zixin Wen Tianyu Hua Yue Wang Hang Zhao 18 45 0 21 Jun 2021
AI perspectives in Smart Cities and Communities to enable road vehicle automation and smart traffic control Cristofer Englund E. Aksoy F. Alonso-Fernandez Martin Cooney Sepideh Pashami B. Åstrand 12 40 0 07 Apr 2021
Autonomous Navigation with Mobile Robots using Deep Learning and the Robot Operating System A. Nguyen Quang-Dieu Tran 11 9 0 04 Dec 2020
Modality-Buffet for Real-Time Object Detection Nicolai Dorka Johannes Meyer Wolfram Burgard ObjD OffRL 22 3 0 17 Nov 2020
An Improved Attention for Visual Question Answering Tanzila Rahman Shih-Han Chou Leonid Sigal Giuseppe Carenini 13 42 0 04 Nov 2020
Multi-modal Experts Network for Autonomous Driving Shihong Fang A. Choromańska MoE 18 5 0 18 Sep 2020
Autonomous Navigation in Complex Environments with Deep Multimodal Fusion Network A. Nguyen Ngoc Son Nguyen K. Tran Erman Tjiputra Quang-Dieu Tran 7 39 0 31 Jul 2020
Rolling-Unrolling LSTMs for Action Anticipation from First-Person Video Antonino Furnari G. Farinella EgoV 10 139 0 04 May 2020
VMLoc: Variational Fusion For Learning-Based Multimodal Camera Localization Kaichen Zhou Changhao Chen Bing Wang Muhamad Risqi U. Saputra Niki Trigoni Andrew Markham 8 20 0 12 Mar 2020
Input Dropout for Spatially Aligned Modalities Sébastien de Blois Mathieu Garon Christian Gagné Jean-François Lalonde 13 7 0 07 Feb 2020
UNO: Uncertainty-aware Noisy-Or Multimodal Fusion for Unanticipated Input Degradation Junjiao Tian W. Cheung Nathan Glaser Yen-Cheng Liu Z. Kira 11 26 0 06 Nov 2019
On Single Source Robustness in Deep Fusion Models Taewan Kim Joydeep Ghosh AAML 6 22 0 11 Jun 2019
What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality Attention Antonino Furnari G. Farinella EgoV 22 171 0 22 May 2019
Learning the Depths of Moving People by Watching Frozen People Zhengqi Li Tali Dekel Forrester Cole Richard Tucker Noah Snavely Ce Liu William T. Freeman MDE 3DH 21 242 0 25 Apr 2019
Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather Mario Bijelic Tobias Gruber Fahim Mannan Florian Kraus W. Ritter Klaus C. J. Dietmayer Felix Heide 6 37 0 24 Feb 2019
Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges Di Feng Christian Haase-Schuetz Lars Rosenbaum Heinz Hertlein Claudius Gläser Fabian Duffhauss W. Wiesbeck Klaus C. J. Dietmayer 3DPC 27 985 0 21 Feb 2019
Robust Deep Multi-Modal Sensor Fusion using Fusion Weight Regularization and Target Learning Myung Seok Shim Chenye Zhao Y. Li Xuchong Zhang Wenrui Zhang Peng Li OOD AAML 17 0 0 29 Jan 2019
Modular Sensor Fusion for Semantic Segmentation Hermann Blum Abel Gawel Roland Siegwart César Cadena 28 14 0 30 Jul 2018
Optimal Sensor Data Fusion Architecture for Object Detection in Adverse Weather Conditions Andreas Pfeuffer Klaus C. J. Dietmayer 12 46 0 06 Jul 2018
3D Human Pose Estimation in RGBD Images for Robotic Task Learning Christiane Zimmermann Tim Welschehold C. Dornhege Wolfram Burgard Thomas Brox 3DH 11 149 0 07 Mar 2018
Deep Detection of People and their Mobility Aids for a Hospital Robot Andres Vasquez Marina Kollmitz Andreas Eitel Wolfram Burgard 13 35 0 02 Aug 2017