Multimodal Deep Learning for Robust RGB-D Object Recognition

24 July 2015

Andreas Eitel

Jost Tobias Springenberg

Luciano Spinello

Martin Riedmiller

Wolfram Burgard

ArXiv PDF HTML

Papers citing "Multimodal Deep Learning for Robust RGB-D Object Recognition"

50 / 76 papers shown

Title
MLMT-CNN for Object Detection and Segmentation in Multi-layer and Multi-spectral Images Majedaldein Almahasneh A. Paiement Xianghua Xie Jean Aboudarham 33 4 0 19 Jul 2024
DLP: towards active defense against backdoor attacks with decoupled learning process Zonghao Ying Bin Wu AAML 48 6 0 18 Jun 2024
Generation of Synthetic Images for Pedestrian Detection Using a Sequence of GANs Viktor Seib Malte Roosen Ida Germann Stefan Wirtz Dietrich Paulus 31 0 0 14 Jan 2024
Probabilistic Multimodal Depth Estimation Based on Camera-LiDAR Sensor Fusion Johan S. Obando-Ceron Victor A. Romero-Cano S. Monteiro MDE 43 3 0 20 Jul 2023
Structure Flow-Guided Network for Real Depth Super-Resolution Jiayi Yuan Haobo Jiang Xiang Li J. Qian Jun Yu Li Jian Yang SupR 33 10 0 31 Jan 2023
Leveraging the Third Dimension in Contrastive Learning Sumukh K Aithal Anirudh Goyal Alex Lamb Yoshua Bengio Michael C. Mozer MDE 37 0 0 27 Jan 2023
SHLE: Devices Tracking and Depth Filtering for Stereo-based Height Limit Estimation Zhaoxin Fan Kaixing Yang Hao Fei Zhenbo Song Hongyan Liu Jun He 23 0 0 22 Dec 2022
ObjectMatch: Robust Registration using Canonical Object Correspondences Can Gümeli Angela Dai Matthias Nießner 3DPC 35 12 0 05 Dec 2022
RGB-D-based Stair Detection using Deep Learning for Autonomous Stair Climbing Chen Wang Z. Pei Shuang Qiu Zhiyong Tang 31 1 0 02 Dec 2022
Early or Late Fusion Matters: Efficient RGB-D Fusion in Vision Transformers for 3D Object Recognition Georgios Tziafas Hamidreza Kasaei ViT 47 10 0 03 Oct 2022
RGB-X Classification for Electronics Sorting Abhimanyu Fnu T. Zodage Umesh Thillaivasan Xinyue Lai Rahul Chakwate ... E. Oti Ming Zhao Ralph Boirum Howie Choset Matthew Travers 27 1 0 08 Sep 2022
Large-Scale Traffic Congestion Prediction based on Multimodal Fusion and Representation Mapping Bo Zhou Jiahui Liu Songyi Cui Yaping Zhao 26 5 0 23 Aug 2022
GE-Grasp: Efficient Target-Oriented Grasping in Dense Clutter Z. Liu Ziwei Wang Sichao Huang Jie Zhou Jiwen Lu 48 22 0 25 Jul 2022
Accurate Ground-Truth Depth Image Generation via Overfit Training of Point Cloud Registration using Local Frame Sets Ji-Woo Kim Minchang Kim Y. Shin Minyoung Chung 3DPC 29 1 0 14 Jul 2022
Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video Minsu Kim Joanna Hong Se Jin Park Yong Man Ro CVBM 25 40 0 04 Apr 2022
Exploring Body Texture from mmW Images for Person Recognition E. González-Sosa J. Fierrez R. Vera-Rodríguez F. Alonso-Fernandez Vishal M. Patel CVBM 13 3 0 27 Mar 2022
Improving Lidar-Based Semantic Segmentation of Top-View Grid Maps by Learning Features in Complementary Representations Frank Bieder Maximilian Link Simon Romanski Haohao Hu Christoph Stiller 3DPC 27 2 0 02 Mar 2022
Bridging the Gap: Using Deep Acoustic Representations to Learn Grounded Language from Percepts and Raw Speech Gaoussou Youssouf Kebe Luke E. Richards Edward Raff Francis Ferraro Cynthia Matuszek SSL 22 5 0 27 Dec 2021
Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection Yifan Zhuang Ziyuan Pu Jia Hu Yinhai Wang 33 24 0 09 Dec 2021
DeepStroke: An Efficient Stroke Screening Framework for Emergency Rooms with Multimodal Adversarial Deep Learning Tongan Cai Haomiao Ni Ming-Chieh Yu Xiaolei Huang K. Wong John Volpi Jianmin Wang Stephen T. C. Wong 34 14 0 24 Sep 2021
ACFNet: Adaptively-Cooperative Fusion Network for RGB-D Salient Object Detection Jinchao Zhu 26 0 0 10 Sep 2021
Specificity-preserving RGB-D Saliency Detection Tao Zhou Deng-Ping Fan Geng Chen Yi Zhou Ling Shao 47 161 0 18 Aug 2021
Deep Continuous Fusion for Multi-Sensor 3D Object Detection Ming Liang Binh Yang Shenlong Wang R. Urtasun 3DPC 208 841 0 20 Dec 2020
Multi-Modal Depth Estimation Using Convolutional Neural Networks Sadique Adnan Siddiqui A. Vierling Karsten Berns MDE 24 6 0 17 Dec 2020
FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection A. Inceoğlu E. Aksoy Abdullah Cihan Ak Sanem Sariel 24 22 0 11 Nov 2020
A Brief Review of Domain Adaptation Abolfazl Farahani Sahar Voghoei Khaled Rasheed H. Arabnia OOD 36 527 0 07 Oct 2020
DeepLiDARFlow: A Deep Learning Architecture For Scene Flow Estimation Using Monocular Camera and Sparse LiDAR Rishav Rishav Ramy Battrawy René Schuster Oliver Wasenmüller D. Stricker 3DPC 27 32 0 18 Aug 2020
AUTSL: A Large Scale Multi-modal Turkish Sign Language Dataset and Baseline Methods Ozge Mercanoglu Sincan H. Keles SLR 30 168 0 03 Aug 2020
YCB-M: A Multi-Camera RGB-D Dataset for Object Recognition and 6DoF Pose Estimation Till Grenzdörffer Martin Günther J. Hertzberg 16 18 0 24 Apr 2020
Unsupervised Domain Adaptation through Inter-modal Rotation for RGB-D Object Recognition Mohammad Reza Loghmani Yu Sun Eric Tzeng Trevor Darrell Alexei A. Efros Markus Vincze 29 33 0 21 Apr 2020
When Deep Learning Meets Data Alignment: A Review on Deep Registration Networks (DRNs) Victor Villena-Martinez Sergiu Oprea Marcelo Saval-Calvo J. Azorín-López Andrés Fuster-Guilló Robert B. Fisher 42 32 0 06 Mar 2020
Large-scale Kernel Methods and Applications to Lifelong Robot Learning Raffaello Camoriano 42 1 0 11 Dec 2019
What You See is What You Get: Exploiting Visibility for 3D Object Detection Peiyun Hu Jason Ziglar David Held Deva Ramanan 3DPC 24 116 0 10 Dec 2019
Multimodal deep networks for text and image-based document classification Nicolas Audebert Catherine Herold K. Slimani Cédric Vidal 19 97 0 15 Jul 2019
A review on deep learning techniques for 3D sensed data classification David J. Griffiths Jan Boehm 3DPC 3DV 32 165 0 09 Jul 2019
Theory of the Frequency Principle for General Deep Neural Networks Yaoyu Zhang Zheng Ma Zhi-Qin John Xu Tao Luo 26 78 0 21 Jun 2019
SA-Net: Deep Neural Network for Robot Trajectory Recognition from RGB-D Streams Nihal Soans Ehsan Asali Yi Hong Prashant Doshi 33 2 0 10 May 2019
Improved visible to IR image transformation using synthetic data augmentation with cycle-consistent adversarial networks Kyongsik Yun Kevin Yu Joseph Osborne S. Eldin Luan Nguyen Alexander Huyen Thomas Lu GAN 19 19 0 25 Apr 2019
Deep Multi-View Learning using Neuron-Wise Correlation-Maximizing Regularizers Kui Jia Jiehong Lin Mingkui Tan Dacheng Tao 3DV 32 32 0 25 Apr 2019
EmbraceNet: A robust deep learning architecture for multimodal classification Jun-Ho Choi Jong-Seok Lee 29 123 0 19 Apr 2019
Mix and match networks: cross-modal alignment for zero-pair image-to-image translation Yaxing Wang Luis Herranz Joost van de Weijer 21 4 0 08 Mar 2019
Learning to see across Domains and Modalities Fabio Maria Carlucci 29 0 0 13 Feb 2019
Multimodal Densenet Faisal Mahmood Ziyun Yang Thomas Ashley Nicholas J. Durr 21 11 0 18 Nov 2018
Learning with privileged information via adversarial discriminative modality distillation Nuno C. Garcia Pietro Morerio Vittorio Murino 27 67 0 19 Oct 2018
LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networks Luca Caltagirone M. Bellone Lennart Svensson M. Wahde 24 302 0 21 Sep 2018
Self-Supervised Model Adaptation for Multimodal Semantic Segmentation Abhinav Valada Rohit Mohan Wolfram Burgard SSL 25 242 0 11 Aug 2018
Robust Deep Multi-modal Learning Based on Gated Information Fusion Network Jaekyum Kim Junho Koh Yecheol Kim Jaehyung Choi Youngbae Hwang Jun-Won Choi 35 64 0 17 Jul 2018
Multimodal feature fusion for CNN-based gait recognition: an empirical comparison F. M. Castro M. Marín-Jiménez Nicolás Guil Mata N. P. D. L. Blanca CVBM 29 60 0 19 Jun 2018
Modality Distillation with Multiple Stream Networks for Action Recognition Nuno C. Garcia Pietro Morerio Vittorio Murino 30 181 0 19 Jun 2018
HGR-Net: A Fusion Network for Hand Gesture Segmentation and Recognition Amirhossein Dadashzadeh Alireza Tavakoli Targhi Maryam Tahmasbi Majid Mirmehdi SLR 30 71 0 14 Jun 2018