Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction

18 February 2021

Daniel Gehrig

Michelle Rüegg

Mathias Gehrig

Javier Hidalgo-Carrió

Davide Scaramuzza

ArXiv PDF HTML

Papers citing "Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction"

50 / 63 papers shown

Title
A Survey of 3D Reconstruction with Event Cameras: From Event-based Geometry to Neural 3D Rendering Chuanzhi Xu Haoxian Zhou Langyi Chen Haodong Chen Ying Zhou Vera Chung Qiang Qu 3DV 35 0 0 13 May 2025
RGB-Event Fusion with Self-Attention for Collision Prediction Pietro Bonazzi Christian Vogt Michael Jost Haotong Qin Lyes Khacef Federico Paredes-Valles Michele Magno 32 0 0 07 May 2025
DELTA: Dense Depth from Events and LiDAR using Transformer's Attention Vincent Brebion Julien Moreau Franck Davoine 38 0 0 05 May 2025
FUSE: Label-Free Image-Event Joint Monocular Depth Estimation via Frequency-Decoupled Alignment and Degradation-Robust Fusion Pihai Sun Junjun Jiang Yuanqi Yao Youyu Chen Wenbo Zhao Kui Jiang Xianming Liu MDE 41 0 0 25 Mar 2025
DEIO: Deep Event Inertial Odometry Weipeng Guan Fuling Lin Peiyu Chen P. Lu 51 2 0 06 Nov 2024
Enhancing SNN-based Spatio-Temporal Learning: A Benchmark Dataset and Cross-Modality Attention Model Shibo Zhou Bo Yang Mengwen Yuan Runhao Jiang Rui Yan Gang Pan Huajin Tang 32 3 0 21 Oct 2024
Steering Prediction via a Multi-Sensor System for Autonomous Racing Zhuyun Zhou Zongwei Wu Florian Bolli Rémi Boutteau Fan Yang Radu Timofte D. Ginhac T. Delbruck 23 0 0 28 Sep 2024
EventHDR: from Event to High-Speed HDR Videos and Beyond Yunhao Zou Ying Fu Tsuyoshi Takatani Yinqiang Zheng 39 4 0 25 Sep 2024
EvLight++: Low-Light Video Enhancement with an Event Camera: A Large-Scale Real-World Dataset, Novel Method, and More Kanghao Chen Guoqiang Liang Hangyu Li Yunfan Lu Lin Wang 3DV VGen 38 2 0 29 Aug 2024
CoSEC: A Coaxial Stereo Event Camera Dataset for Autonomous Driving Shihan Peng Hanyu Zhou Hao Dong Zhiwei Shi Haoyue Liu Yuxing Duan Yi Chang Luxin Yan 40 3 0 16 Aug 2024
Embracing Events and Frames with Hierarchical Feature Refinement Network for Object Detection Hu Cao Zehua Zhang Yan Xia Xinyi Li Jiahao Xia Guang Chen Alois C. Knoll ObjD 47 7 0 17 Jul 2024
Finding Meaning in Points: Weakly Supervised Semantic Segmentation for Event Cameras Hoonhee Cho Sung-Hoon Yoon H. Kweon Kuk-Jin Yoon 28 1 0 15 Jul 2024
Neuromorphic Perception and Navigation for Mobile Robots: A Review Alvaro Novo Francisco Lobon Hector Garcia de Marina Samuel Romero Francisco Barranco 52 8 0 09 Jul 2024
Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Survey Uchitha Rajapaksha Ferdous Sohel Hamid Laga D. Diepeveen Mohammed Bennamoun MDE 33 11 0 28 Jun 2024
SGE: Structured Light System Based on Gray Code with an Event Camera Xingyu Lu Lei Sun Diyang Gu Zhijie Xu 3DV 35 1 0 12 Mar 2024
PCDepth: Pattern-based Complementary Learning for Monocular Depth Estimation by Best of Both Worlds Haotian Liu Sanqing Qu Fan Lu Zongtao Bu Florian Roehrbein Alois C. Knoll Guang Chen MDE 36 2 0 29 Feb 2024
EvPlug: Learn a Plug-and-Play Module for Event and Image Fusion Jianping Jiang Xinyu Zhou Peiqi Duan Boxin Shi 34 0 0 28 Dec 2023
EVI-SAM: Robust, Real-time, Tightly-coupled Event-Visual-Inertial State Estimation and 3D Dense Mapping Weipeng Guan Peiyu Chen Huibin Zhao Yu Wang P. Lu MDE 41 9 0 19 Dec 2023
Event Camera Data Dense Pre-training Yan Yang Liyuan Pan Liu Liu 27 4 0 20 Nov 2023
In the Blink of an Eye: Event-based Emotion Recognition Haiwei Zhang Jiqing Zhang B. Dong Pieter Peers Wenwei Wu Xiaopeng Wei Felix Heide Xin Yang CVBM 17 11 0 06 Oct 2023
SRFNet: Monocular Depth Estimation with Fine-grained Structure via Spatial Reliability-oriented Fusion of Frames and Events Tianbo Pan Zidong Cao Lin Wang MDE 20 5 0 22 Sep 2023
SODFormer: Streaming Object Detection with Transformer Using Events and Frames Dianze Li Jianing Li Yonghong Tian ViT 24 27 0 08 Aug 2023
CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentation Ruihao Xia Chaoqiang Zhao Meng Zheng Ziyan Wu Qiyu Sun Yang Tang 36 29 0 29 Jul 2023
Hierarchical Neural Memory Network for Low Latency Event Processing Ryuhei Hamaguchi Yasutaka Furukawa Masaki Onishi Ken Sakurada 38 26 0 29 May 2023
RGB-D And Thermal Sensor Fusion: A Systematic Literature Review M. Brenner N. Reyes Teo Susnjak A. Barczak 66 28 0 19 May 2023
EV-MGRFlowNet: Motion-Guided Recurrent Network for Unsupervised Event-based Optical Flow with Hybrid Motion-Compensation Loss Zhuang Hao Xinjie Huang Kuanxu Hou Delei Kong Chenming Hu Zheng Fang 16 10 0 13 May 2023
Fast Event-based Double Integral for Real-time Robotics Shijie Lin Yingqiang Zhang Dongyue Huang Bin Zhou Xiaowei Luo Jia Pan 21 6 0 10 May 2023
Event-based Simultaneous Localization and Mapping: A Comprehensive Survey Kunping Huang Sen Zhang Jing Zhang Dacheng Tao 32 27 0 19 Apr 2023
Neuromorphic Event-based Facial Expression Recognition Lorenzo Berlincioni Luca Cultrera C. Albisani Lisa Cresti Andrea Leonardo Sara Picchioni Federico Becattini A. Bimbo CVBM 35 11 0 13 Apr 2023
Bimodal SegNet: Instance Segmentation Fusing Events and RGB Frames for Robotic Grasping Sanket Kachole Xiaoqian Huang F. B. Naeini Rajkumar Muthusamy Dimitrios Makris Yahya Zweiri 37 5 0 20 Mar 2023
EvConv: Fast CNN Inference on Event Camera Inputs For High-Speed Robot Perception Sankeerth Durvasula Yushi Guan Nandita Vijaykumar 26 0 0 08 Mar 2023
Delivering Arbitrary-Modal Semantic Segmentation Jiaming Zhang R. Liu Haowen Shi Kailun Yang Simon Reiß Kunyu Peng Haodong Fu Kaiwei Wang Rainer Stiefelhagen VLM 39 85 0 02 Mar 2023
Event Fusion Photometric Stereo Network Won-Wha Ryoo Giljoo Nam Jae-Sang Hyun Sangpil Kim 25 2 0 01 Mar 2023
Learning to Estimate Two Dense Depths from LiDAR and Event Data Vincent Brebion Julien Moreau Franck Davoine 3DPC 19 7 0 28 Feb 2023
Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarks Xueye Zheng Yexin Liu Yunfan Lu Tongyan Hua Tianbo Pan Weiming Zhang Dacheng Tao Lin Wang AI4TS BDL 3DV 39 80 0 17 Feb 2023
EVEN: An Event-Based Framework for Monocular Depth Estimation at Adverse Night Conditions Peilun Shi Jiachuan Peng Jianing Qiu Xinwei Ju F. P. Lo Benny P. L. Lo MDE 26 15 0 08 Feb 2023
Neuromorphic High-Frequency 3D Dancing Pose Estimation in Dynamic Environment Zhongyang Zhang Kaidong Chai Haowen Yu Ramzi M Majaj Francesca Walsh Edward Wang U. Mahbub H. Siegelmann Donghyun Kim Tauhidur Rahman 3DH 24 19 0 17 Jan 2023
Event-based Monocular Dense Depth Estimation with Recurrent Transformers Xu Liu Jianing Li Xiaopeng Fan Yonghong Tian ViT MDE 59 16 0 06 Dec 2022
FE-Fusion-VPR: Attention-based Multi-Scale Network Architecture for Visual Place Recognition by Fusing Frames and Events Kuanxu Hou Delei Kong Junjie Jiang Zhuang Hao Xinjie Huang Zheng Fang 33 18 0 22 Nov 2022
Event Transformer+. A multi-purpose solution for efficient event data processing Alberto Sabater Luis Montesano Ana C. Murillo ViT 31 8 0 22 Nov 2022
Self-Supervised Intensity-Event Stereo Matching Jinjin Gu Jinan Zhou Ringo S. W. Chu Yan Chen Jiawei Zhang Xuanye Cheng Song Zhang Jimmy S. J. Ren 26 6 0 01 Nov 2022
Robust and Efficient Depth-based Obstacle Avoidance for Autonomous Miniaturized UAVs H. Müller Vlad Niculescu T. Polonelli Michele Magno Luca Benini 27 29 0 26 Aug 2022
DeepFusion: Real-Time Dense 3D Reconstruction for Monocular SLAM using Single-View Depth and Gradient Predictions Tristan Laidlow J. Czarnowski Stefan Leutenegger 3DGS MDE 39 55 0 25 Jul 2022
IBISCape: A Simulated Benchmark for multi-modal SLAM Systems Evaluation in Large-scale Dynamic Environments Abanob Soliman Fabien Bonardi Désiré Sidibé S. Bouchafa 25 10 0 27 Jun 2022
Emergent Visual Sensors for Autonomous Vehicles You Li Julien Moreau J. Ibañez-Guzmán 40 28 0 19 May 2022
EVIMO2: An Event Camera Dataset for Motion Segmentation, Optical Flow, Structure from Motion, and Visual Inertial Odometry in Indoor Scenes with Monocular or Stereo Algorithms Levi Burner A. Mitrokhin Cornelia Fermuller Yiannis Aloimonos VGen MDE 19 33 0 06 May 2022
SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpoints Paolo Testolina F. Barbato Umberto Michieli M. Giordani Pietro Zanuttigh Michele Zorzi 22 34 0 20 Apr 2022
Event-aided Direct Sparse Odometry Javier Hidalgo-Carrió Guillermo Gallego Davide Scaramuzza 22 92 0 15 Apr 2022
Event Transformer. A sparse-aware solution for efficient event data processing Alberto Sabater Luis Montesano Ana C. Murillo 21 51 0 07 Apr 2022
Event-Based Dense Reconstruction Pipeline Kun Xiao Guohui Wang Yi Chen Jinghong Nan Yongfeng Xie 3DV 16 12 0 23 Mar 2022