Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation

22 March 2024

Kaixuan Wang

Chunhua Shen

Shaojie Shen

3DGS

ArXiv PDF HTML

Papers citing "Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation"

38 / 88 papers shown

Title
UniGaussian: Driving Scene Reconstruction from Multiple Camera Models via Unified Gaussian Representations Y. Ren Guile Wu Runhao Li Zheyuan Yang Yibo Liu Xingxin Chen Tongtong Cao Bingbing Liu 3DGS 66 3 0 22 Nov 2024
SCube: Instant Large-Scale Scene Reconstruction using VoxSplats Xuanchi Ren Y. Lu Hanxue Liang Zhangjie Wu Huan Ling Mike Chen Sanja Fidler Francis Williams Jiahui Huang 3DGS 32 8 0 26 Oct 2024
MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervision Ruicheng Wang Sicheng Xu Cassie Dai Jianfeng Xiang Yu Deng Xin Tong Jiaolong Yang TPM 3DH MDE 43 29 0 24 Oct 2024
VistaDream: Sampling multiview consistent images for single-view scene reconstruction Haiping Wang Yuan-Bin Liu Ziwei Liu Wenping Wang Z. Dong Bisheng Yang 41 11 0 22 Oct 2024
Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free Ziyue Li Tianyi Zhou MoE 53 5 0 14 Oct 2024
FusionSense: Bridging Common Sense, Vision, and Touch for Robust Sparse-View Reconstruction Irving Fang Kairui Shi X. He Siqi Tan Yifan Wang Hanwen Zhao Hung-Jui Huang Wenzhen Yuan Chen Feng Jing Zhang 3DGS 31 1 0 10 Oct 2024
Next Best Sense: Guiding Vision and Touch with FisherRF for 3D Gaussian Splatting Matthew Strong Boshu Lei Aiden Swann Wen Jiang Kostas Daniilidis Monroe Kennedy III 3DGS 38 3 0 07 Oct 2024
HazyDet: Open-source Benchmark for Drone-view Object Detection with Depth-cues in Hazy Scenes Changfeng Feng Zhenyuan Chen Renke Kou Guangwei Gao Chunping Wang Xiang Li Xiangbo Shu Yimian Dai Qiang Fu Jian Yang 20 4 0 30 Sep 2024
KineDepth: Utilizing Robot Kinematics for Online Metric Depth Estimation Soofiyan Atar Yuheng Zhi Florian Richter Michael C. Yip MDE 24 0 0 29 Sep 2024
Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Prediction Jing He Haodong Li Wei Yin Yixun Liang Leheng Li Kaiqiang Zhou Hongbo Zhang Bingbing Liu Ying-Cong Chen DiffM VLM 34 38 0 26 Sep 2024
Combining Absolute and Semi-Generalized Relative Poses for Visual Localization Vojtech Panek Torsten Sattler Zuzana Kukelova 24 0 0 21 Sep 2024
Reactive Collision Avoidance for Safe Agile Navigation Alessandro Saviolo Niko Picello Rishabh Verma Giuseppe Loianno Giuseppe Loianno 28 0 0 18 Sep 2024
Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think Gonzalo Martin Garcia Karim Abou Zeid Christian Schmidt Daan de Geus Alexander Hermans Bastian Leibe 33 23 0 17 Sep 2024
Introducing a Class-Aware Metric for Monocular Depth Estimation: An Automotive Perspective Tim Bader Leon Eisemann Adrian Pogorzelski Namrata Jangid Attila B. Kis 30 0 0 06 Sep 2024
UDGS-SLAM : UniDepth Assisted Gaussian Splatting for Monocular SLAM Mostafa Mansour Ahmed Abdelsalam Ari Happonen J. Porras Esa Rahtu 3DGS MDE 61 0 0 31 Aug 2024
Map-Free Visual Relocalization Enhanced by Instance Knowledge and Depth Knowledge Mingyu Xiao Runze Chen Haiyong Luo Fang Zhao Juan Wang Xuepeng Ma 30 0 0 23 Aug 2024
CoSEC: A Coaxial Stereo Event Camera Dataset for Autonomous Driving Shihan Peng Hanyu Zhou Hao Dong Zhiwei Shi Haoyue Liu Yuxing Duan Yi Chang Luxin Yan 24 3 0 16 Aug 2024
Towards Robust Monocular Depth Estimation in Non-Lambertian Surfaces Junrui Zhang Jiaqi Li Yachuan Huang Yiran Wang Jinghong Zheng Liao Shen Z. Cao MDE 18 3 0 12 Aug 2024
BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimation Xiang Zhang B. Ke Hayko Riemenschneider Nando Metzger Anton Obukhov Markus H. Gross Konrad Schindler Christopher Schroers DiffM MDE 31 7 0 25 Jul 2024
GeoBench: Benchmarking and Analyzing Monocular Geometry Estimation Models Yongtao Ge Guangkai Xu Zhiyue Zhao Libo Sun Zheng Huang Yanlong Sun Hao Chen Chunhua Shen MDE 24 3 0 18 Jun 2024
Depth Anything V2 Lihe Yang Bingyi Kang Zilong Huang Zhen Zhao Xiaogang Xu Jiashi Feng Hengshuang Zhao DiffM VLM MDE 55 314 0 13 Jun 2024
SpatialRGPT: Grounded Spatial Reasoning in Vision Language Model An-Chieh Cheng Hongxu Yin Yang Fu Qiushan Guo Ruihan Yang Jan Kautz Xiaolong Wang Sifei Liu LRM 43 43 0 03 Jun 2024
Learning Temporally Consistent Video Depth from Video Diffusion Priors Jiahao Shao Yuanbo Yang Hongyu Zhou Youmin Zhang Yujun Shen Matteo Poggi Yiyi Liao VGen DiffM MDE 16 37 0 03 Jun 2024
MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds Jiahui Lei Yijia Weng Adam W. Harley Leonidas J. Guibas Kostas Daniilidis 3DGS 40 23 0 27 May 2024
SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modeling Yijun Yuan M. Bleier Andreas Nüchter 36 0 0 13 May 2024
MonoPatchNeRF: Improving Neural Radiance Fields with Patch-based Monocular Guidance Yuqun Wu Jae Yong Lee Chuhang Zou Shenlong Wang Derek Hoiem 24 0 0 12 Apr 2024
Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single View Andreea Dogaru M. Ozer Bernhard Egger 3DGS 41 4 0 04 Apr 2024
DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshing Matias Turkulainen Xuqian Ren Iaroslav Melekhov Otto Seiskari Esa Rahtu Juho Kannala 3DGS 40 55 0 26 Mar 2024
TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos Yufu Wang ZiYun Wang Lingjie Liu Kostas Daniilidis 29 25 0 26 Mar 2024
Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Images Xiaoxiao Long Yuhang Zheng Yupeng Zheng Beiwen Tian Cheng Lin Lingjie Liu Hao Zhao Guyue Zhou Wenping Wang 47 11 0 08 Feb 2024
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data Lihe Yang Bingyi Kang Zilong Huang Xiaogang Xu Jiashi Feng Hengshuang Zhao VLM 133 681 0 19 Jan 2024
Robust Geometry-Preserving Depth Estimation Using Differentiable Rendering Chi Zhang Wei Yin Gang Yu Zhibin Wang Tao Chen Bin-Bin Fu Joey Tianyi Zhou Chunhua Shen MDE 106 5 0 18 Sep 2023
Dense Depth Priors for Neural Radiance Fields from Sparse Input Views Barbara Roessle Jonathan T. Barron B. Mildenhall Pratul P. Srinivasan Matthias Nießner VGen 114 352 0 06 Dec 2021
PENet: Towards Precise and Efficient Image Guided Depth Completion Mu Hu Shuling Wang Bin Li Shiyu Ning Li Fan Xiaojin Gong MDE 93 270 0 01 Mar 2021
SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detection Rui Fan H. Wang Peide Cai Ming-Yu Liu 47 147 0 26 Aug 2020
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 261 10,106 0 16 Nov 2016
ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras Raul Mur-Artal Juan D. Tardós 191 4,837 0 20 Oct 2016
Designing Deep Networks for Surface Normal Estimation X. Wang David Fouhey Abhinav Gupta 3DV SSL 149 352 0 18 Nov 2014