Panoptic Lifting for 3D Scene Understanding with Neural Fields

19 December 2022

Lorenzo Porzi

Matthias Nießner

Peter Kontschieder

Papers citing "Panoptic Lifting for 3D Scene Understanding with Neural Fields"

50 / 113 papers shown

Title
Benchmarking Neural Radiance Fields for Autonomous Robots: An Overview Yuhang Ming Xingrui Yang Weihan Wang Zheng Chen Jinglun Feng Yifan Xing Guofeng Zhang 27 9 0 09 May 2024
InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior Zhiheng Liu Ouyang Hao Qiuyu Wang Ka Leong Cheng Jie Xiao Kai Zhu Nan Xue Yu Liu Yujun Shen Yang Cao DiffM 3DGS 41 20 0 17 Apr 2024
Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Prediction Jingyi Pan Zipeng Wang Lin Wang 27 20 0 06 Apr 2024
OpenNeRF: Open Set 3D Neural Scene Segmentation with Pixel-Wise Features and Rendered Novel Views Francis Engelmann Fabian Manhardt Michael Niemeyer Keisuke Tateno Marc Pollefeys Federico Tombari VLM 65 32 1 04 Apr 2024
NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields Muhammad Zubair Irshad Sergey Zakahrov Vitor Campagnolo Guizilini Adrien Gaidon Z. Kira Rares Ambrus ViT 32 12 0 01 Apr 2024
Efficient 3D Instance Mapping and Localization with Neural Fields George Tang Krishna Murthy Jatavallabhula Antonio Torralba ISeg 32 5 0 28 Mar 2024
Total-Decom: Decomposed 3D Scene Reconstruction with Minimal Interaction Xiaoyang Lyu Chirui Chang Peng Dai Yang-tian Sun Xiaojuan Qi 3DGS 33 3 0 28 Mar 2024
EgoLifter: Open-world 3D Segmentation for Egocentric Perception Qiao Gu Zhaoyang Lv Duncan Frost Simon Green Julian Straub Chris Sweeney 3DGS EgoV 21 21 0 26 Mar 2024
NeRF-HuGS: Improved Neural Radiance Fields in Non-static Scenes Using Heuristics-Guided Segmentation Jiahao Chen Yipeng Qin Lingjie Liu Jiangbo Lu Guanbin Li 33 11 0 26 Mar 2024
Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting Jun Guo Xiaojian Ma Yue Fan Huaping Liu Qing Li 3DGS 36 26 0 22 Mar 2024
ClusteringSDF: Self-Organized Neural Implicit Surfaces for 3D Decomposition Tianhao Wu Chuanxia Zheng Tat-Jen Cham Qianyi Wu 3DV 27 1 0 21 Mar 2024
Aerial Lifting: Neural Urban Semantic and Building Instance Lifting from Aerial Imagery Yuqi Zhang Guanying Chen Jiaxing Chen Shuguang Cui 31 1 0 18 Mar 2024
STAIR: Semantic-Targeted Active Implicit Reconstruction Liren Jin Haofei Kuang Yue Pan C. Stachniss Marija Popović 3DV 35 1 0 17 Mar 2024
N2F2: Hierarchical Scene Understanding with Nested Neural Feature Fields Yash Bhalgat Iro Laina João F. Henriques Andrew Zisserman Andrea Vedaldi 41 14 0 16 Mar 2024
RoDUS: Robust Decomposition of Static and Dynamic Elements in Urban Scenes Thang-Anh-Quan Nguyen Luis Roldão Nathan Piasco Moussâb Bennehar D. Tsishkou 44 5 0 14 Mar 2024
Closing the Visual Sim-to-Real Gap with Object-Composable NeRFs Nikhil Mishra Maximilian Sieb Pieter Abbeel Xi Chen 3DPC 33 1 0 07 Mar 2024
GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understanding Zi-Ting Chou Sheng-Yu Huang I-Jieh Liu Yu-Chiang Frank Wang 24 9 0 06 Mar 2024
AlignMiF: Geometry-Aligned Multimodal Implicit Field for LiDAR-Camera Joint Synthesis Tao Tang Guangrun Wang Yixing Lao Peng Chen Jie Liu Liang Lin Kaicheng Yu Xiaodan Liang 36 8 0 27 Feb 2024
Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review Thang-Anh-Quan Nguyen Amine Bourki Mátyás Macudzinski Anthony Brunel M. Bennamoun 25 10 0 17 Feb 2024
HaLo-NeRF: Learning Geometry-Guided Semantics for Exploring Unconstrained Photo Collections Chen Dudai Morris Alper Hana Bezalel Rana Hanocka Itai Lang Hadar Averbuch-Elor 23 2 0 14 Feb 2024
Geometry Transfer for Stylizing Radiance Fields Hyunyoung Jung Seonghyeon Nam N. Sarafianos Sungjoo Yoo Alexander Sorkine-Hornung Rakesh Ranjan 37 10 0 01 Feb 2024
GARField: Group Anything with Radiance Fields C. Kim Mingxuan Wu J. Kerr Ken Goldberg Matthew Tancik Angjoo Kanazawa 38 47 0 17 Jan 2024
ODIN: A Single Model for 2D and 3D Segmentation Ayush Jain Pushkal Katara N. Gkanatsios Adam W. Harley Gabriel H. Sarch Kriti Aggarwal Vishrav Chaudhary Katerina Fragkiadaki 3DPC 40 7 0 04 Jan 2024
Slot-guided Volumetric Object Radiance Fields Di Qi Tong Yang Xiangyu Zhang OCL 27 2 0 04 Jan 2024
Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splatting Yunzhi Yan Haotong Lin Chenxu Zhou Weijie Wang Haiyang Sun Kun Zhan Xianpeng Lang Xiaowei Zhou Sida Peng 3DGS 65 56 0 02 Jan 2024
PlanarNeRF: Online Learning of Planar Primitives with Neural Radiance Fields Zheng Chen Qingan Yan Huangying Zhan Changjiang Cai Xiangyu Xu Yuzhong Huang Weihan Wang Ziyue Feng Lantao Liu Yi Tian Xu 3DV 46 3 0 30 Dec 2023
LangSplat: 3D Language Gaussian Splatting Minghan Qin Wanhua Li Jiawei Zhou Haoqian Wang Hanspeter Pfister VLM 3DGS 24 178 0 26 Dec 2023
SAM-guided Graph Cut for 3D Instance Segmentation Haoyu Guo He Zhu Sida Peng Yuang Wang Yujun Shen Ruizhen Hu Xiaowei Zhou 3DV 27 17 0 13 Dec 2023
Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields Shijie Zhou Haoran Chang Sicheng Jiang Zhiwen Fan Zehao Zhu Dejia Xu Pradyumna Chari Suya You Zhangyang Wang A. Kadambi 3DGS 28 161 0 06 Dec 2023
SANeRF-HQ: Segment Anything for NeRF in High Quality Yichen Liu Benran Hu Chi-Keung Tang Yu-Wing Tai 19 11 0 03 Dec 2023
Gaussian Grouping: Segment and Edit Anything in 3D Scenes Mingqiao Ye Martin Danelljan Fisher Yu Lei Ke 3DGS DiffM 20 61 0 01 Dec 2023
Language Embedded 3D Gaussians for Open-Vocabulary Scene Understanding Jin-Chuan Shi Miao Wang Hao-Bin Duan Shao-Hua Guan 3DGS 25 84 0 30 Nov 2023
DAE-Net: Deforming Auto-Encoder for fine-grained shape co-segmentation Zhiqin Chen Qimin Chen Hang Zhou Hao Zhang 3DPC 3DV 14 2 0 22 Nov 2023
LABELMAKER: Automatic Semantic Label Generation from RGB-D Trajectories Silvan Weder Hermann Blum Francis Engelmann Marc Pollefeys VLM 19 11 0 20 Nov 2023
GP-NeRF: Generalized Perception NeRF for Context-Aware 3D Scene Understanding Hao Li Dingwen Zhang Yalun Dai Nian Liu Lechao Cheng Jingfeng Li Jingdong Wang Junwei Han 19 13 0 20 Nov 2023
OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning Haiyang Ying Yixuan Yin Jinzhi Zhang Fan Wang Tao Yu Ruqi Huang Lu Fang 10 29 0 20 Nov 2023
ASSIST: Interactive Scene Nodes for Scalable and Realistic Indoor Simulation Zhide Zhong Jiakai Cao Songen Gu Sirui Xie Weibo Gao Liyi Luo Zike Yan Hao Zhao Guyue Zhou 22 1 0 10 Nov 2023
VioLA: Aligning Videos to 2D LiDAR Scans Jun-Jee Chao Selim Engin Nikhil Chavan-Dafle Bhoram Lee Volkan Isler VGen 27 0 0 08 Nov 2023
SparseDFF: Sparse-View Feature Distillation for One-Shot Dexterous Manipulation Qianxu Wang Haotong Zhang Congyue Deng Yang You Hao Dong Yixin Zhu Leonidas J. Guibas 24 18 0 25 Oct 2023
Open-NeRF: Towards Open Vocabulary NeRF Decomposition Hao Zhang Fang Li Narendra Ahuja 19 11 0 25 Oct 2023
S4C: Self-Supervised Semantic Scene Completion with Neural Fields Adrian Hayler Felix Wimbauer Dominik Muhle Christian Rupprecht Daniel Cremers 16 22 0 11 Oct 2023
Multi-task View Synthesis with Neural Radiance Fields Shuhong Zheng Zhipeng Bao Martial Hebert Yu-Xiong Wang 21 4 0 29 Sep 2023
PanopticNeRF-360: Panoramic 3D-to-2D Label Transfer in Urban Scenes Xiao Fu Shangzhan Zhang Tianrun Chen Yichong Lu Xiaowei Zhou Andreas Geiger Yiyi Liao 3DPC 14 8 0 19 Sep 2023
Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models James Burgess Kuan-Chieh Wang Serena Yeung-Levy DiffM 22 6 0 14 Sep 2023
Panoptic Vision-Language Feature Fields Haoran Chen Kenneth Blomqvist Francesco Milano Roland Siegwart VLM 13 13 0 11 Sep 2023
PAg-NeRF: Towards fast and efficient end-to-end panoptic 3D representations for agricultural robotics Claus Smitt Michael Halstead Patrick Zimmer Thomas Labe Esra Guclu C. Stachniss Chris McCool 15 14 0 11 Sep 2023
ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenes Chandan Yeshwanth Yueh-Cheng Liu Matthias Nießner Angela Dai 3DV 3DPC 20 219 0 22 Aug 2023
ObjectSDF++: Improved Object-Compositional Neural Implicit Surfaces Qianyi Wu Kai Wang Kejie Li Jianmin Zheng Jianfei Cai AI4CE 16 27 0 15 Aug 2023
Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracing Junyi Zeng Chong Bao Ruiguo Chen Zilong Dong Guofeng Zhang Hujun Bao Zhaopeng Cui AI4CE 19 26 0 07 Aug 2023
Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understanding Runyu Ding Jihan Yang Chuhui Xue Wenqing Zhang Song Bai Xiaojuan Qi 3DV VLM 16 28 0 01 Aug 2023