Towards Label-free Scene Understanding by Vision Foundation Models

6 June 2023

Xinge Zhu

Yuexin Ma

Tongliang Liu

Wenping Wang

VLM

ArXiv PDF HTML

Papers citing "Towards Label-free Scene Understanding by Vision Foundation Models"

35 / 35 papers shown

Title
MLLM-For3D: Adapting Multimodal Large Language Model for 3D Reasoning Segmentation Jiaxin Huang Runnan Chen Ziwen Li Zhengqing Gao Xiao He Yandong Guo M. Gong Tongliang Liu LRM 51 0 0 23 Mar 2025
Cross-Modal and Uncertainty-Aware Agglomeration for Open-Vocabulary 3D Scene Understanding Jinlong Li Cristiano Saltori Fabio Poiesi N. Sebe 76 0 0 20 Mar 2025
Learning A Zero-shot Occupancy Network from Vision Foundation Models via Self-supervised Adaptation Sihao Lin Daqi Liu Ruochong Fu Dongrui Liu A. Song Hongwei Xie Zhihui Li Bing Wang Xiaojun Chang 72 0 0 10 Mar 2025
PanoSLAM: Panoptic 3D Scene Reconstruction via Gaussian SLAM Runnan Chen Zhaoqing Wang Jiepeng Wang Yuexin Ma M. Gong Wenping Wang Tongliang Liu 3DGS 29 1 0 03 Jan 2025
Vision Technologies with Applications in Traffic Surveillance Systems: A Holistic Survey Wei Zhou Lei Zhao Runyu Zhang Yifan Cui Hongpu Huang Kun Qie Chen Wang AI4TS 71 0 0 30 Nov 2024
ImOV3D: Learning Open-Vocabulary Point Clouds 3D Object Detection from Only 2D Images Timing Yang Yuanliang Ju Li Yi 3DPC 29 3 0 31 Oct 2024
Image-to-Lidar Relational Distillation for Autonomous Driving Data Anas Mahmoud Ali Harakeh Steven Waslander 14 0 0 01 Sep 2024
Open Vocabulary 3D Scene Understanding via Geometry Guided Self-Distillation Pengfei Wang Yuxi Wang Shuai Li Zhaoxiang Zhang Zhen Lei Lei Zhang 28 2 0 18 Jul 2024
Part2Object: Hierarchical Unsupervised 3D Instance Segmentation Cheng Shi Yulin Zhang Bin Yang Jiajin Tang Yuexin Ma Sibei Yang 3DPC 29 1 0 14 Jul 2024
3D Weakly Supervised Semantic Segmentation with 2D Vision-Language Guidance Xiaoxu Xu Yitian Yuan Jinlong Li Qiudan Zhang Zequn Jie Lin Ma Hao Tang N. Sebe Xu Wang 38 2 0 13 Jul 2024
4D Contrastive Superflows are Dense 3D Representation Learners Xiang Xu Lingdong Kong Hui Shuai Wenwei Zhang Liang Pan Kai Chen Ziwei Liu Qingshan Liu 3DPC 39 7 0 08 Jul 2024
Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Driving Shaoyuan Xie Lingdong Kong Wenwei Zhang Jiawei Ren Liang Pan Kai-xiang Chen Ziwei Liu AAML 50 9 0 27 May 2024
An Empirical Study of Training State-of-the-Art LiDAR Segmentation Models Jiahao Sun Chunmei Qing Xiang Xu Lingdong Kong You-Chen Liu ... Zeqi Xiao Runnan Chen Tai Wang Wenwei Zhang Kai-xiang Chen 3DV 42 6 0 23 May 2024
OpenESS: Event-based Semantic Scene Understanding with Open Vocabularies Lingdong Kong You-Chen Liu Lai Xing Ng Benoit R. Cottereau Wei Tsang Ooi VLM 29 12 0 08 May 2024
Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Driving Lingdong Kong Xiang Xu Jiawei Ren Wenwei Zhang Liang Pan Kai-xiang Chen Wei Tsang Ooi Ziwei Liu 40 15 0 08 May 2024
On the Foundations of Earth and Climate Foundation Models Xiao Xiang Zhu Zhitong Xiong Yi Wang Adam J. Stewart Konrad Heidler Yuanyuan Wang Zhenghang Yuan Thomas Dujardin Qingsong Xu Yilei Shi AI4Cl AI4CE 26 20 0 07 May 2024
Multi-Space Alignments Towards Universal LiDAR Segmentation You-Chen Liu Lingdong Kong Xiaoyang Wu Runnan Chen Xin Li Liang Pan Ziwei Liu Yuexin Ma 3DPC 37 16 0 02 May 2024
Lift3D: Zero-Shot Lifting of Any 2D Vision Model to 3D Mukund Varma Peihao Wang Zhiwen Fan Zhangyang Wang Hao Su R. Ramamoorthi VLM 32 8 0 27 Mar 2024
Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding Lingdong Kong Xiang Xu Jun Cen Wenwei Zhang Liang Pan Kai-xiang Chen Ziwei Liu 42 5 0 25 Mar 2024
IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detection Junbo Yin Jianbing Shen Runnan Chen Wei Li Ruigang Yang Pascal Frossard Wenguan Wang 3DPC 26 31 0 22 Mar 2024
HUNTER: Unsupervised Human-centric 3D Detection via Transferring Knowledge from Synthetic Instances to Real Scenes Yichen Yao Zimo Jiang Yujing Sun Zhencai Zhu Xinge Zhu Runnan Chen Yuexin Ma 25 2 0 05 Mar 2024
Mitigating Label Noise on Graph via Topological Sample Selection Yuhao Wu Jiangchao Yao Xiaobo Xia Jun-chen Yu Ruxing Wang Bo Han Tongliang Liu NoLa 39 2 0 04 Mar 2024
MixSup: Mixed-grained Supervision for Label-efficient LiDAR-based 3D Object Detection Yuxue Yang Lue Fan Zhaoxiang Zhang 3DPC 34 6 0 29 Jan 2024
FRNet: Frustum-Range Networks for Scalable LiDAR Segmentation Xiang Xu Lingdong Kong Hui Shuai Qingshan Liu 3DPC 53 21 0 07 Dec 2023
Learning to Adapt SAM for Segmenting Cross-domain Point Clouds Xidong Peng Runnan Chen Feng Qiao Lingdong Kong You-Chen Liu Tai Wang Xinge Zhu Yuexin Ma 23 12 0 13 Oct 2023
Model2Scene: Learning 3D Scene Representation via Contrastive Language-CAD Models Pre-training Runnan Chen Xinge Zhu Nenglun Chen Dawei Wang Wei Li Yuexin Ma Ruigang Yang Tongliang Liu Wenping Wang 3DPC SSL 8 3 0 29 Sep 2023
UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebase You-Chen Liu Runnan Chen Xin Li Lingdong Kong Yuchen Yang ... Xinge Zhu Yuexin Ma Yikang Li Yu Qiao Yuenan Hou 3DPC 3DV 24 47 0 11 Sep 2023
The RoboDepth Challenge: Methods and Advancements Towards Robust Depth Estimation Lingdong Kong Yaru Niu Shaoyuan Xie Hanjiang Hu Lai Xing Ng ... Zhenyu Li Runze Chen Haiyong Luo Fang Zhao Jing Yu 19 13 0 27 Jul 2023
See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data Yuhang Lu Qingnan Jiang Runnan Chen Yuenan Hou Xinge Zhu Yuexin Ma 3DPC 13 19 0 20 Jul 2023
A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering Chaoning Zhang Fachrina Dewi Puspitasari Sheng Zheng Chenghao Li Yu Qiao ... Caiyan Qin François Rameau Lik-Hang Lee Sung-Ho Bae Choong Seon Hong VLM 76 61 0 12 May 2023
Zero-shot point cloud segmentation by transferring geometric primitives Runnan Chen Xinge Zhu Nenglun Chen Wei Li Yuexin Ma Ruigang Yang Wenping Wang 3DPC 19 8 0 18 Oct 2022
NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenes Zhiwen Fan Peihao Wang Yifan Jiang Xinyu Gong Dejia Xu Zhangyang Wang 97 63 0 19 Sep 2022
2DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Clouds Xu Yan Jiantao Gao Chaoda Zheng Chao Zheng Ruimao Zhang Shenghui Cui Zhen Li 3DPC 84 210 0 10 Jul 2022
(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Network Ran Cheng Ryan Razani E. Taghavi Enxu Li Bingbing Liu 3DPC 153 239 0 08 Feb 2021
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation C. Qi Hao Su Kaichun Mo Leonidas J. Guibas 3DH 3DPC 3DV PINN 219 13,886 0 02 Dec 2016