Title
Semantically Safe Robot Manipulation: From Semantic Scene Understanding to Motion Safeguards Lukas Brunke Yanni Zhang Ralf Romer Jack Naimer Nikola Staykov Siqi Zhou Angela P. Schoellig 40 3 0 19 Oct 2024
IntelliMove: Enhancing Robotic Planning with Semantic Mapping Fama Ngom H. Zhang Lei Zhang Karen Godary-Dejean M. Huchard 25 0 0 18 Oct 2024
VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Grounding Runsen Xu Zhiwei Huang Tai Wang Y. Chen Jiangmiao Pang Dahua Lin VGen 26 0 0 17 Oct 2024
Dynamic Open-Vocabulary 3D Scene Graphs for Long-term Language-Guided Mobile Manipulation Zhijie Yan Shufei Li Z. Wang Lixiu Wu Han Wang Jun Zhu Lijiang Chen Jihong Liu 22 1 0 15 Oct 2024
SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigation Hang Yin Xiuwei Xu Zhenyu Wu Jie Zhou Jiwen Lu 16 13 0 10 Oct 2024
3D Vision-Language Gaussian Splatting Qucheng Peng Benjamin Planche Zhongpai Gao Meng Zheng Anwesa Choudhuri Terrence Chen C. L. P. Chen Ziyan Wu 3DGS 27 4 0 10 Oct 2024
OrionNav: Online Planning for Robot Autonomy with Context-Aware LLM and Open-Vocabulary Semantic Scene Graphs Venkata Naren Devarakonda Raktim Gautam Goswami Ali Umut Kaypak Naman Patel Rooholla Khorrambakht P. Krishnamurthy Farshad Khorrami LM&Ro 27 3 0 08 Oct 2024
ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution Corban Rivera Grayson Byrd William Paul Tyler Feldman Meghan Booker ... Krishna Murthy Jatavallabhula Celso M. De Melo Lalithkumar Seenivasan Mathias Unberath Rama Chellappa LLMAG LM&Ro 21 0 0 08 Oct 2024
PANav: Toward Privacy-Aware Robot Navigation via Vision-Language Models Bangguo Yu H. Kasaei Ming Cao 22 0 0 05 Oct 2024
SPINE: Online Semantic Planning for Missions with Incomplete Natural Language Specifications in Unstructured Environments Zachary Ravichandran Varun Murali Mariliza Tzes George J. Pappas Vijay Kumar LRM 49 6 0 03 Oct 2024
OpenObject-NAV: Open-Vocabulary Object-Oriented Navigation Based on Dynamic Carrier-Relationship Scene Graph Yujie Tang Meiling Wang Yinan Deng Zibo Zheng Jiagui Zhong Yufeng Yue 13 0 0 27 Sep 2024
Search3D: Hierarchical Open-Vocabulary 3D Segmentation Ayca Takmaz Alexandros Delitzas R. Sumner Francis Engelmann Johanna Wald Federico Tombari 42 10 0 27 Sep 2024
Language-Embedded Gaussian Splats (LEGS): Incrementally Building Room-Scale Representations with a Mobile Robot Justin Yu Kush Hari Kishore Srinivas Karim El-Refai Adam Rashid ... Richard Cheng Muhammad Zubair Irshad Ashwin Balakrishna Thomas Kollar Ken Goldberg 3DGS 17 8 0 26 Sep 2024
Revisit Anything: Visual Place Recognition via Image Segment Retrieval Kartik Garg Sai Shubodh Puligilla Shishir Kolathaya Madhava Krishna Sourav Garg 29 3 0 26 Sep 2024
SYNERGAI: Perception Alignment for Human-Robot Collaboration Yixin Chen Guoxi Zhang Yaowei Zhang Hongming Xu Peiyuan Zhi Qing Li Siyuan Huang 32 0 0 24 Sep 2024
Tag Map: A Text-Based Map for Spatial Reasoning and Navigation with Large Language Models Mike Zhang Kaixian Qu Vaishakh Patil César Cadena Marco Hutter LM&Ro 3DV 17 3 0 23 Sep 2024
Autonomous Exploration and Semantic Updating of Large-Scale Indoor Environments with Mobile Robots Sai Haneesh Allu Itay Kadosh Tyler Summers Yu Xiang 19 0 0 23 Sep 2024
Towards Efficient Neuro-Symbolic AI: From Workload Characterization to Hardware Architecture Zishen Wan Che-Kai Liu Hanchen Yang Ritik Raj Chaojian Li ... Yingyan Celine Lin Mohamed Ibrahim Jan M. Rabaey Tushar Krishna A. Raychowdhury 15 8 0 20 Sep 2024
Towards Robust Automation of Surgical Systems via Digital Twin-based Scene Representations from Foundation Models Hao Ding Lalithkumar Seenivasan Hongchao Shu Grayson Byrd Han Zhang Pu Xiao Juan Antonio Barragan Russell H. Taylor Peter Kazanzides Mathias Unberath 24 5 0 19 Sep 2024
Metric-Semantic Factor Graph Generation based on Graph Neural Networks Jose A. Millan-Romera Hriday Bavle Muhammad Shaheer Holger Voos Jose Luis Sanchez-Lopez 13 0 0 18 Sep 2024
One Map to Find Them All: Real-time Open-Vocabulary Mapping for Zero-shot Multi-Object Navigation F. L. Busch Timon Homberger Jesús Ortega-Peimbert Quantao Yang Olov Andersson 21 1 0 18 Sep 2024
Point2Graph: An End-to-end Point Cloud-based 3D Open-Vocabulary Scene Graph for Robot Navigation Yifan Xu Ziming Luo Qianwei Wang Vineet Kamat Carol Menassa 3DV 3DPC 16 0 0 16 Sep 2024
Intelligent LiDAR Navigation: Leveraging External Information and Semantic Maps with LLM as Copilot Fujing Xie Jiajie Zhang Sören Schwertfeger 31 1 0 13 Sep 2024
GraspSplats: Efficient Manipulation with 3D Feature Splatting Mazeyu Ji Ri-Zhao Qiu Xueyan Zou Xiaolong Wang 3DGS 21 9 0 03 Sep 2024
A Modern Take on Visual Relationship Reasoning for Grasp Planning Paolo Rabino Tatiana Tommasi 23 1 0 03 Sep 2024
EMPOWER: Embodied Multi-role Open-vocabulary Planning with Online Grounding and Execution F. Argenziano Michele Brienza Vincenzo Suriani Daniele Nardi D. Bloisi LM&Ro 33 0 0 30 Aug 2024
Space3D-Bench: Spatial 3D Question Answering Benchmark E. Szymańska Mihai Dusmanu J. Buurlage Mahdi Rad Marc Pollefeys 43 4 0 29 Aug 2024
Active Semantic Mapping and Pose Graph Spectral Analysis for Robot Exploration Rongge Zhang Haechan Mark Bong Giovanni Beltrame 31 1 0 27 Aug 2024
OpenSU3D: Open World 3D Scene Understanding using Foundation Models Rafay Mohiuddin Sai Manoj Prakhya Fiona Collins Ziyuan Liu André Borrmann 26 2 0 19 Jul 2024
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI Y. Liu Weixing Chen Yongjie Bai Xiaodan Liang Guanbin Li Wen Gao Liang Lin LM&Ro SyDa AI4CE 48 27 0 09 Jul 2024
Embodied Instruction Following in Unknown Environments Zhenyu Wu Ziwei Wang Xiuwei Xu Jiwen Lu Haibin Yan LM&Ro 14 4 0 17 Jun 2024
OpenObj: Open-Vocabulary Object-Level Neural Radiance Fields with Fine-Grained Understanding Yinan Deng Jiahui Wang Jingyu Zhao Jianyu Dou Yi Yang Yufeng Yue AI4CE 16 6 0 12 Jun 2024
Beyond Bare Queries: Open-Vocabulary Object Grounding with 3D Scene Graph S. Linok T. Zemskova Svetlana Ladanova Roman Titkov Dmitry A. Yudin Maxim Monastyrny Aleksei Valenkov LM&Ro 37 3 0 11 Jun 2024
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 41 11 0 06 Jun 2024
DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences Yidong Huang Jacob Sansom Ziqiao Ma Felix Gervits Joyce Chai 33 17 0 05 Jun 2024
Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentation Mohamed El Amine Boudjoghra Angela Dai Jean Lahoud Hisham Cholakkal Rao Muhammad Anwer Salman Khan F. Khan VLM ISeg 55 6 0 04 Jun 2024
SpatialRGPT: Grounded Spatial Reasoning in Vision Language Model An-Chieh Cheng Hongxu Yin Yang Fu Qiushan Guo Ruihan Yang Jan Kautz Xiaolong Wang Sifei Liu LRM 43 43 0 03 Jun 2024
Evaluating Zero-Shot GPT-4V Performance on 3D Visual Question Answering Benchmarks Simranjit Singh Georgios Pavlakos Dimitrios Stamoulis 14 2 0 29 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 55 38 0 23 May 2024
RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigation Sourav Garg Krishan Rana M. Hosseinzadeh Lachlan Mares Niko Sünderhauf Feras Dayoub Ian Reid 29 17 0 09 May 2024
Open-Set 3D Semantic Instance Maps for Vision Language Navigation -- O3D-SIM Laksh Nanwani Kumaraditya Gupta Aditya Mathur Swayam Agrawal A. H. A. Hafez K. M. Krishna 24 0 0 27 Apr 2024
Clio: Real-time Task-Driven Open-Set 3D Scene Graphs Dominic Maggio Yun Chang Nathan Hughes Matthew Trang Dan Griffith Carlyn Dougherty Eric Cristofalo Lukas Schmid Luca Carlone 3DV 23 31 0 21 Apr 2024
Towards Human Awareness in Robot Task Planning with Large Language Models Yuchen Liu Luigi Palmieri Sebastian Koch Ilche Georgievski Marco Aiello LM&Ro 14 6 0 17 Apr 2024
Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V Peiyuan Zhi Zhiyuan Zhang Muzhi Han Zeyu Zhang Zhitian Li Ziyuan Jiao Ziyuan Jiao Siyuan Huang Siyuan Huang LRM LM&Ro 38 28 0 16 Apr 2024
QueSTMaps: Queryable Semantic Topological Maps for 3D Scene Understanding Yash Mehan Kumaraditya Gupta Rohit Jayanti Anirudh Govil Sourav Garg Madhava Krishna 3DPC 27 2 0 09 Apr 2024
DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models Yuchen Liu Luigi Palmieri Sebastian Koch Ilche Georgievski Marco Aiello LM&Ro 47 15 0 04 Apr 2024
Commonsense Scene Graph-based Target Localization for Object Search Wenqi Ge Chao Tang Hong Zhang LM&Ro 19 1 0 30 Mar 2024
Beyond Embeddings: The Promise of Visual Table in Visual Reasoning Yiwu Zhong Zi-Yuan Hu Michael R. Lyu Liwei Wang 16 1 0 27 Mar 2024
EgoLifter: Open-world 3D Segmentation for Egocentric Perception Qiao Gu Zhaoyang Lv Duncan Frost Simon Green Julian Straub Chris Sweeney 3DGS EgoV 16 4 0 26 Mar 2024
Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigation Abdelrhman Werby Chen Huang M. Büchner Abhinav Valada Wolfram Burgard 26 63 0 26 Mar 2024