CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation

20 March 2022

Shuran Song

Papers citing "CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation"

50 / 114 papers shown

Title
Map-based Modular Approach for Zero-shot Embodied Question Answering Koya Sakamoto Daich Azuma Taiki Miyanishi Shuhei Kurita M. Kawanabe 23 3 0 26 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 60 38 0 23 May 2024
SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Tasks M. Ginting Sung-Kyun Kim David D. Fan M. Palieri Mykel J. Kochenderfer Ali-akbar Agha-Mohammadi 22 1 0 16 May 2024
LOC-ZSON: Language-driven Object-Centric Zero-Shot Object Retrieval and Navigation Tianrui Guan Yurou Yang Harry Cheng Muyuan Lin Richard Kim R. Madhivanan Arnie Sen Dinesh Manocha LM&Ro 31 8 0 08 May 2024
HIPer: A Human-Inspired Scene Perception Model for Multifunctional Mobile Robots Florenz Graf Jochen Lindermayr Birgit Graf Werner Kraus Marco F. Huber 33 3 0 27 Apr 2024
Integrating Disambiguation and User Preferences into Large Language Models for Robot Motion Planning Mohammed Abugurain Shinkyu Park 19 1 0 22 Apr 2024
TDANet: Target-Directed Attention Network For Object-Goal Visual Navigation With Zero-Shot Ability Shiwei Lian Feitian Zhang 22 3 0 12 Apr 2024
GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigation Mukul Khanna Ram Ramrakhya Gunjan Chhablani Sriram Yenamandra Théophile Gervet Matthew Chang Z. Kira Devendra Singh Chaplot Dhruv Batra Roozbeh Mottaghi LM&Ro 28 22 0 09 Apr 2024
Commonsense Scene Graph-based Target Localization for Object Search Wenqi Ge Chao Tang Hong Zhang LM&Ro 19 1 0 30 Mar 2024
MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language Models Peng Ding Jiading Fang Peng Li Kangrui Wang Xiaochen Zhou Mo Yu Jing Li Matthew R. Walter Hongyuan Mei RALM ELM 34 3 0 29 Mar 2024
Online Embedding Multi-Scale CLIP Features into 3D Maps Shun Taguchi Hideki Deguchi 14 0 0 27 Mar 2024
Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigation Abdelrhman Werby Chen Huang M. Büchner Abhinav Valada Wolfram Burgard 36 63 0 26 Mar 2024
Explore until Confident: Efficient Exploration for Embodied Question Answering Allen Z. Ren Jaden Clark Anushri Dixit Masha Itkina Anirudha Majumdar Dorsa Sadigh 40 28 0 23 Mar 2024
TriHelper: Zero-Shot Object Navigation with Dynamic Assistance Lingfeng Zhang Qiang Zhang Hao Wang Erjia Xiao Zixuan Jiang Honglei Chen Renjing Xu 22 8 0 22 Mar 2024
Embedding Pose Graph, Enabling 3D Foundation Model Capabilities with a Compact Representation Hugues Thomas Jian Zhang 26 1 0 20 Mar 2024
GaussNav: Gaussian Splatting for Visual Navigation Xiaohan Lei Min Wang Wen-gang Zhou Houqiang Li 3DGS 20 11 0 18 Mar 2024
Learning Generalizable Feature Fields for Mobile Manipulation Ri-Zhao Qiu Yafei Hu Ge Yang Yuchen Song Yang Fu ... Jiteng Mu Ruihan Yang Nikolay A. Atanasov Sebastian Scherer Xiaolong Wang 26 25 0 12 Mar 2024
DOZE: A Dataset for Open-Vocabulary Zero-Shot Object Navigation in Dynamic Environments Ji Ma Hongming Dai Yao Mu Pengying Wu Hao Wang Xiaowei Chi Yang Fei Shanghang Zhang Chang-rui Liu 37 6 0 29 Feb 2024
Aligning Knowledge Graph with Visual Perception for Object-goal Navigation Nuo Xu Wen Wang Rong Yang Mengjie Qin Zheyuan Lin Wei Song Chunlong Zhang J. Gu Chao Li 16 7 0 29 Feb 2024
Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation X. Lei Min Wang Wen-gang Zhou Li Li Houqiang Li 22 5 0 25 Feb 2024
NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation Jiazhao Zhang Kunyu Wang Rongtao Xu Gengze Zhou Yicong Hong Xiaomeng Fang Qi Wu Zhizheng Zhang Wang He LM&Ro 24 11 0 24 Feb 2024
RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation Hanxiao Jiang Binghao Huang Ruihai Wu Zhuoran Li Shubham Garg H. Nayyeri Shenlong Wang Yunzhu Li 29 17 0 23 Feb 2024
Verifiably Following Complex Robot Instructions with Foundation Models Benedict Quartey Eric Rosen Stefanie Tellex G. Konidaris LM&Ro 39 10 0 18 Feb 2024
OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models Yuxuan Kuang Hai Lin Meng Jiang LM&Ro 31 25 0 16 Feb 2024
PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs Soroush Nasiriany Fei Xia Wenhao Yu Ted Xiao Jacky Liang ... Karol Hausman N. Heess Chelsea Finn Sergey Levine Brian Ichter LM&Ro LRM 17 88 0 12 Feb 2024
CLIP-Loc: Multi-modal Landmark Association for Global Localization in Object-based Maps Shigemichi Matsuzaki Takuma Sugino Kazuhito Tanaka Zijun Sha Shintaro Nakaoka Shintaro Yoshizawa Kazuhiro Shintani VLM 6 5 0 08 Feb 2024
An Interactive Agent Foundation Model Zane Durante Bidipta Sarkar Ran Gong Rohan Taori Yusuke Noda ... Katsushi Ikeuchi Fei-Fei Li Jianfeng Gao Naoki Wake Qiuyuan Huang LM&Ro AI4CE LLMAG 86 14 0 08 Feb 2024
CLIP feature-based randomized control using images and text for multiple tasks and robots Kazuki Shibata Hideki Deguchi Shun Taguchi 19 1 0 18 Jan 2024
VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Model Pengying Wu Yao Mu Bingxian Wu Yi Hou Ji Ma Shanghang Zhang Chang-rui Liu LM&Ro 19 23 0 05 Jan 2024
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 27 136 0 13 Dec 2023
FoMo Rewards: Can we cast foundation models as reward functions? Ekdeep Singh Lubana Johann Brehmer P. D. Haan Taco S. Cohen OffRL LRM 25 2 0 06 Dec 2023
VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation Naoki Yokoyama Sehoon Ha Dhruv Batra Jiuguang Wang Bernadette Bucher LM&Ro 13 75 0 06 Dec 2023
Robot Learning in the Era of Foundation Models: A Survey Xuan Xiao Jiahang Liu Zhipeng Wang Yanmin Zhou Yong Qi Qian Cheng Bin He Shuo Jiang AI4CE LM&Ro 16 25 0 24 Nov 2023
GOAT: GO to Any Thing Matthew Chang Théophile Gervet Mukul Khanna Sriram Yenamandra Dhruv Shah ... Saurabh Gupta Dhruv Batra Roozbeh Mottaghi Jitendra Malik Devendra Singh Chaplot 15 65 0 10 Nov 2023
Interactive Semantic Map Representation for Skill-based Visual Object Navigation T. Zemskova A. Staroverov K. Muravyev Dmitry A. Yudin Aleksandr I. Panov 24 2 0 07 Nov 2023
Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture Yixin Chen Junfeng Ni Nan Jiang Yaowei Zhang Yixin Zhu Siyuan Huang 3DV 17 19 0 01 Nov 2023
Large Language Models as Generalizable Policies for Embodied Tasks Andrew Szot Max Schwarzer Harsh Agrawal Bogdan Mazoure Walter A. Talbott Katherine Metcalf Natalie Mackraz Devon Hjelm Alexander Toshev LM&Ro 8 57 0 26 Oct 2023
Vision and Language Navigation in the Real World via Online Visual Language Mapping Chengguang Xu Hieu T. Nguyen Christopher Amato Lawson L. S. Wong 19 9 0 16 Oct 2023
An Unbiased Look at Datasets for Visuo-Motor Pre-Training Sudeep Dasari M. K. Srirama Unnat Jain Abhinav Gupta SSL 12 33 0 13 Oct 2023
Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation Yinpei Dai Run Peng Sikai Li Joyce Chai LM&Ro 27 23 0 12 Oct 2023
Open-Fusion: Real-time Open-Vocabulary 3D Mapping and Queryable Scene Representation Kashu Yamazaki Taisei Hanyu Khoa T. Vo Thang M. Pham Minh-Triet Tran Gianfranco Doretto Anh Nguyen Ngan Le 11 25 0 05 Oct 2023
Context-Aware Entity Grounding with Open-Vocabulary 3D Scene Graphs Haonan Chang Kowndinya Boyalakuntla Shiyang Lu Siwei Cai E. Jing ... Shijie Geng Adeeb Abbas Lifeng Zhou Kostas Bekris Abdeslam Boularias 6 26 0 27 Sep 2023
LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agent Jianing Yang Xuweiyi Chen Shengyi Qian Nikhil Madaan Madhavan Iyengar David Fouhey Joyce Chai LM&Ro LLMAG 22 84 0 21 Sep 2023
Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill Wenzhe Cai Siyuan Huang Guangran Cheng Yuxing Long Peng Gao Changyin Sun Hao Dong LM&Ro 19 39 0 19 Sep 2023
Language-enhanced RNR-Map: Querying Renderable Neural Radiance Field maps with natural language Francesco Taioli Federico Cunico Federico Girella Riccardo Bologna Alessandro Farinelli Marco Cristani 15 7 0 17 Aug 2023
CARTIER: Cartographic lAnguage Reasoning Targeted at Instruction Execution for Robots D. Rivkin Nikhil Kakodkar F. Hogan Bobak H. Baghi Gregory Dudek LM&Ro 11 3 0 21 Jul 2023
DRAGON: A Dialogue-Based Robot for Assistive Navigation with Visual Language Grounding Shuijing Liu Aamir Hasan Kaiwen Hong Runxuan Wang Peixin Chang Z. Mizrachi Justin Lin D. L. McPherson W. Rogers Katherine Driggs-Campbell LM&Ro 26 12 0 13 Jul 2023
Goal Representations for Instruction Following: A Semi-Supervised Language Interface to Control Vivek Myers Andre Wang He Kuan Fang Homer Walke Philippe Hansen-Estruch Ching-An Cheng Mihai Jalobeanu Andrey Kolobov Anca Dragan Sergey Levine LM&Ro 17 29 0 30 Jun 2023
Statler: State-Maintaining Language Models for Embodied Reasoning Takuma Yoneda Jiading Fang Peng Li Huanyu Zhang Tianchong Jiang Shengjie Lin Ben Picker David Yunis Hongyuan Mei Matthew R. Walter LM&Ro 10 32 0 30 Jun 2023
CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigation Xiwen Liang Liang Ma Shanshan Guo Jianhua Han Hang Xu Shikui Ma Xiaodan Liang LM&Ro LLMAG 71 4 0 17 Jun 2023