Title
Kubrick: Multimodal Agent Collaborations for Synthetic Video Generation Liu He Yizhi Song Hejun Huang Pinxin Liu Yunlong Tang Daniel G. Aliaga Xin Zhou DiffM VGen 90 3 0 19 Aug 2024
ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic Environments Taewoong Kim Cheolhong Min Byeonghwi Kim Jinyeon Kim Wonje Jeung Jonghyun Choi LM&Ro 24 4 0 26 Jul 2024
DStruct2Design: Data and Benchmarks for Data Structure Driven Generative Floor Plan Design Zhi Hao Luo Luis Lara Ge Ya Luo Florian Golemo Christopher Beckham Christopher Pal 3DV 26 1 0 22 Jul 2024
GRUtopia: Dream General Robots in a City at Scale Hanqing Wang Jiahe Chen Wensi Huang Qingwei Ben Tai Wang ... Ying Zhao Zhongying Tu Yu Qiao Dahua Lin Jiangmiao Pang LM&Ro VGen 47 16 0 15 Jul 2024
MetaUrban: A Simulation Platform for Embodied AI in Urban Spaces Wayne Wu Honglin He Yiran Wang Chenda Duan Jack He Zhizheng Liu Quanyi Li Bolei Zhou 24 0 0 11 Jul 2024
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI Y. Liu Weixing Chen Yongjie Bai Xiaodan Liang Guanbin Li Wen Gao Liang Lin LM&Ro SyDa AI4CE 48 27 0 09 Jul 2024
3D Vision and Language Pretraining with Large-Scale Synthetic Data Dejie Yang Zhu Xu Wentao Mo Qingchao Chen Siyuan Huang Yang Liu 24 5 0 08 Jul 2024
ClutterGen: A Cluttered Scene Generator for Robot Learning Yinsen Jia Boyuan Chen 19 3 0 07 Jul 2024
Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesis Qi Sun Hang Zhou Wengang Zhou Li Li Houqiang Li 3DPC 3DV 31 6 0 07 Jul 2024
PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigators Kuo-Hao Zeng Zichen Zhang Kiana Ehsani Rose Hendrix Jordi Salvador Alvaro Herrasti Ross Girshick Aniruddha Kembhavi Luca Weihs LM&Ro OffRL 29 17 0 28 Jun 2024
HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Model Hieu T. Nguyen Yiwen Chen Vikram S. Voleti Varun Jampani Huaizu Jiang 51 0 0 28 Jun 2024
HumanVLA: Towards Vision-Language Directed Object Rearrangement by Physical Humanoid Xinyu Xu Yizheng Zhang Yong-Lu Li Lei Han Cewu Lu 38 7 0 28 Jun 2024
Two-Stage Depth Enhanced Learning with Obstacle Map For Object Navigation Yanwei Zheng Shaopu Feng Bowen Huang Changrui Li Xiao Zhang Dongxiao Yu 24 0 0 20 Jun 2024
Leveraging Large Language Model for Heterogeneous Ad Hoc Teamwork Collaboration Xinzhu Liu Peiyan Li Wenju Yang Di Guo Huaping Liu 26 6 0 18 Jun 2024
Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generation Alexander R. E. Raistrick Lingjie Mei Karhan Kayan David Yan Yiming Zuo ... Meenal Parakh Stamatis Alexandropoulos Lahav Lipson Zeyu Ma Jia Deng VGen AI4CE 30 18 0 17 Jun 2024
RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics Wentao Yuan Jiafei Duan Valts Blukis Wilbert Pumacay Ranjay Krishna Adithyavairavan Murali Arsalan Mousavian Dieter Fox LM&Ro 42 43 0 15 Jun 2024
InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment Yuxing Long Wenzhe Cai Hongcheng Wang Guanqi Zhan Hao Dong 30 20 0 07 Jun 2024
3D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination Jianing Yang Xuweiyi Chen Nikhil Madaan Madhavan Iyengar Shengyi Qian David Fouhey Joyce Chai 3DV 65 11 0 07 Jun 2024
LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Model Yixuan Yang Junru Lu Zixiang Zhao Zhen Luo James J.Q. Yu Victor Sanchez Feng Zheng 3DV 33 3 0 06 Jun 2024
Task Planning for Object Rearrangement in Multi-room Environments Karan Mirakhor Sourav Ghosh Dipanjan Das Brojeshwar Bhowmick 37 1 0 01 Jun 2024
Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning Fangjun Li David C. Hogg Anthony G. Cohn LRM 22 4 0 23 May 2024
URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Images Zoey Chen Aaron Walsman Marius Memmel Kaichun Mo Alex Fang Karthikeya Vemuri Alan Wu Dieter Fox Abhishek Gupta AI4CE VGen 56 24 0 19 May 2024
BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation Yunhao Ge Yihe Tang Jiashu Xu Cem Gokmen Chengshu Li ... Miao Liu Pengchuan Zhang Ruohan Zhang Fei-Fei Li Jiajun Wu VGen 28 6 0 15 May 2024
A hypergraph model shows the carbon reduction potential of effective space use in housing R. Weber Caitlin Mueller Christoph Reinhart AI4CE 19 3 0 02 May 2024
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models Gabriel H. Sarch Sahil Somani Raghav Kapoor Michael J. Tarr Katerina Fragkiadaki LM&Ro LLMAG 18 3 0 29 Apr 2024
LEGENT: Open Platform for Embodied Agents Zhili Cheng Zhitong Wang Jinyi Hu Shengding Hu An Liu Yuge Tu Pengkai Li Lei Shi Zhiyuan Liu Maosong Sun VLM 20 6 0 28 Apr 2024
What Foundation Models can Bring for Robot Learning in Manipulation : A Survey Dingzhe Li Yixiang Jin A. Yong Hongze Yu Jun Shi Xiaoshuai Hao Peng Hao Huaping Liu Fuchun Sun Bin Fang AI4CE LM&Ro 64 12 0 28 Apr 2024
3DBench: A Scalable 3D Benchmark and Instruction-Tuning Dataset Junjie Zhang Tianci Hu Xiaoshui Huang Yongshun Gong Dan Zeng 25 1 0 23 Apr 2024
PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI Yandan Yang Baoxiong Jia Peiyuan Zhi Siyuan Huang LM&Ro VGen 41 41 0 15 Apr 2024
Koala: Key frame-conditioned long video-LLM Reuben Tan Ximeng Sun Ping Hu Jui-hsien Wang Hanieh Deilamsalehy Bryan A. Plummer Bryan C. Russell Kate Saenko 38 35 0 05 Apr 2024
I-Design: Personalized LLM Interior Designer Ata cCelen Guo Han Konrad Schindler Luc Van Gool Iro Armeni Anton Obukhov Xi Wang 3DV 24 4 0 03 Apr 2024
Commonsense Scene Graph-based Target Localization for Object Search Wenqi Ge Chao Tang Hong Zhang LM&Ro 19 1 0 30 Mar 2024
TriHelper: Zero-Shot Object Navigation with Dynamic Assistance Lingfeng Zhang Qiang Zhang Hao Wang Erjia Xiao Zixuan Jiang Honglei Chen Renjing Xu 25 8 0 22 Mar 2024
Leveraging Large Language Model-based Room-Object Relationships Knowledge for Enhancing Multimodal-Input Object Goal Navigation Leyuan Sun Asako Kanezaki Guillaume Caron Yusuke Yoshiyasu LM&Ro 21 2 0 21 Mar 2024
Semantic Layering in Room Segmentation via LLMs Taehyeon Kim Byung-Cheol Min 19 2 0 19 Mar 2024
Prioritized Semantic Learning for Zero-shot Instance Navigation Xander Sun Louis Lau Hoyard Zhi Ronghe Qiu Junwei Liang 25 8 0 18 Mar 2024
Can LLMs Generate Human-Like Wayfinding Instructions? Towards Platform-Agnostic Embodied Instruction Synthesis Vishnu Sashank Dorbala Sanjoy Chowdhury Dinesh Manocha LM&Ro 25 0 0 18 Mar 2024
Advancing Object Goal Navigation Through LLM-enhanced Object Affinities Transfer Mengying Lin Yaran Chen Dong Zhao Zhaoran Wang 33 2 0 15 Mar 2024
Scaling Instructable Agents Across Many Simulated Worlds Sima Team Maria Abi Raad Arun Ahuja Catarina Barros F. Besse ... Daan Wierstra Duncan Williams Nathaniel Wong Sarah York Nick Young LM&Ro 107 35 0 13 Mar 2024
RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation Hanxiao Jiang Binghao Huang Ruihai Wu Zhuoran Li Shubham Garg H. Nayyeri Shenlong Wang Yunzhu Li 29 17 0 23 Feb 2024
Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review Thang-Anh-Quan Nguyen Amine Bourki Mátyás Macudzinski Anthony Brunel M. Bennamoun 25 9 0 17 Feb 2024
Implicit Causal Representation Learning via Switchable Mechanisms Shayan Shirahmad Gale Bagi Zahra Gharaee Oliver Schulte Mark Crowley CML 40 0 0 16 Feb 2024
THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation Wilbert Pumacay Ishika Singh Jiafei Duan Ranjay Krishna Jesse Thomason Dieter Fox 27 39 0 13 Feb 2024
Language-Based Augmentation to Address Shortcut Learning in Object Goal Navigation Dennis Hoftijzer Gertjan J. Burghouts Luuk J. Spreeuwers 10 1 0 07 Feb 2024
Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases Rio Aguina-Kang Maxim Gumin Do Heon Han Stewart Morris Seung Jean Yoo Aditya Ganeshan R. K. Jones Qiuhong Anna Wei Kailiang Fu Daniel E. Ritchie 3DV 37 24 0 05 Feb 2024
Understanding User Experience in Large Language Model Interactions Jiayin Wang Weizhi Ma Peijie Sun Min Zhang Jian-yun Nie 16 6 0 16 Jan 2024
ODIN: A Single Model for 2D and 3D Segmentation Ayush Jain Pushkal Katara N. Gkanatsios Adam W. Harley Gabriel H. Sarch Kriti Aggarwal Vishrav Chaudhary Katerina Fragkiadaki 3DPC 34 7 0 04 Jan 2024
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action Jiasen Lu Christopher Clark Sangho Lee Zichen Zhang Savya Khosla Ryan Marten Derek Hoiem Aniruddha Kembhavi VLM MLLM 27 143 0 28 Dec 2023
Promptable Behaviors: Personalizing Multi-Objective Rewards from Human Preferences Minyoung Hwang Luca Weihs Chanwoo Park Kimin Lee Aniruddha Kembhavi Kiana Ehsani 22 18 0 14 Dec 2023
Holodeck: Language Guided Generation of 3D Embodied AI Environments Yue Yang Fan-Yun Sun Luca Weihs Eli VanderBilt Alvaro Herrasti ... Lingjie Liu Chris Callison-Burch Mark Yatskar Aniruddha Kembhavi Christopher Clark LM&Ro 23 77 0 14 Dec 2023