MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge

17 June 2022

Linxi Fan

De-An Huang

Papers citing "MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge"

50 / 286 papers shown

Title
Generative AI in Embodied Systems: System-Level Analysis of Performance, Efficiency and Scalability Zishen Wan Jiayi Qian Yuhang Du Jason J. Jabbour Yilun Du Yang Katie Zhao A. Raychowdhury Tushar Krishna Vijay Janapa Reddi LM&Ro 86 0 0 26 Apr 2025
Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation Phillip Y. Lee Jihyeon Je Chanho Park Mikaela Angelina Uy Leonidas J. Guibas Minhyuk Sung LRM 41 0 0 24 Apr 2025
PLANET: A Collection of Benchmarks for Evaluating LLMs' Planning Capabilities Haoming Li Zhaoliang Chen Jonathan Zhang Fei Liu LLMAG 33 0 0 21 Apr 2025
Are Retrials All You Need? Enhancing Large Language Model Reasoning Without Verbalized Feedback Nearchos Potamitis Akhil Arora LRM 42 0 0 17 Apr 2025
WORLDMEM: Long-term Consistent World Simulation with Memory Zeqi Xiao Yushi Lan Yifan Zhou Wenqi Ouyang Shuai Yang Yanhong Zeng Xingang Pan 73 0 0 16 Apr 2025
Multi-fidelity Reinforcement Learning Control for Complex Dynamical Systems Luning Sun Xin-Yang Liu Siyan Zhao Aditya Grover Jian-Xun Wang Jayaraman J. Thiagarajan AI4CE 21 0 0 08 Apr 2025
Building LLM Agents by Incorporating Insights from Computer Systems Yapeng Mi Zhi Gao Xiaojian Ma Qing Li LLMAG 36 0 0 06 Apr 2025
AnimeGamer: Infinite Anime Life Simulation with Next Game State Prediction Junhao Cheng Yuying Ge Yixiao Ge Jing Liao Ying Shan VGen AI4CE 51 0 0 01 Apr 2025
Cultivating Game Sense for Yourself: Making VLMs Gaming Experts Wenxuan Lu Jiangyang He Zhanqiu Zhang Yiwen Guo Tianning Zang 42 0 0 27 Mar 2025
Optimal Transport Adapter Tuning for Bridging Modality Gaps in Few-Shot Remote Sensing Scene Classification Zhong Ji Ci Liu Jingren Liu Chen Tang Yanwei Pang X. Li OT 49 0 0 19 Mar 2025
Open-World Skill Discovery from Unsegmented Demonstrations Jingwen Deng Zihao Wang Shaofei Cai Anji Liu Yitao Liang 36 1 0 11 Mar 2025
UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces Baining Zhao Jianjie Fang Zichao Dai Z. Wang Jirong Zha ... Chen Gao Y. Wang Jinqiang Cui Xinlei Chen Y. Li 48 2 0 08 Mar 2025
Digital Player: Evaluating Large Language Models based Human-like Agent in Games J. T. Wang Kai Wang Shaojie Lin Runze Wu Bihan Xu ... Zhipeng Hu Z. Fan Le Li Tangjie Lyu Changjie Fan LLMAG ELM AI4CE 53 1 0 28 Feb 2025
Complex LLM Planning via Automated Heuristics Discovery Hongyi Ling Shubham Parashar Sambhav Khurana Blake Olson Anwesha Basu Gaurangi Sinha Z. Tu James Caverlee Shuiwang Ji 95 2 0 26 Feb 2025
The Evolving Landscape of LLM- and VLM-Integrated Reinforcement Learning Sheila Schoepp Masoud Jafaripour Yingyue Cao Tianpei Yang Fatemeh Abdollahi Shadan Golestan Zahin Sufiyan Osmar Zaiane Matthew E. Taylor OffRL LM&Ro 46 0 0 24 Feb 2025
Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale Fan Zhou Zengzhi Wang Qian Liu Junlong Li Pengfei Liu ALM 93 14 0 17 Feb 2025
AgentStudio: A Toolkit for Building General Virtual Agents Longtao Zheng Zhiyuan Huang Zhenghai Xue Xinrun Wang Bo An Shuicheng Yan 75 14 0 17 Feb 2025
EvoAgent: Agent Autonomous Evolution with Continual World Model for Long-Horizon Tasks Tongtong Feng X. Wang Zekai Zhou Ren Wang Yuwei Zhan Guangyao Li Qing Li Wenwu Zhu LM&Ro 61 0 0 09 Feb 2025
CueTip: An Interactive and Explainable Physics-aware Pool Assistant Sean Memery Kevin Denamganai Jiaxin Zhang Zehai Tu Yiwen Guo Kartic Subr LRM 35 0 0 30 Jan 2025
MLVU: Benchmarking Multi-task Long Video Understanding Junjie Zhou Yan Shu Bo Zhao Boya Wu Zhengyang Liang ... Xi Yang Y. Xiong Bo Zhang Tiejun Huang Zheng Liu VLM 56 11 0 03 Jan 2025
Plancraft: an evaluation dataset for planning with LLM agents Gautier Dagan Frank Keller A. Lascarides LLMAG 29 0 0 31 Dec 2024
Multi-Modal Grounded Planning and Efficient Replanning For Learning Embodied Agents with A Few Examples Taewoong Kim Byeonghwi Kim Jonghyun Choi LLMAG LM&Ro 49 1 0 23 Dec 2024
EscapeBench: Pushing Language Models to Think Outside the Box Cheng Qian Peixuan Han Qinyu Luo Bingxiang He X. Chen ... Jiarui Yao Xiaocheng Yang Denghui Zhang Yunzhu Li Heng Ji LLMAG LRM 80 3 0 18 Dec 2024
RL-LLM-DT: An Automatic Decision Tree Generation Method Based on RL Evaluation and LLM Enhancement Junjie Lin Jian Zhao Lin Liu Yue Deng Youpeng Zhao Lanxiao Huang Xia Lin Wengang Zhou H. Li 74 0 0 16 Dec 2024
Reinforcement Learning from Wild Animal Videos Elliot Chane-Sane Constant Roux O. Stasse Nicolas Mansard 82 0 0 05 Dec 2024
STEVE-Audio: Expanding the Goal Conditioning Modalities of Embodied Agents in Minecraft Nicholas Lenzen Amogh Raut Andrew Melnik VGen 66 0 0 01 Dec 2024
APT: Architectural Planning and Text-to-Blueprint Construction Using Large Language Models for Open-World Agents Jun Yu Chen Tao Gao LM&Ro LLMAG 73 1 0 26 Nov 2024
From Laws to Motivation: Guiding Exploration through Law-Based Reasoning and Rewards Ziyu Chen Zhiqing Xiao Xinbei Jiang Junbo Zhao 67 0 0 24 Nov 2024
Towards Full Delegation: Designing Ideal Agentic Behaviors for Travel Planning Song Jiang Da JU Andrew Cohen Sasha Mitts Aaron Foss Justine T Kao Xian Li Yuandong Tian 57 2 0 21 Nov 2024
BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games Davide Paglieri Bartłomiej Cupiał Samuel Coward Ulyana Piterbarg Maciej Wolczyk ... Lerrel Pinto Rob Fergus Jakob Foerster Jack Parker-Holder Tim Rocktaschel LLMAG LRM 101 10 0 20 Nov 2024
AutoGameUI: Constructing High-Fidelity Game UIs via Multimodal Learning and Interactive Web-Based Tool Zhongliang Tang Mengchen Tan Fei Xia Qingrong Cheng Hao Jiang Y. Zhang 26 0 0 06 Nov 2024
LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulation Bowen Li Zhaoyu Li Qiwei Du Jinqi Luo Wenshan Wang ... Katia P. Sycara Pradeep Kumar Ravikumar Alexander G. Gray X. Si Sebastian A. Scherer AI4CE LRM 74 2 0 01 Nov 2024
A Systematic Review of NeurIPS Dataset Management Practices Yiwei Wu Leah Ajmani Shayne Longpre Hanlin Li 39 0 0 31 Oct 2024
Project Sid: Many-agent simulations toward AI civilization Altera. AL Andrew Ahn Nic Becker Stephanie Carroll Nico Christie ... Shuying Luo Peter Y Wang Mathew Willows Feitong Yang Guangyu Robert Yang LLMAG LM&Ro AI4CE 54 12 0 31 Oct 2024
Teaching Embodied Reinforcement Learning Agents: Informativeness and Diversity of Language Use Jiajun Xi Yinong He Jianing Yang Yinpei Dai Joyce Chai LM&Ro 22 2 0 31 Oct 2024
Online Intrinsic Rewards for Decision Making Agents from Large Language Model Feedback Qinqing Zheng Mikael Henaff Amy Zhang Aditya Grover Brandon Amos LLMAG OffRL 29 3 0 30 Oct 2024
AutoGLM: Autonomous Foundation Agents for GUIs Xiao Liu Bo Qin Dongzhu Liang Guang Dong Hanyu Lai ... Yujia Wang Y. Xu Zehan Qi Yuxiao Dong Jie Tang LLMAG 48 11 0 28 Oct 2024
OSCAR: Operating System Control via State-Aware Reasoning and Re-Planning Xiaoqiang Wang Bang Liu LLMAG LM&Ro LRM 31 6 0 24 Oct 2024
Foundation Models for Rapid Autonomy Validation Alec Farid Peter Schleede Aaron Huang Christoffer Heckman 32 0 0 22 Oct 2024
Task-oriented Robotic Manipulation with Vision Language Models Nurhan Bulus Guran Hanchi Ren Jingjing Deng Xianghua Xie 19 3 0 21 Oct 2024
A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learning Shengjie Sun Runze Liu Jiafei Lyu J. Yang L. Zhang Xiu Li LRM 19 7 0 18 Oct 2024
MarineFormer: A Transformer-based Navigation Policy Model for Collision Avoidance in Marine Environment Ehsan Kazemi Iman Soltani 49 0 0 17 Oct 2024
Instruction-Driven Game Engine: A Poker Case Study Hongqiu Wu Xingyuan Liu Yan Wang Hai Zhao 25 2 0 17 Oct 2024
EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment Chen Gao Baining Zhao Weichen Zhang Jinzhu Mao Jun Zhang ... Jianjie Fang Zile Zhou Jinqiang Cui X. Chen Yong Li LM&Ro 35 10 0 12 Oct 2024
Automated Rewards via LLM-Generated Progress Functions Vishnu Sarukkai Brennan Shacklett Zander Majercik Kush S. Bhatia Christopher Ré Kayvon Fatahalian 26 1 0 11 Oct 2024
WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents Siyu Zhou Tianyi Zhou Yijun Yang Guodong Long Deheng Ye Jing Jiang Chengqi Zhang LLMAG LM&Ro 17 0 0 09 Oct 2024
Validation of the Scientific Literature via Chemputation Augmented by Large Language Models Sebastian Pagel Michael Jirasek Leroy Cronin 20 0 0 08 Oct 2024
Open-World Reinforcement Learning over Long Short-Term Imagination Jiajian Li Q. Wang Yunbo Wang Xin Jin Yang Li Wenjun Zeng Xiaokang Yang OCL VLM 47 1 0 04 Oct 2024
Learning to Build by Building Your Own Instructions Aaron Walsman Muru Zhang Adam Fishman Ali Farhadi Dieter Fox 18 0 0 01 Oct 2024
A Survey on Complex Tasks for Goal-Directed Interactive Agents Mareike Hartmann Alexander Koller LM&Ro LLMAG 32 0 0 27 Sep 2024