ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2206.08853
  4. Cited By
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale
  Knowledge
v1v2 (latest)

MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge

Neural Information Processing Systems (NeurIPS), 2022
17 June 2022
Linxi Fan
Guanzhi Wang
Yunfan Jiang
Ajay Mandlekar
Yuncong Yang
Haoyi Zhu
Andrew Tang
De-An Huang
Yuke Zhu
Anima Anandkumar
    LM&Ro
ArXiv (abs)PDFHTMLHuggingFace (1 upvotes)

Papers citing "MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge"

50 / 349 papers shown
The Embodied World Model Based on LLM with Visual Information and
  Prediction-Oriented Prompts
The Embodied World Model Based on LLM with Visual Information and Prediction-Oriented Prompts
Wakana Haijima
Kou Nakakubo
Masahiro Suzuki
Yutaka Matsuo
162
1
0
02 Jun 2024
Towards Rationality in Language and Multimodal Agents: A Survey
Towards Rationality in Language and Multimodal Agents: A Survey
Bowen Jiang
Yangxinyu Xie
Xiaomeng Wang
Yuan Yuan
Camillo J Taylor
Tanwi Mallick
Weijie J. Su
Camillo J. Taylor
Tanwi Mallick
LLMAG
335
4
0
01 Jun 2024
Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics
Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics
Minttu Alakuijala
Reginald McLean
Isaac Woungang
Nariman Farsad
Samuel Kaski
Pekka Marttinen
Kai Yuan
LM&Ro
328
9
0
30 May 2024
Position: Foundation Agents as the Paradigm Shift for Decision Making
Position: Foundation Agents as the Paradigm Shift for Decision Making
Xiaoqian Liu
Xingzhou Lou
Jianbin Jiao
Junge Zhang
OffRLLLMAG
400
9
0
27 May 2024
LARM: Large Auto-Regressive Model for Long-Horizon Embodied Intelligence
LARM: Large Auto-Regressive Model for Long-Horizon Embodied Intelligence
Zhuoling Li
Xiaohan Li
Zhenhua Xu
Sernam Lim
Hengshuang Zhao
LM&Ro
418
9
0
27 May 2024
Luban: Building Open-Ended Creative Agents via Autonomous Embodied
  Verification
Luban: Building Open-Ended Creative Agents via Autonomous Embodied Verification
Yuxuan Guo
Shaohui Peng
Jiaming Guo
Di Huang
Xishan Zhang
...
Zihao Zhang
Zidong Du
Qi Guo
Xingui Hu
Yunji Chen
196
5
0
24 May 2024
TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction
TRANSIC: Sim-to-Real Policy Transfer by Learning from Online CorrectionConference on Robot Learning (CoRL), 2024
Yunfan Jiang
Chen Wang
Ruohan Zhang
Jiajun Wu
Fei-Fei Li
OnRL
287
57
0
16 May 2024
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via
  Reinforcement Learning
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2024
Yuexiang Zhai
Hao Bai
Zipeng Lin
Jiayi Pan
Shengbang Tong
...
Alane Suhr
Saining Xie
Yann LeCun
Yi-An Ma
Sergey Levine
LLMAGLRM
354
132
0
16 May 2024
Natural Language Can Help Bridge the Sim2Real Gap
Natural Language Can Help Bridge the Sim2Real Gap
Albert Yu
Adeline Foote
Raymond J. Mooney
Roberto Martín-Martín
LM&Ro
396
21
0
16 May 2024
Imitation Learning: A Survey of Learning Methods, Environments and
  Metrics
Imitation Learning: A Survey of Learning Methods, Environments and Metrics
Nathan Gavenski
Odinaldo Rodrigues
Michael Luck
279
167
0
30 Apr 2024
MMAC-Copilot: Multi-modal Agent Collaboration Operating Copilot
MMAC-Copilot: Multi-modal Agent Collaboration Operating Copilot
Zirui Song
Yaohang Li
Meng Fang
Zhenhao Chen
Zecheng Shi
Yuan Huang
Ling-Hao Chen
Xiuying Chen
Ling Chen
LLMAG
408
8
0
28 Apr 2024
Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual
  and Action Representations
Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representations
Puhao Li
Tengyu Liu
Yuyang Li
Muzhi Han
Haoran Geng
Shu Wang
Yixin Zhu
Song-Chun Zhu
Siyuan Huang
263
27
0
26 Apr 2024
Benchmarking Mobile Device Control Agents across Diverse Configurations
Benchmarking Mobile Device Control Agents across Diverse Configurations
Juyong Lee
Taywon Min
Minyong An
Dongyoon Hahm
Kimin Lee
Changyeon Kim
Kimin Lee
360
29
0
25 Apr 2024
DreamCraft: Text-Guided Generation of Functional 3D Environments in
  Minecraft
DreamCraft: Text-Guided Generation of Functional 3D Environments in Minecraft
Sam Earle
Filippos Kokkinos
Yuhe Nie
Julian Togelius
Roberta Raileanu
236
12
0
23 Apr 2024
Do We Really Need a Complex Agent System? Distill Embodied Agent into a
  Single Model
Do We Really Need a Complex Agent System? Distill Embodied Agent into a Single Model
Zhonghan Zhao
Ke Ma
Wenhao Chai
Xuan Wang
Kewei Chen
Dongxu Guo
Yanting Zhang
Hongwei Wang
Gaoang Wang
218
21
0
06 Apr 2024
Evolving Agents: Interactive Simulation of Dynamic and Diverse Human
  Personalities
Evolving Agents: Interactive Simulation of Dynamic and Diverse Human Personalities
Jiale Li
Jiayang Li
Jiahao Chen
Yifan Li
Shijie Wang
Hugo Zhou
Minjun Ye
Yunsheng Su
AI4CE
441
9
0
03 Apr 2024
A Survey on Large Language Model-Based Game Agents
A Survey on Large Language Model-Based Game Agents
Sihao Hu
Tiansheng Huang
Gaowen Liu
Ramana Rao Kompella
Gaowen Liu
Selim Furkan Tekin
Yichang Xu
Zachary Yahn
Ling Liu
AI4CELLMAGLM&RoLM&MA
679
107
0
02 Apr 2024
Instruction-Driven Game Engines on Large Language Models
Instruction-Driven Game Engines on Large Language Models
Hongqiu Wu
Xing-Chen Liu
Haizhen Zhao
Min Zhang
277
3
0
30 Mar 2024
MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of
  Large Language Models
MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language Models
Peng Ding
Jiading Fang
Peng Li
Kangrui Wang
Xiaochen Zhou
Mo Yu
Jing Li
Matthew R. Walter
Hongyuan Mei
RALMELM
252
9
0
29 Mar 2024
MineLand: Simulating Large-Scale Multi-Agent Interactions with Limited
  Multimodal Senses and Physical Needs
MineLand: Simulating Large-Scale Multi-Agent Interactions with Limited Multimodal Senses and Physical Needs
Xianhao Yu
Jiaqi Fu
Renjia Deng
Wenjuan Han
278
10
0
28 Mar 2024
Untangling Knots: Leveraging LLM for Error Resolution in Computational
  Notebooks
Untangling Knots: Leveraging LLM for Error Resolution in Computational Notebooks
Konstantin Grotov
Sergey Titov
Yaroslav Zharov
T. Bryksin
154
3
0
26 Mar 2024
AIOS: LLM Agent Operating System
AIOS: LLM Agent Operating System
Kai Mei
Zelong Li
Wujiang Xu
Qingfeng Lan
Haoyang Ling
Zelong Li
Shuyuan Xu
Ruosong Ye
Yingqiang Ge
Yongfeng Zhang
LLMAG
699
56
0
25 Mar 2024
Temporal-Spatial Object Relations Modeling for Vision-and-Language
  Navigation
Temporal-Spatial Object Relations Modeling for Vision-and-Language Navigation
Bowen Huang
Yanwei Zheng
Chuanlin Lan
Xinpeng Zhao
Yifei Zou
Dongxiao Yu
303
0
0
23 Mar 2024
MineDreamer: Learning to Follow Instructions via Chain-of-Imagination
  for Simulated-World Control
MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control
Enshen Zhou
Yiran Qin
Zhen-fei Yin
Yuzhou Huang
Ruimao Zhang
Lu Sheng
Yu Qiao
Jing Shao
LM&RoAI4CE
296
49
0
18 Mar 2024
EnvGen: Generating and Adapting Environments via LLMs for Training
  Embodied Agents
EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents
Abhaysinh Zala
Jaemin Cho
Han Lin
Jaehong Yoon
Mohit Bansal
271
24
0
18 Mar 2024
A Survey on Game Playing Agents and Large Models: Methods, Applications,
  and Challenges
A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges
Weishuai Zeng
Yuxin Wang
Chaoyi Xu
Haobin Jiang
Jiechuan Jiang
Zhiming Ding
Börje F. Karlsson
LM&RoLLMAG
389
29
0
15 Mar 2024
USimAgent: Large Language Models for Simulating Search Users
USimAgent: Large Language Models for Simulating Search UsersAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2024
Erhan Zhang
Xingzhu Wang
Peiyuan Gong
Yankai Lin
Jiaxin Mao
LLMAG
214
43
0
14 Mar 2024
Scaling Instructable Agents Across Many Simulated Worlds
Scaling Instructable Agents Across Many Simulated Worlds
Sima Team
Maria Abi Raad
Arun Ahuja
Catarina Barros
F. Besse
...
Daan Wierstra
Duncan Williams
Nathaniel Wong
Sarah York
Nick Young
LM&Ro
409
66
0
13 Mar 2024
Hierarchical Auto-Organizing System for Open-Ended Multi-Agent
  Navigation
Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigation
Zhonghan Zhao
Kewei Chen
Dongxu Guo
Wenhao Chai
Tianbo Ye
Yanting Zhang
Gaoang Wang
298
26
0
13 Mar 2024
Online Continual Learning For Interactive Instruction Following Agents
Online Continual Learning For Interactive Instruction Following AgentsInternational Conference on Learning Representations (ICLR), 2024
Byeonghwi Kim
Minhyuk Seo
Jonghyun Choi
CLLLM&Ro
318
21
0
12 Mar 2024
OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied
  Instruction Following
OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied Instruction Following
Haochen Shi
Zhiyuan Sun
Xingdi Yuan
Marc-Alexandre Côté
Bang Liu
LLMAG
221
17
0
05 Mar 2024
In-Memory Learning: A Declarative Learning Framework for Large Language
  Models
In-Memory Learning: A Declarative Learning Framework for Large Language Models
Bo Wang
Tianxiang Sun
Hang Yan
Siyin Wang
Qingyuan Cheng
Xipeng Qiu
LLMAG
175
1
0
05 Mar 2024
AutoAttacker: A Large Language Model Guided System to Implement
  Automatic Cyber-attacks
AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks
Jiacen Xu
Jack W. Stokes
Geoff McDonald
Xuesong Bai
David Marshall
Siyue Wang
Adith Swaminathan
Zhou Li
268
99
0
02 Mar 2024
RL-GPT: Integrating Reinforcement Learning and Code-as-policy
RL-GPT: Integrating Reinforcement Learning and Code-as-policy
Shaoteng Liu
Haoqi Yuan
Minda Hu
Yanwei Li
Yukang Chen
Shu Liu
Zongqing Lu
Jiaya Jia
LLMAG
273
26
0
29 Feb 2024
On the Challenges and Opportunities in Generative AI
On the Challenges and Opportunities in Generative AI
Laura Manduchi
Kushagra Pandey
Kushagra Pandey
Robert Bamler
Sina Daubener
...
Yixin Wang
F. Wenzel
Frank Wood
Stephan Mandt
Vincent Fortuin
758
40
0
28 Feb 2024
Empowering Large Language Model Agents through Action Learning
Empowering Large Language Model Agents through Action Learning
Haiteng Zhao
Chang Ma
Guoyin Wang
Jing Su
Lingpeng Kong
Jingjing Xu
Zhi-Hong Deng
Hongxia Yang
LM&RoLLMAG
205
16
0
24 Feb 2024
MORE-3S:Multimodal-based Offline Reinforcement Learning with Shared
  Semantic Spaces
MORE-3S:Multimodal-based Offline Reinforcement Learning with Shared Semantic Spaces
Tianyu Zheng
Ge Zhang
Xingwei Qu
Ming Kuang
Stephen W. Huang
Zhaofeng He
OffRL
231
2
0
20 Feb 2024
GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via
  Game-Theoretic Evaluations
GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations
Jinhao Duan
Renming Zhang
James Diffenderfer
B. Kailkhura
Lichao Sun
Elias Stengel-Eskin
Mohit Bansal
Tianlong Chen
Kaidi Xu
ELMLRM
318
89
0
19 Feb 2024
AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous
  Systems
AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systems
Jiaying Lu
Bo Pan
Jieyi Chen
Yingchaojie Feng
Jingyuan Hu
Yuchen Peng
Wei Chen
183
24
0
14 Feb 2024
AQA-Bench: An Interactive Benchmark for Evaluating LLMs' Sequential Reasoning Ability
AQA-Bench: An Interactive Benchmark for Evaluating LLMs' Sequential Reasoning Ability
Siwei Yang
Bingchen Zhao
Cihang Xie
LRM
187
7
0
14 Feb 2024
Towards Unified Alignment Between Agents, Humans, and Environment
Towards Unified Alignment Between Agents, Humans, and Environment
Zonghan Yang
An Liu
Zijun Liu
Wenbing Huang
Fangzhou Xiong
...
Zhenhe Zhang
Ziyue Wang
Zhicheng Guo
Peng Li
Yang Liu
287
5
0
12 Feb 2024
OS-Copilot: Towards Generalist Computer Agents with Self-Improvement
OS-Copilot: Towards Generalist Computer Agents with Self-Improvement
Zhiyong Wu
Chengcheng Han
Zichen Ding
Zhenmin Weng
Zhoumianze Liu
Shunyu Yao
Tao Yu
Lingpeng Kong
LLMAGLM&Ro
807
146
0
12 Feb 2024
Code as Reward: Empowering Reinforcement Learning with VLMs
Code as Reward: Empowering Reinforcement Learning with VLMs
David Venuto
Sami Nur Islam
Martin Klissarov
Doina Precup
Sherry Yang
Ankit Anand
VLM
163
23
0
07 Feb 2024
S-Agents: Self-organizing Agents in Open-ended Environments
S-Agents: Self-organizing Agents in Open-ended Environments
Jia-Qing Chen
Yu-Gang Jiang
Jiachen Lu
Li Zhang
AIFinLLMAGLM&Ro
357
20
0
07 Feb 2024
Read to Play (R2-Play): Decision Transformer with Multimodal Game
  Instruction
Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction
Yonggang Jin
Ge Zhang
Hao Zhao
Tianyu Zheng
Jiawei Guo
Liuyu Xiang
Shawn Yue
Stephen W. Huang
Zhaofeng He
Jie Fu
OffRL
409
4
0
06 Feb 2024
RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model
  Feedback
RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model FeedbackInternational Conference on Machine Learning (ICML), 2024
Yufei Wang
Zhanyi Sun
Jesse Zhang
Zhou Xian
Erdem Biyik
David Held
Zackory M. Erickson
VLM
378
108
0
06 Feb 2024
Assessing the Impact of Distribution Shift on Reinforcement Learning
  Performance
Assessing the Impact of Distribution Shift on Reinforcement Learning Performance
Ted Fujimoto
Joshua Suetterlein
Samrat Chatterjee
A. Ganguly
OffRL
243
9
0
05 Feb 2024
Vision-Language Models Provide Promptable Representations for
  Reinforcement Learning
Vision-Language Models Provide Promptable Representations for Reinforcement Learning
William Chen
Oier Mees
Aviral Kumar
Sergey Levine
VLMLM&Ro
370
42
0
05 Feb 2024
Integration of cognitive tasks into artificial general intelligence test
  for large models
Integration of cognitive tasks into artificial general intelligence test for large models
Youzhi Qu
Chen Wei
Penghui Du
Wenxin Che
Chi Zhang
...
Bin Hu
Kai Du
Haiyan Wu
Jia Liu
Quanying Liu
ELM
175
12
0
04 Feb 2024
Point Cloud Matters: Rethinking the Impact of Different Observation
  Spaces on Robot Learning
Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learning
Haoyi Zhu
Yating Wang
Di Huang
Weicai Ye
Wanli Ouyang
Tong He
SSL3DPC
348
46
0
04 Feb 2024
Previous
1234567
Next