Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2206.08853
Cited By
v1
v2 (latest)
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Neural Information Processing Systems (NeurIPS), 2022
17 June 2022
Linxi Fan
Guanzhi Wang
Yunfan Jiang
Ajay Mandlekar
Yuncong Yang
Haoyi Zhu
Andrew Tang
De-An Huang
Yuke Zhu
Anima Anandkumar
LM&Ro
Re-assign community
ArXiv (abs)
PDF
HTML
HuggingFace (1 upvotes)
Papers citing
"MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge"
49 / 349 papers shown
Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback
Findings (Findings), 2023
Nikhil Mehta
Milagro Teruel
Patricio Figueroa Sanz
Xinwei Deng
Ahmed Hassan Awadallah
Julia Kiseleva
LLMAG
324
31
0
21 Apr 2023
LLM as A Robotic Brain: Unifying Egocentric Memory and Control
Jinjie Mai
Jun Chen
Bing Li
Guocheng Qian
Mohamed Elhoseiny
Guohao Li
LM&Ro
333
47
0
19 Apr 2023
Think Before You Act: Unified Policy for Interleaving Language Reasoning with Actions
Lina Mezghani
Piotr Bojanowski
Alahari Karteek
Sainbayar Sukhbaatar
LM&Ro
OffRL
LRM
208
12
0
18 Apr 2023
Grounding Classical Task Planners via Vision-Language Models
Xiaohan Zhang
Yan Ding
S. Amiri
Hao Yang
Andy Kaminski
Chad Esselink
Shiqi Zhang
200
26
0
17 Apr 2023
Language Instructed Reinforcement Learning for Human-AI Coordination
International Conference on Machine Learning (ICML), 2023
Hengyuan Hu
Dorsa Sadigh
LM&Ro
263
83
0
13 Apr 2023
Object-centric Inference for Language Conditioned Placement: A Foundation Model based Approach
International Conference on Advanced Robotics and Mechatronics (ICARM), 2023
Zhi-Wei Xu
Kechun Xu
Yue Wang
R. Xiong
OCL
177
4
0
06 Apr 2023
Chain-of-Thought Predictive Control
International Conference on Machine Learning (ICML), 2023
Zhiwei Jia
Vineet Thumuluri
Fangchen Liu
Ling-Hao Chen
Zhiao Huang
H. Su
LM&Ro
519
23
0
03 Apr 2023
Accelerating exploration and representation learning with offline pre-training
Bogdan Mazoure
Jake Bruce
Doina Precup
Rob Fergus
Ankit Anand
OffRL
265
7
0
31 Mar 2023
When Learning Is Out of Reach, Reset: Generalization in Autonomous Visuomotor Reinforcement Learning
Zichen Zhang
Luca Weihs
OffRL
215
5
0
30 Mar 2023
Language Models can Solve Computer Tasks
Neural Information Processing Systems (NeurIPS), 2023
Geunwoo Kim
Pierre Baldi
Alexander Shmakov
LLMAG
LM&Ro
564
463
0
30 Mar 2023
Skill Reinforcement Learning and Planning for Open-World Long-Horizon Tasks
Haoqi Yuan
Chi Zhang
Hongchen Wang
Feiyang Xie
Penglin Cai
Hao Dong
Zongqing Lu
LM&Ro
LLMAG
356
30
0
29 Mar 2023
Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition
Neural Information Processing Systems (NeurIPS), 2023
Stephanie Milani
Anssi Kanervisto
Karolis Ramanauskas
Sander Schulhoff
Brandon Houghton
...
Vinicius G. Goecks
Nicholas R. Waytowich
David Watkins
J. Miller
Rohin Shah
156
18
0
23 Mar 2023
Building artificial neural circuits for domain-general cognition: a primer on brain-inspired systems-level architecture
Jascha Achterberg
Danyal Akarca
Moataz Assem
Moritz P. Heimbach
D. Astle
John Duncan
AI4CE
128
5
0
21 Mar 2023
CLIP4MC: An RL-Friendly Vision-Language Model for Minecraft
European Conference on Computer Vision (ECCV), 2023
Haobin Jiang
Hao Luo
Ke Li
Junpeng Yue
Tiejun Huang
Zongqing Lu
VLM
190
9
0
19 Mar 2023
Vision-Language Models as Success Detectors
Yuqing Du
Ksenia Konyushkova
Misha Denil
A. Raju
Jessica Landon
Felix Hill
Nando de Freitas
Serkan Cabi
MLLM
LRM
276
114
0
13 Mar 2023
Foundation Models for Decision Making: Problems, Methods, and Opportunities
Sherry Yang
Ofir Nachum
Yilun Du
Jason W. Wei
Pieter Abbeel
Dale Schuurmans
LM&Ro
OffRL
LRM
AI4CE
393
211
0
07 Mar 2023
Cross-domain Random Pre-training with Prototypes for Reinforcement Learning
Xin Liu
Yaran Chen
Haoran Li
Boyu Li
Dong Zhao
SSL
523
13
0
11 Feb 2023
A Song of Ice and Fire: Analyzing Textual Autotelic Agents in ScienceWorld
Laetitia Teodorescu
Eric Yuan
Marc-Alexandre Côté
Pierre-Yves Oudeyer
353
1
0
10 Feb 2023
Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals
Neural Information Processing Systems (NeurIPS), 2023
Yue Wu
Yewen Fan
Paul Pu Liang
A. Azaria
Yuan-Fang Li
Tom Michael Mitchell
OffRL
260
54
0
09 Feb 2023
Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning
International Conference on Machine Learning (ICML), 2023
Thomas Carta
Clément Romac
Thomas Wolf
Sylvain Lamprier
Olivier Sigaud
Pierre-Yves Oudeyer
LM&Ro
LLMAG
385
237
0
06 Feb 2023
Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents
Zihao Wang
Shaofei Cai
Guanzhou Chen
Hoang Trung-Dung
Xiaojian Ma
Yitao Liang
LM&Ro
LLMAG
509
430
0
03 Feb 2023
Distilling Internet-Scale Vision-Language Models into Embodied Agents
International Conference on Machine Learning (ICML), 2023
T. Sumers
Kenneth Marino
Arun Ahuja
Rob Fergus
Ishita Dasgupta
LM&Ro
217
33
0
29 Jan 2023
Truth Machines: Synthesizing Veracity in AI Language Models
Ai & Society (AI & Society), 2023
Luke Munn
Liam Magee
Vanicka Arora
SyDa
HILM
97
50
0
28 Jan 2023
Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling
International Conference on Machine Learning (ICML), 2023
Kolby Nottingham
Prithviraj Ammanabrolu
Alane Suhr
Yejin Choi
Hannaneh Hajishirzi
Sameer Singh
Roy Fox
LLMAG
LM&Ro
250
105
0
28 Jan 2023
Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction
Computer Vision and Pattern Recognition (CVPR), 2023
Shaofei Cai
Zihao Wang
Xiaojian Ma
Hoang Trung-Dung
Yitao Liang
243
46
0
21 Jan 2023
Human-Timescale Adaptation in an Open-Ended Task Space
International Conference on Machine Learning (ICML), 2023
Adaptive Agent Team
Jakob Bauer
Kate Baumli
Satinder Baveja
Feryal M. P. Behbahani
...
Jakub Sygnowski
K. Tuyls
Sarah York
Alexander Zacherl
Lei Zhang
LM&Ro
OffRL
AI4CE
LRM
326
147
0
18 Jan 2023
Mastering Diverse Domains through World Models
Danijar Hafner
J. Pašukonis
Jimmy Ba
Timothy Lillicrap
353
854
0
10 Jan 2023
A Survey on Transformers in Reinforcement Learning
Wenzhe Li
Hao Luo
Zichuan Lin
Chongjie Zhang
Zongqing Lu
Deheng Ye
OffRL
MU
AI4CE
538
71
0
08 Jan 2023
On Transforming Reinforcement Learning by Transformer: The Development Trajectory
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Shengchao Hu
Li Shen
Ya Zhang
Yixin Chen
Dacheng Tao
OffRL
340
61
0
29 Dec 2022
On Realization of Intelligent Decision-Making in the Real World: A Foundation Decision Model Perspective
Ying Wen
Bo Liu
M. Zhou
Shufang Hou
Zhe Cao
Chenyang Le
Jingxiao Chen
Zheng Tian
Weinan Zhang
Jun Wang
AI4CE
221
12
0
24 Dec 2022
Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editing
Shengchao Liu
Weili Nie
Chengpeng Wang
Jiarui Lu
Zhuoran Qiao
Ling Liu
Jian Tang
Chaowei Xiao
Anima Anandkumar
277
226
0
21 Dec 2022
Powderworld: A Platform for Understanding Generalization via Rich Task Distributions
International Conference on Learning Representations (ICLR), 2022
Kevin Frans
Phillip Isola
OffRL
341
10
0
23 Nov 2022
Robotic Skill Acquisition via Instruction Augmentation with Vision-Language Models
Ted Xiao
Harris Chan
P. Sermanet
Ayzaan Wahid
Anthony Brohan
Karol Hausman
Sergey Levine
Jonathan Tompson
VLM
LM&Ro
433
77
0
21 Nov 2022
General Intelligence Requires Rethinking Exploration
Royal Society Open Science (RSOS), 2022
Minqi Jiang
Tim Rocktaschel
Edward Grefenstette
LRM
227
26
0
15 Nov 2022
Pretraining in Deep Reinforcement Learning: A Survey
Zhihui Xie
Zichuan Lin
Junyou Li
Shuai Li
Deheng Ye
OffRL
OnRL
AI4CE
223
30
0
08 Nov 2022
Dichotomy of Control: Separating What You Can Control from What You Cannot
International Conference on Learning Representations (ICLR), 2022
Mengjiao Yang
Dale Schuurmans
Pieter Abbeel
Ofir Nachum
OffRL
215
48
0
24 Oct 2022
Augmentative Topology Agents For Open-Ended Learning
Muhammad Umair Nasir
Michael Beukman
Steven D. James
C. Cleghorn
213
3
0
20 Oct 2022
WILD-SCAV: Benchmarking FPS Gaming AI on Unity3D-based Environments
Xi Chen
Tianyuan Shi
Qing Zhao
Yuchen Sun
Yunfei Gao
Xiangjun Wang
135
5
0
14 Oct 2022
VIMA: General Robot Manipulation with Multimodal Prompts
Yunfan Jiang
Agrim Gupta
Zichen Zhang
Guanzhi Wang
Yongqiang Dou
Yanjun Chen
Li Fei-Fei
Anima Anandkumar
Yuke Zhu
Linxi Fan
LM&Ro
386
475
0
06 Oct 2022
Neural-Symbolic Recursive Machine for Systematic Generalization
International Conference on Learning Representations (ICLR), 2022
Qing Li
Yixin Zhu
Yitao Liang
Ying Nian Wu
Song-Chun Zhu
Siyuan Huang
NAI
358
14
0
04 Oct 2022
Pretraining the Vision Transformer using self-supervised methods for vision based Deep Reinforcement Learning
European Conference on Artificial Intelligence (ECAI), 2022
Manuel Goulão
Arlindo L. Oliveira
ViT
246
7
0
22 Sep 2022
Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos
Neural Information Processing Systems (NeurIPS), 2022
Bowen Baker
Ilge Akkaya
Peter Zhokhov
Joost Huizinga
Jie Tang
Adrien Ecoffet
Brandon Houghton
Raul Sampedro
Jeff Clune
OffRL
474
365
0
23 Jun 2022
NovelCraft: A Dataset for Novelty Detection and Discovery in Open Worlds
Patrick Feeney
Sarah Schneider
Panagiotis Lymperopoulos
Liping Liu
matthias. scheutz
Michael C. Hughes Dept. of Computer Science
189
7
0
23 Jun 2022
Reincarnating Reinforcement Learning: Reusing Prior Computation to Accelerate Progress
Neural Information Processing Systems (NeurIPS), 2022
Rishabh Agarwal
Max Schwarzer
Pablo Samuel Castro
Rameswar Panda
Marc G. Bellemare
OffRL
OnRL
363
82
0
03 Jun 2022
Language and Culture Internalisation for Human-Like Autotelic AI
Cédric Colas
Tristan Karch
Clément Moulin-Frier
Pierre-Yves Oudeyer
LM&Ro
239
34
0
02 Jun 2022
Geodesic Multi-Modal Mixup for Robust Fine-Tuning
Neural Information Processing Systems (NeurIPS), 2022
Changdae Oh
Junhyuk So
Hoyoon Byun
Yongtaek Lim
Minchul Shin
Jong-June Jeon
Kyungwoo Song
449
39
0
08 Mar 2022
CLIP-Adapter: Better Vision-Language Models with Feature Adapters
International Journal of Computer Vision (IJCV), 2021
Shiyang Feng
Shijie Geng
Renrui Zhang
Teli Ma
Rongyao Fang
Zelong Li
Jiaming Song
Yu Qiao
VLM
CLIP
1.2K
1,431
0
09 Oct 2021
robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
Yuke Zhu
J. Wong
Ajay Mandlekar
Roberto Martín-Martín
Abhishek Joshi
Soroush Nasiriany
Yifeng Zhu
Soroush Nasiriany
Yifeng Zhu
536
565
0
25 Sep 2020
The Multi-Agent Reinforcement Learning in MalmÖ (MARLÖ) Competition
Diego Perez-Liebana
Katja Hofmann
Sharada Mohanty
Noburu Kuno
André Kramer
Sam Devlin
Raluca D. Gaina
Daniel Ionita
LRM
268
37
0
23 Jan 2019
Previous
1
2
3
4
5
6
7
