Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
All Papers
0 / 0 papers shown
Home
Papers
2206.08853
Cited By
v1
v2 (latest)
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Neural Information Processing Systems (NeurIPS), 2022
17 June 2022
Linxi Fan
Guanzhi Wang
Yunfan Jiang
Ajay Mandlekar
Yuncong Yang
Haoyi Zhu
Andrew Tang
De-An Huang
Yuke Zhu
Anima Anandkumar
LM&Ro
Re-assign community
ArXiv (abs)
PDF
HTML
HuggingFace (1 upvotes)
Papers citing
"MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge"
50 / 349 papers shown
Towards Full Delegation: Designing Ideal Agentic Behaviors for Travel Planning
Song Jiang
Da JU
Andrew Cohen
Sasha Mitts
Aaron Foss
Justine T Kao
Xian Li
Yuandong Tian
356
5
0
21 Nov 2024
Understanding World or Predicting Future? A Comprehensive Survey of World Models
ACM Computing Surveys (ACM CSUR), 2024
Jingtao Ding
Yunke Zhang
Yu Shang
Yuheng Zhang
Zefang Zong
...
Fengli Xu
Yong Li
Chen Gao
Fengli Xu
Yong Li
VGen
SyDa
517
74
0
21 Nov 2024
BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games
International Conference on Learning Representations (ICLR), 2024
Davide Paglieri
Bartłomiej Cupiał
Samuel Coward
Ulyana Piterbarg
Maciej Wolczyk
...
Lerrel Pinto
Rob Fergus
Jakob Foerster
Jack Parker-Holder
Tim Rocktaschel
LLMAG
LRM
578
68
0
20 Nov 2024
AutoGameUI: Constructing High-Fidelity Game UIs via Multimodal Learning and Interactive Web-Based Tool
Zhongliang Tang
Mengchen Tan
Fei Xia
Qingrong Cheng
Hao Jiang
Yujiao Shi
164
0
0
06 Nov 2024
LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulation
Neural Information Processing Systems (NeurIPS), 2024
Bowen Li
Zhaoyu Li
Qiwei Du
Jinqi Luo
Wenshan Wang
...
Katia Sycara
Pradeep Kumar Ravikumar
Alexander G. Gray
X. Si
Sebastian A. Scherer
AI4CE
LRM
464
13
0
01 Nov 2024
A Systematic Review of NeurIPS Dataset Management Practices
Neural Information Processing Systems (NeurIPS), 2024
Yiwei Wu
Leah Ajmani
Shayne Longpre
Hanlin Li
236
0
0
31 Oct 2024
Project Sid: Many-agent simulations toward AI civilization
Altera. AL
Andrew Ahn
Nic Becker
Stephanie Carroll
Nico Christie
...
Shuying Luo
Peter Y Wang
Mathew Willows
Feitong Yang
Guangyu Robert Yang
LLMAG
LM&Ro
AI4CE
370
30
0
31 Oct 2024
Teaching Embodied Reinforcement Learning Agents: Informativeness and Diversity of Language Use
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Jiajun Xi
Yinong He
Jianing Yang
Yinpei Dai
Joyce Chai
LM&Ro
293
9
0
31 Oct 2024
Online Intrinsic Rewards for Decision Making Agents from Large Language Model Feedback
Qinqing Zheng
Mikael Henaff
Amy Zhang
Aditya Grover
Brandon Amos
LLMAG
OffRL
498
8
0
30 Oct 2024
AutoGLM: Autonomous Foundation Agents for GUIs
Xiao Liu
Bo Qin
Dongzhu Liang
Guang Dong
Hanyu Lai
...
Yujia Wang
Yongjun Xu
Zehan Qi
Yuxiao Dong
Jie Tang
LLMAG
291
47
0
28 Oct 2024
OSCAR: Operating System Control via State-Aware Reasoning and Re-Planning
International Conference on Learning Representations (ICLR), 2024
Xiaoqiang Wang
Bang Liu
LLMAG
LM&Ro
LRM
299
23
0
24 Oct 2024
Foundation Models for Rapid Autonomy Validation
IEEE International Conference on Robotics and Automation (ICRA), 2024
Alec Farid
Peter Schleede
Aaron Huang
Christoffer Heckman
370
0
0
22 Oct 2024
Task-oriented Robotic Manipulation with Vision Language Models
Nurhan Bulus Guran
Hanchi Ren
Jingjing Deng
Xianghua Xie
375
5
0
21 Oct 2024
A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learning
Knowledge-Based Systems (KBS), 2024
Shengjie Sun
Runze Liu
Jiafei Lyu
J. Yang
L. Zhang
Xiu Li
LRM
235
19
0
18 Oct 2024
Instruction-Driven Game Engine: A Poker Case Study
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Hongqiu Wu
Xingyuan Liu
Yan Wang
Hai Zhao
201
4
0
17 Oct 2024
MarineFormer: A Spatio-Temporal Attention Model for USV Navigation in Dynamic Marine Environments
Ehsan Kazemi
Iman Soltani
Iman Soltani
1.0K
0
0
17 Oct 2024
EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment
Chen Gao
Baining Zhao
Weichen Zhang
Jinzhu Mao
Jun Zhang
...
Jianjie Fang
Zile Zhou
Jinqiang Cui
Xinyu Chen
Yong Li
LM&Ro
239
26
0
12 Oct 2024
Automated Rewards via LLM-Generated Progress Functions
Vishnu Sarukkai
Brennan Shacklett
Zander Majercik
Kush S. Bhatia
Christopher Ré
Kayvon Fatahalian
265
3
0
11 Oct 2024
WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents
Siyu Zhou
Tianyi Zhou
Yijun Yang
Guodong Long
Deheng Ye
Jing Jiang
Chengqi Zhang
LLMAG
LM&Ro
277
11
0
09 Oct 2024
Validation of the Scientific Literature via Chemputation Augmented by Large Language Models
Sebastian Pagel
Michael Jirasek
Leroy Cronin
106
2
0
08 Oct 2024
Open-World Reinforcement Learning over Long Short-Term Imagination
International Conference on Learning Representations (ICLR), 2024
Jiajian Li
Q. Wang
Yunbo Wang
Xin Jin
Yang Li
Wenjun Zeng
Xiaokang Yang
OCL
VLM
362
10
0
04 Oct 2024
Learning to Build by Building Your Own Instructions
European Conference on Computer Vision (ECCV), 2024
Aaron Walsman
Muru Zhang
Adam Fishman
Ali Farhadi
Dieter Fox
184
1
0
01 Oct 2024
A Survey on Complex Tasks for Goal-Directed Interactive Agents
Mareike Hartmann
Alexander Koller
LM&Ro
LLMAG
293
1
0
27 Sep 2024
CLSP: High-Fidelity Contrastive Language-State Pre-training for Agent State Representation
Fuxian Huang
Tao Gui
Shaopeng Zhai
Jie Wang
Tianyi Zhang
Haoran Zhang
Ming Zhou
Yu Liu
Yu Qiao
CLIP
AI4TS
201
0
0
24 Sep 2024
Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scale
Neural Information Processing Systems (NeurIPS), 2024
Tianyue Ou
Frank F. Xu
Aman Madaan
J. Liu
Robert Lo
Abishek Sridhar
Sudipta Sengupta
Dan Roth
Graham Neubig
Shuyan Zhou
OffRL
246
30
0
24 Sep 2024
A Survey on Multimodal Benchmarks: In the Era of Large AI Models
Lin Li
Guikun Chen
Hanrong Shi
Jun Xiao
Long Chen
343
23
0
21 Sep 2024
LASP: Surveying the State-of-the-Art in Large Language Model-Assisted AI Planning
Haoming Li
Zhaoliang Chen
Jonathan Zhang
Fei Liu
LM&Ro
LLMAG
LRM
233
10
0
03 Sep 2024
EPO: Hierarchical LLM Agents with Environment Preference Optimization
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Qi Zhao
Haotian Fu
Chen Sun
George Konidaris
284
23
0
28 Aug 2024
VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agents
Xiao-Yang Liu
Tianjie Zhang
Yu Gu
Iat Long Iong
Yifan Xu
...
Zhengxiao Du
Chan Hee Song
Yu Su
Yuxiao Dong
Jie Tang
VLM
LLMAG
252
65
0
12 Aug 2024
Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks
Neural Information Processing Systems (NeurIPS), 2024
Zaijing Li
Yuquan Xie
Rui Shao
Gongwei Chen
Dongmei Jiang
Liqiang Nie
389
59
0
07 Aug 2024
Visual Grounding for Object-Level Generalization in Reinforcement Learning
European Conference on Computer Vision (ECCV), 2024
Haobin Jiang
Zongqing Lu
LM&Ro
229
3
0
04 Aug 2024
PianoMime: Learning a Generalist, Dexterous Piano Player from Internet Demonstrations
Cheng Qian
Julen Urain
Kevin Zakka
Jan Peters
159
10
0
25 Jul 2024
Adapt2Reward: Adapting Video-Language Models to Generalizable Robotic Rewards via Failure Prompts
Yanting Yang
Minghao Chen
Qibo Qiu
Jiahao Wu
Wenxiao Wang
Binbin Lin
Ziyu Guan
Xiaofei He
LM&Ro
216
4
0
20 Jul 2024
GRUtopia: Dream General Robots in a City at Scale
Hanqing Wang
Jiahe Chen
Wensi Huang
Qingwei Ben
Tai Wang
...
Ying Zhao
Zhongying Tu
Yu Qiao
Dahua Lin
Jiangmiao Pang
LM&Ro
VGen
329
43
0
15 Jul 2024
Instruction Following with Goal-Conditioned Reinforcement Learning in Virtual Environments
Zoya Volovikova
A. Skrynnik
Petr Kuderov
Aleksandr I. Panov
LLMAG
LM&Ro
289
3
0
12 Jul 2024
IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents
Shrestha Mohanty
Negar Arabzadeh
Andrea Tupini
Yuxuan Sun
Alexey Skrynnik
Artem Zholus
Marc-Alexandre Côté
Julia Kiseleva
269
0
0
12 Jul 2024
Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacy
Zhenyu Guan
Xiangyu Kong
Fangwei Zhong
Yizhou Wang
230
25
0
09 Jul 2024
Craftium: Bridging Flexibility and Efficiency for Rich 3D Single- and Multi-Agent Environments
Mikel Malagón
Josu Ceberio
Jose A. Lozano
216
0
0
04 Jul 2024
Multi-State-Action Tokenisation in Decision Transformers for Multi-Discrete Action Spaces
Perusha Moodley
Pramod S. Kaushik
Dhillu Thambi
Mark Trovinger
Praveen Paruchuri
Xia Hong
Benjamin Rosman
318
0
0
01 Jul 2024
Disentangled Representations for Causal Cognition
Filippo Torresan
Manuel Baltieri
CML
260
4
0
30 Jun 2024
OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents
Zihao Wang
Shaofei Cai
Zhancun Mu
Haowei Lin
Ceyao Zhang
Xuejie Liu
Qing Li
Hoang Trung-Dung
Xiaojian Ma
Yitao Liang
LM&Ro
304
25
0
27 Jun 2024
Multimodal foundation world models for generalist embodied agents
Pietro Mazzaglia
Tim Verbelen
Bart Dhoedt
Rameswar Panda
Sai Rajeswar
OffRL
LM&Ro
257
1
0
26 Jun 2024
DKPROMPT: Domain Knowledge Prompting Vision-Language Models for Open-World Planning
Xiaohan Zhang
Zainab Altaweel
Yohei Hayamizu
Yan Ding
S. Amiri
Hao Yang
Andy Kaminski
Chad Esselink
Shiqi Zhang
VLM
LM&Ro
300
14
0
25 Jun 2024
QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worlds
Ye Wang
Yuting Mei
Sipeng Zheng
Qin Jin
LRM
326
9
0
24 Jun 2024
LangSuitE: Planning, Controlling and Interacting with Large Language Models in Embodied Text Environments
Zixia Jia
Minghua Yi
Baichen Tong
Song-Chun Zhu
Zilong Zheng
LM&Ro
LLMAG
186
7
0
24 Jun 2024
Do Multimodal Foundation Models Understand Enterprise Workflows? A Benchmark for Business Process Management Tasks
Neural Information Processing Systems (NeurIPS), 2024
Michael Wornow
A. Narayan
Ben T Viggiano
Ishan S. Khare
Tathagat Verma
...
Joshua Martinez
Vardhan Agrawal
Althea Hudson
N. Shah
Christopher Ré
228
10
0
19 Jun 2024
STEVE Series: Step-by-Step Construction of Agent Systems in Minecraft
Zhonghan Zhao
Wenhao Chai
Xuan Wang
Ke Ma
Kewei Chen
Dongxu Guo
Tian Ye
Yanting Zhang
Hongwei Wang
Gaoang Wang
LLMAG
LM&Ro
156
7
0
17 Jun 2024
DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents
Peter Alexander Jansen
Marc-Alexandre Côté
Tushar Khot
Erin Bransom
Bhavana Dalvi Mishra
Bodhisattwa Prasad Majumder
Oyvind Tafjord
Peter Clark
LLMAG
251
46
0
10 Jun 2024
Online Adaptation for Enhancing Imitation Learning Policies
Federico Malato
Ville Hautamaki
OnRL
194
4
0
07 Jun 2024
AgentGym: Evolving Large Language Model-based Agents across Diverse Environments
Zhiheng Xi
Yiwen Ding
Wenxiang Chen
Boyang Hong
Honglin Guo
...
Qi Zhang
Xipeng Qiu
Xuanjing Huang
Zuxuan Wu
Yu-Gang Jiang
LLMAG
LM&Ro
278
66
0
06 Jun 2024
Previous
1
2
3
4
5
6
7
Next
