Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2202.01771
Cited By
v1
v2
v3
v4 (latest)
Pre-Trained Language Models for Interactive Decision-Making
Neural Information Processing Systems (NeurIPS), 2022
3 February 2022
Shuang Li
Xavier Puig
Chris Paxton
Yilun Du
Clinton Jia Wang
Linxi Fan
Tao Chen
De-An Huang
Ekin Akyürek
Anima Anandkumar
Jacob Andreas
Igor Mordatch
Antonio Torralba
Yuke Zhu
LM&Ro
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Pre-Trained Language Models for Interactive Decision-Making"
50 / 206 papers shown
Multimodal Web Navigation with Instruction-Finetuned Foundation Models
International Conference on Learning Representations (ICLR), 2023
Hiroki Furuta
Kuang-Huei Lee
Ofir Nachum
Yutaka Matsuo
Aleksandra Faust
S. Gu
Izzeddin Gur
LM&Ro
416
142
0
19 May 2023
Introspective Tips: Large Language Model for In-Context Decision Making
Liting Chen
Lu Wang
Hang Dong
Yali Du
Jie Yan
...
Lu Wang
Si Qin
Saravan Rajmohan
Qingwei Lin
Dongmei Zhang
LLMAG
LRM
265
32
0
19 May 2023
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings
Neural Information Processing Systems (NeurIPS), 2023
Shibo Hao
Tianyang Liu
Zhen Wang
Zhiting Hu
RALM
LLMAG
604
239
0
19 May 2023
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
Siyuan Huang
Zhengkai Jiang
Hao Dong
Yu Qiao
Shiyang Feng
Jiaming Song
LM&Ro
268
136
0
18 May 2023
Semantically Aligned Task Decomposition in Multi-Agent Reinforcement Learning
Wenhao Li
Dan Qiao
Baoxiang Wang
Xiangfeng Wang
Bo Jin
H. Zha
189
13
0
18 May 2023
Language Models Meet World Models: Embodied Experiences Enhance Language Models
Neural Information Processing Systems (NeurIPS), 2023
Jiannan Xiang
Tianhua Tao
Yi Gu
Tianmin Shu
Zirui Wang
Zichao Yang
Zhiting Hu
ALM
LLMAG
LM&Ro
CLL
418
140
0
18 May 2023
Learning to Reason over Scene Graphs: A Case Study of Finetuning GPT-2 into a Robot Language Model for Grounded Task Planning
Georgia Chalvatzaki
A. Younes
Daljeet Nandha
An T. Le
Leonardo F. R. Ribeiro
Iryna Gurevych
LM&Ro
LRM
LLMAG
170
39
0
12 May 2023
Think Before You Act: Unified Policy for Interleaving Language Reasoning with Actions
Lina Mezghani
Piotr Bojanowski
Alahari Karteek
Sainbayar Sukhbaatar
LM&Ro
OffRL
LRM
208
12
0
18 Apr 2023
Pretrained Language Models as Visual Planners for Human Assistance
IEEE International Conference on Computer Vision (ICCV), 2023
Dhruvesh Patel
H. Eghbalzadeh
Nitin Kamra
Michael L. Iuzzolino
Unnat Jain
Ruta Desai
LM&Ro
326
35
0
17 Apr 2023
Tool Learning with Foundation Models
ACM Computing Surveys (ACM Comput. Surv.), 2023
Yujia Qin
Shengding Hu
Yankai Lin
Weize Chen
Ning Ding
...
Cheng Yang
Tongshuang Wu
Heng Ji
Zhiyuan Liu
Maosong Sun
388
315
0
17 Apr 2023
Can Large Language Models Transform Computational Social Science?
International Conference on Computational Logic (ICCL), 2023
Caleb Ziems
William B. Held
Omar Shaikh
Jiaao Chen
Zhehao Zhang
Diyi Yang
LLMAG
479
426
0
12 Apr 2023
Skill Reinforcement Learning and Planning for Open-World Long-Horizon Tasks
Haoqi Yuan
Chi Zhang
Hongchen Wang
Feiyang Xie
Penglin Cai
Hao Dong
Zongqing Lu
LM&Ro
LLMAG
356
30
0
29 Mar 2023
Planning with Sequence Models through Iterative Energy Minimization
International Conference on Learning Representations (ICLR), 2023
Hongyi Chen
Yilun Du
Yiye Chen
J. Tenenbaum
Patricio A. Vela
163
8
0
28 Mar 2023
A Picture is Worth a Thousand Words: Language Models Plan from Pixels
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Anthony Z. Liu
Lajanugen Logeswaran
Sungryull Sohn
Honglak Lee
LM&Ro
131
7
0
16 Mar 2023
Embodied Active Learning of Relational State Abstractions for Bilevel Planning
Amber Li
Tom Silver
218
16
0
08 Mar 2023
Foundation Models for Decision Making: Problems, Methods, and Opportunities
Sherry Yang
Ofir Nachum
Yilun Du
Jason W. Wei
Pieter Abbeel
Dale Schuurmans
LM&Ro
OffRL
LRM
AI4CE
393
211
0
07 Mar 2023
PaLM-E: An Embodied Multimodal Language Model
International Conference on Machine Learning (ICML), 2023
Danny Driess
F. Xia
Mehdi S. M. Sajjadi
Corey Lynch
Aakanksha Chowdhery
...
Marc Toussaint
Klaus Greff
Andy Zeng
Igor Mordatch
Peter R. Florence
LM&Ro
473
2,228
0
06 Mar 2023
Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents
Neural Information Processing Systems (NeurIPS), 2023
Wenlong Huang
Fei Xia
Dhruv Shah
Danny Driess
Andy Zeng
...
Pete Florence
Igor Mordatch
Sergey Levine
Karol Hausman
Brian Ichter
LM&Ro
256
78
0
01 Mar 2023
Augmented Language Models: a Survey
Grégoire Mialon
Roberto Dessì
Maria Lomeli
Christoforos Nalmpantis
Ramakanth Pasunuru
...
Jane Dwivedi-Yu
Asli Celikyilmaz
Edouard Grave
Yann LeCun
Thomas Scialom
LRM
KELM
290
487
0
15 Feb 2023
ConceptFusion: Open-set Multimodal 3D Mapping
Krishna Murthy Jatavallabhula
Ali Kuwajerwala
Qiao Gu
Mohd. Omama
Tao Chen
...
Celso Miguel de Melo
Madhava Krishna
Liam Paull
Florian Shkurti
Antonio Torralba
782
323
0
14 Feb 2023
Translating Natural Language to Planning Goals with Large-Language Models
Yaqi Xie
Chenyao Yu
Tongyao Zhu
Jinbin Bai
Ze Gong
Harold Soh
LM&Ro
LRM
226
173
0
10 Feb 2023
Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning
International Conference on Machine Learning (ICML), 2023
Thomas Carta
Clément Romac
Thomas Wolf
Sylvain Lamprier
Olivier Sigaud
Pierre-Yves Oudeyer
LM&Ro
LLMAG
385
237
0
06 Feb 2023
Transfer Knowledge from Natural Language to Electrocardiography: Can We Detect Cardiovascular Disease Through Language Models?
Findings (Findings), 2023
Jielin Qiu
William Jongwon Han
Jiacheng Zhu
Mengdi Xu
Michael A. Rosenberg
Emerson Liu
Douglas Weber
Ding Zhao
224
27
0
21 Jan 2023
A Survey on Transformers in Reinforcement Learning
Wenzhe Li
Hao Luo
Zichuan Lin
Chongjie Zhang
Zongqing Lu
Deheng Ye
OffRL
MU
AI4CE
538
71
0
08 Jan 2023
On Transforming Reinforcement Learning by Transformer: The Development Trajectory
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Shengchao Hu
Li Shen
Ya Zhang
Yixin Chen
Dacheng Tao
OffRL
340
63
0
29 Dec 2022
Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editing
Shengchao Liu
Weili Nie
Chengpeng Wang
Jiarui Lu
Zhuoran Qiao
Ling Liu
Jian Tang
Chaowei Xiao
Anima Anandkumar
277
226
0
21 Dec 2022
Evaluating Step-by-Step Reasoning through Symbolic Verification
Yi-Fan Zhang
Hanlin Zhang
Li Erran Li
Eric P. Xing
ReLM
LRM
273
10
0
16 Dec 2022
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement Learning
Neural Information Processing Systems (NeurIPS), 2022
S. Takagi
OffRL
186
8
0
17 Nov 2022
Language models are good pathologists: using attention-based sequence reduction and text-pretrained transformers for efficient WSI classification
Juan Pisula
Katarzyna Bozek
VLM
MedIm
318
4
0
14 Nov 2022
Pretraining in Deep Reinforcement Learning: A Survey
Zhihui Xie
Zichuan Lin
Junyou Li
Shuai Li
Deheng Ye
OffRL
OnRL
AI4CE
223
30
0
08 Nov 2022
Language Control Diffusion: Efficiently Scaling through Space, Time, and Tasks
International Conference on Learning Representations (ICLR), 2022
Edwin Zhang
Yujie Lu
William Wang
Amy Zhang
DiffM
LM&Ro
244
26
0
27 Oct 2022
Composing Ensembles of Pre-trained Models via Iterative Consensus
International Conference on Learning Representations (ICLR), 2022
Shuang Li
Yilun Du
J. Tenenbaum
Antonio Torralba
Igor Mordatch
MoMe
160
30
0
20 Oct 2022
Can Language Representation Models Think in Bets?
Royal Society Open Science (RSOS), 2022
Zhi–Bin Tang
Mayank Kejriwal
154
7
0
14 Oct 2022
Mind's Eye: Grounded Language Model Reasoning through Simulation
International Conference on Learning Representations (ICLR), 2022
Ruibo Liu
Jason W. Wei
S. Gu
Te-Yen Wu
Soroush Vosoughi
Claire Cui
Denny Zhou
Andrew M. Dai
ReLM
LRM
362
94
0
11 Oct 2022
Generating Executable Action Plans with Environmentally-Aware Language Models
IEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2022
Maitrey Gramopadhye
D. Szafir
LM&Ro
LLMAG
323
38
0
10 Oct 2022
Large Language Models can Implement Policy Iteration
Neural Information Processing Systems (NeurIPS), 2022
Ethan A. Brooks
Logan Walls
Richard L. Lewis
Satinder Singh
LM&Ro
OffRL
377
25
0
07 Oct 2022
VIMA: General Robot Manipulation with Multimodal Prompts
Yunfan Jiang
Agrim Gupta
Zichen Zhang
Guanzhi Wang
Yongqiang Dou
Yanjun Chen
Li Fei-Fei
Anima Anandkumar
Yuke Zhu
Linxi Fan
LM&Ro
389
475
0
06 Oct 2022
ReAct: Synergizing Reasoning and Acting in Language Models
International Conference on Learning Representations (ICLR), 2022
Shunyu Yao
Jeffrey Zhao
Dian Yu
Nan Du
Izhak Shafran
Karthik Narasimhan
Yuan Cao
LLMAG
ReLM
LRM
2.6K
5,256
0
06 Oct 2022
Robot Task Planning and Situation Handling in Open Worlds
Yan Ding
Xiaohan Zhang
S. Amiri
Nieqing Cao
Hao Yang
Chad Esselink
Shiqi Zhang
LM&Ro
147
23
0
04 Oct 2022
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models
IEEE International Conference on Robotics and Automation (ICRA), 2022
Ishika Singh
Valts Blukis
Arsalan Mousavian
Ankit Goyal
Danfei Xu
Jonathan Tremblay
Dieter Fox
Jesse Thomason
Animesh Garg
LM&Ro
LLMAG
456
852
0
22 Sep 2022
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions
ACM Computing Surveys (ACM CSUR), 2022
Paul Pu Liang
Amir Zadeh
Louis-Philippe Morency
310
166
0
07 Sep 2022
The Alignment Problem from a Deep Learning Perspective
International Conference on Learning Representations (ICLR), 2022
Richard Ngo
Lawrence Chan
Sören Mindermann
534
248
0
30 Aug 2022
Inner Monologue: Embodied Reasoning through Planning with Language Models
Conference on Robot Learning (CoRL), 2022
Wenlong Huang
F. Xia
Ted Xiao
Harris Chan
Jacky Liang
...
Tomas Jackson
Linda Luu
Sergey Levine
Karol Hausman
Brian Ichter
LLMAG
LM&Ro
LRM
402
1,160
0
12 Jul 2022
Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos
Neural Information Processing Systems (NeurIPS), 2022
Bowen Baker
Ilge Akkaya
Peter Zhokhov
Joost Huizinga
Jie Tang
Adrien Ecoffet
Brandon Houghton
Raul Sampedro
Jeff Clune
OffRL
477
365
0
23 Jun 2022
Learning Neuro-Symbolic Skills for Bilevel Planning
Conference on Robot Learning (CoRL), 2022
Tom Silver
Ashay Athalye
J. Tenenbaum
Tomas Lozano-Perez
L. Kaelbling
276
83
0
21 Jun 2022
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Neural Information Processing Systems (NeurIPS), 2022
Linxi Fan
Guanzhi Wang
Yunfan Jiang
Ajay Mandlekar
Yuncong Yang
Haoyi Zhu
Andrew Tang
De-An Huang
Yuke Zhu
Anima Anandkumar
LM&Ro
502
495
0
17 Jun 2022
Bootstrapped Transformer for Offline Reinforcement Learning
Neural Information Processing Systems (NeurIPS), 2022
Kerong Wang
Hanye Zhao
Xufang Luo
Kan Ren
Weinan Zhang
Dongsheng Li
OffRL
283
48
0
17 Jun 2022
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks
Neural Information Processing Systems (NeurIPS), 2022
Tuan Dinh
Yuchen Zeng
Ruisu Zhang
Ziqian Lin
Michael Gira
Shashank Rajput
Jy-yong Sohn
Dimitris Papailiopoulos
Kangwook Lee
LMTD
559
167
0
14 Jun 2022
Learning to Query Internet Text for Informing Reinforcement Learning Agents
Kolby Nottingham
Alekhya Pyla
Sameer Singh
Roy Fox
RALM
121
3
0
25 May 2022
History Compression via Language Models in Reinforcement Learning
International Conference on Machine Learning (ICML), 2022
Fabian Paischer
Thomas Adler
Vihang Patil
Angela Bitto-Nemling
Markus Holzleitner
Sebastian Lehner
Hamid Eghbalzadeh
Sepp Hochreiter
OffRL
AI4TS
509
51
0
24 May 2022
Previous
1
2
3
4
5
Next
