Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1506.04089
Cited By
v1
v2
v3
v4 (latest)
Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences
AAAI Conference on Artificial Intelligence (AAAI), 2015
12 June 2015
Hongyuan Mei
Joey Tianyi Zhou
Matthew R. Walter
LM&Ro
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences"
50 / 129 papers shown
SIMA 2: A Generalist Embodied Agent for Virtual Worlds
Sima Team
Adrian Bolton
Alexander Lerchner
Alexandra Cordell
Alexandre Moufarek
...
Tyson Roberts
Volodymyr Mnih
Y. Liu
Z. Wang
Zoubin Ghahramani
LLMAG
LM&Ro
300
6
0
04 Dec 2025
Sample-Efficient Optimization over Generative Priors via Coarse Learnability
Pranjal Awasthi
Sreenivas Gollapudi
Ravi Kumar
Kamesh Munagala
525
1
0
10 Mar 2025
LeLaN: Learning A Language-Conditioned Navigation Policy from In-the-Wild Videos
Conference on Robot Learning (CoRL), 2024
Noriaki Hirose
Catherine Glossop
A. Sridhar
Dhruv Shah
Oier Mees
Sergey Levine
LM&Ro
415
34
0
04 Oct 2024
LASMP: Language Aided Subset Sampling Based Motion Planner
Saswati Bhattacharjee
Anirban Sinha
Chinwe Ekenna
LM&Ro
371
0
0
01 Oct 2024
HiRT: Enhancing Robotic Control with Hierarchical Robot Transformers
Conference on Robot Learning (CoRL), 2024
Jianke Zhang
Yanjiang Guo
Xiaoyu Chen
Yen-Jen Wang
Yucheng Hu
Chengming Shi
Jianyu Chen
353
56
0
12 Sep 2024
LIMT: Language-Informed Multi-Task Visual World Models
Elie Aljalbout
Nikolaos Sotirakis
Patrick van der Smagt
Maximilian Karl
Nutan Chen
441
5
0
18 Jul 2024
BAKU: An Efficient Transformer for Multi-Task Policy Learning
Siddhant Haldar
Zhuoran Peng
Lerrel Pinto
OffRL
528
87
0
11 Jun 2024
Aspect-based Sentiment Evaluation of Chess Moves (ASSESS): an NLP-based Method for Evaluating Chess Strategies from Textbooks
Haifa Alrdahi
Riza Batista-Navarro
254
1
0
10 May 2024
Learning Planning Abstractions from Language
Weiyu Liu
Geng Chen
Joy Hsu
Jiayuan Mao
Jiajun Wu
PINN
356
4
0
06 May 2024
Provable Interactive Learning with Hindsight Instruction Feedback
Dipendra Kumar Misra
Aldo Pacchiano
Rob Schapire
359
1
0
14 Apr 2024
MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language Models
Peng Ding
Jiading Fang
Peng Li
Kangrui Wang
Xiaochen Zhou
Mo Yu
Jing Li
Matthew R. Walter
Hongyuan Mei
RALM
ELM
300
9
0
29 Mar 2024
Large Language Models for Robotics: A Survey
Fanlong Zeng
Wensheng Gan
Zezheng Huai
Lichao Sun
Hechang Chen
Yongheng Wang
Ning Liu
Philip S. Yu
LM&Ro
461
219
0
13 Nov 2023
Learning to Play Chess from Textbooks (LEAP): a Corpus for Evaluating Chess Moves based on Sentiment Analysis
Haifa Alrdahi
Riza Batista-Navarro
298
2
0
31 Oct 2023
Automated Action Model Acquisition from Narrative Texts
RUIQI LI
Leyang Cui
Songtuan Lin
P. Haslum
172
2
0
17 Jul 2023
DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignment
IEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2023
Yanjiang Guo
Yen-Jen Wang
Lihan Zha
Zheyuan Jiang
Jianyu Chen
LM&Ro
527
69
0
01 Jul 2023
Goal Representations for Instruction Following: A Semi-Supervised Language Interface to Control
Conference on Robot Learning (CoRL), 2023
Vivek Myers
Andre Wang He
Kuan Fang
Homer Walke
Philippe Hansen-Estruch
Ching-An Cheng
Mihai Jalobeanu
Andrey Kolobov
Anca Dragan
Sergey Levine
LM&Ro
576
38
0
30 Jun 2023
Statler: State-Maintaining Language Models for Embodied Reasoning
IEEE International Conference on Robotics and Automation (ICRA), 2023
Takuma Yoneda
Jiading Fang
Peng Li
Huanyu Zhang
Tianchong Jiang
Shengjie Lin
Ben Picker
David Yunis
Hongyuan Mei
Matthew R. Walter
LM&Ro
397
53
0
30 Jun 2023
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
Yu-Chih Chen
So Yeon Min
Chase Davis
Ruslan Salakhutdinov
A. Azaria
Yuan-Fang Li
Tom Michael Mitchell
A. Bovik
LM&Ro
LLMAG
418
42
0
03 May 2023
Learning Flight Control Systems from Human Demonstrations and Real-Time Uncertainty-Informed Interventions
Prashant Ganesh
J. H. Ramos
Vinicius G. Goecks
Jared Paquet
Matthew Longmire
Nicholas R. Waytowich
Kevin Brink
168
0
0
01 May 2023
Lana: A Language-Capable Navigator for Instruction Following and Generation
Computer Vision and Pattern Recognition (CVPR), 2023
Xiaohan Wang
Wenguan Wang
Jiayi Shao
Yi Yang
LLMAG
LM&Ro
276
62
0
15 Mar 2023
Conceptual Reinforcement Learning for Language-Conditioned Tasks
AAAI Conference on Artificial Intelligence (AAAI), 2023
Shaohui Peng
Xingui Hu
Rui Zhang
Jiaming Guo
Qi Yi
Rui Chen
Zidong Du
Ling Li
Qi Guo
Yunji Chen
OffRL
215
12
0
09 Mar 2023
Semantic Mechanical Search with Large Vision and Language Models
Conference on Robot Learning (CoRL), 2023
Satvik Sharma
Huang Huang
K. Shivakumar
A. Imran
Ryan Hoque
Brian Ichter
Ken Goldberg
LM&Ro
VLM
375
11
0
24 Feb 2023
Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals
Neural Information Processing Systems (NeurIPS), 2023
Yue Wu
Yewen Fan
Paul Pu Liang
A. Azaria
Yuan-Fang Li
Tom Michael Mitchell
OffRL
316
58
0
09 Feb 2023
Distilling Internet-Scale Vision-Language Models into Embodied Agents
International Conference on Machine Learning (ICML), 2023
T. Sumers
Kenneth Marino
Arun Ahuja
Rob Fergus
Ishita Dasgupta
LM&Ro
260
35
0
29 Jan 2023
RT-1: Robotics Transformer for Real-World Control at Scale
Anthony Brohan
Noah Brown
Justice Carbajal
Yevgen Chebotar
Joseph Dabis
...
Ted Xiao
Peng Xu
Sichun Xu
Tianhe Yu
Brianna Zitkovich
LM&Ro
676
2,067
0
13 Dec 2022
A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning
Computer Vision and Pattern Recognition (CVPR), 2022
Aishwarya Kamath
Peter Anderson
Su Wang
Jing Yu Koh
Alexander Ku
Austin Waters
Yinfei Yang
Jason Baldridge
Zarana Parekh
LM&Ro
527
64
0
06 Oct 2022
LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action
Conference on Robot Learning (CoRL), 2022
Dhruv Shah
B. Osinski
Brian Ichter
Sergey Levine
LM&Ro
709
663
0
10 Jul 2022
EAGER: Asking and Answering Questions for Automatic Reward Shaping in Language-guided RL
Neural Information Processing Systems (NeurIPS), 2022
Thomas Carta
Pierre-Yves Oudeyer
Olivier Sigaud
Sylvain Lamprier
OffRL
441
32
0
20 Jun 2022
Few-shot Subgoal Planning with Language Models
North American Chapter of the Association for Computational Linguistics (NAACL), 2022
Lajanugen Logeswaran
Yao Fu
Moontae Lee
Honglak Lee
LRM
218
28
0
28 May 2022
Inferring Rewards from Language in Context
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Jessy Lin
Daniel Fried
Dan Klein
Anca Dragan
LM&Ro
242
70
0
05 Apr 2022
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Conference on Robot Learning (CoRL), 2022
Michael Ahn
Anthony Brohan
Noah Brown
Yevgen Chebotar
Omar Cortes
...
Ted Xiao
Peng Xu
Sichun Xu
Mengyuan Yan
Andy Zeng
LM&Ro
729
2,929
0
04 Apr 2022
Counterfactual Cycle-Consistent Learning for Instruction Following and Generation in Vision-Language Navigation
Computer Vision and Pattern Recognition (CVPR), 2022
Hongru Wang
Wei Liang
Jianbing Shen
Luc Van Gool
Wenguan Wang
265
80
0
30 Mar 2022
EnvEdit: Environment Editing for Vision-and-Language Navigation
Computer Vision and Pattern Recognition (CVPR), 2022
Jialu Li
Hao Tan
Joey Tianyi Zhou
484
120
0
29 Mar 2022
Teachable Reinforcement Learning via Advice Distillation
Neural Information Processing Systems (NeurIPS), 2022
Olivia Watkins
Trevor Darrell
Pieter Abbeel
Jacob Andreas
Abhishek Gupta
OffRL
252
3
0
19 Mar 2022
Integrating AI Planning with Natural Language Processing: A Combination of Explicit and Tacit Knowledge
ACM Transactions on Intelligent Systems and Technology (ACM TIST), 2022
Kebing Jin
H. Zhuo
453
13
0
15 Feb 2022
Learning Invariable Semantical Representation from Language for Extensible Policy Generalization
Yihan Li
Jinsheng Ren
Tianrun Xu
Tianren Zhang
Haichuan Gao
Feng Chen
284
1
0
26 Jan 2022
Guided Policy Search for Parameterized Skills using Adverbs
Benjamin A. Spiegel
George Konidaris
196
2
0
23 Oct 2021
TEACh: Task-driven Embodied Agents that Chat
Aishwarya Padmakumar
Jesse Thomason
Ayush Shrivastava
P. Lange
Anjali Narayan-Chen
Spandana Gella
Robinson Piramithu
Gokhan Tur
Dilek Z. Hakkani-Tür
LM&Ro
1.3K
246
0
01 Oct 2021
Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotation
Suraj Nair
E. Mitchell
Kevin Chen
Brian Ichter
Silvio Savarese
Chelsea Finn
LM&Ro
OffRL
381
184
0
02 Sep 2021
Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering
Siddharth Karamcheti
Ranjay Krishna
Li Fei-Fei
Christopher D. Manning
284
97
0
06 Jul 2021
GPT3-to-plan: Extracting plans from text using GPT-3
Alberto Olmo
S. Sreedharan
S. Kambhampati
134
49
0
14 Jun 2021
Grounding Complex Navigational Instructions Using Scene Graphs
Michiel de Jong
Satyapriya Krishna
Anuva Agarwal
LM&Ro
95
0
0
03 Jun 2021
Language Understanding for Field and Service Robots in a Priori Unknown Environments
Field Robotics (FR), 2021
Matthew R. Walter
Siddharth Patki
Andrea F. Daniele
E. Fahnestock
Felix Duvallet
Sachithra Hemachandra
Jean Oh
A. Stentz
Nicholas Roy
T. Howard
LM&Ro
250
12
0
21 May 2021
Towards Navigation by Reasoning over Spatial Configurations
Yue Zhang
Quan Guo
Parisa Kordjamshidi
LLMAG
169
20
0
14 May 2021
Episodic Transformer for Vision-and-Language Navigation
IEEE International Conference on Computer Vision (ICCV), 2021
Alexander Pashevich
Cordelia Schmid
Chen Sun
LM&Ro
490
222
0
13 May 2021
Diagnosing Vision-and-Language Navigation: What Really Matters
North American Chapter of the Association for Computational Linguistics (NAACL), 2021
Wanrong Zhu
Yuankai Qi
P. Narayana
Kazoo Sone
Sugato Basu
Xinze Wang
Qi Wu
Miguel P. Eckstein
Wenjie Wang
LM&Ro
297
58
0
30 Mar 2021
Synthesis of Compositional Animations from Textual Descriptions
IEEE International Conference on Computer Vision (ICCV), 2021
Anindita Ghosh
N. Cheema
Cennet Oguz
Christian Theobalt
P. Slusallek
826
225
0
26 Mar 2021
Structured Scene Memory for Vision-Language Navigation
Computer Vision and Pattern Recognition (CVPR), 2021
Hanqing Wang
Wenguan Wang
Wei Liang
Caiming Xiong
Jianbing Shen
LM&Ro
325
152
0
05 Mar 2021
Interactive Learning from Activity Description
International Conference on Machine Learning (ICML), 2021
Khanh Nguyen
Dipendra Kumar Misra
Robert Schapire
Miroslav Dudík
Patrick Shafto
317
36
0
13 Feb 2021
A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environment
Future Internet (FI), 2021
Homagni Saha
Fateme Fotouhif
Qisai Liu
Soumik Sarkar
LM&Ro
179
8
0
19 Jan 2021
1
2
3
Next
Page 1 of 3
