Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1802.01433
Cited By
v1
v2
v3
v4 (latest)
Interactive Grounded Language Acquisition and Generalization in a 2D World
31 January 2018
Haonan Yu
Haichao Zhang
Wenyuan Xu
LLMAG
LM&Ro
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Interactive Grounded Language Acquisition and Generalization in a 2D World"
50 / 54 papers shown
CoPESD: A Multi-Level Surgical Motion Dataset for Training Large Vision-Language Models to Co-Pilot Endoscopic Submucosal Dissection
Guankun Wang
Han Xiao
Huxin Gao
Renrui Zhang
Long Bai
Xiaoxiao Yang
Zhen Li
Hongsheng Li
Hongliang Ren
227
9
0
10 Oct 2024
Improve the efficiency of deep reinforcement learning through semantic exploration guided by natural language
International Conference on Computer Science and Artificial Intelligence (ICCSAI), 2023
Zhourui Guo
Meng Yao
Yang Yu
Qiyue Yin
OnRL
238
1
0
21 Sep 2023
Type-to-Track: Retrieve Any Object via Prompt-based Tracking
Neural Information Processing Systems (NeurIPS), 2023
Pha Nguyen
Kha Gia Quach
Kris Kitani
Khoa Luu
285
32
0
22 May 2023
Distilling Internet-Scale Vision-Language Models into Embodied Agents
International Conference on Machine Learning (ICML), 2023
T. Sumers
Kenneth Marino
Arun Ahuja
Rob Fergus
Ishita Dasgupta
LM&Ro
218
33
0
29 Jan 2023
Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling
International Conference on Machine Learning (ICML), 2023
Kolby Nottingham
Prithviraj Ammanabrolu
Alane Suhr
Yejin Choi
Hannaneh Hajishirzi
Sameer Singh
Roy Fox
LLMAG
LM&Ro
251
105
0
28 Jan 2023
A Data-Efficient Visual-Audio Representation with Intuitive Fine-tuning for Voice-Controlled Robots
Conference on Robot Learning (CoRL), 2023
Peixin Chang
Shuijing Liu
Tianchen Ji
Neeloy Chakraborty
Kaiwen Hong
Katherine Driggs-Campbell
188
5
0
23 Jan 2023
A Short Survey of Systematic Generalization
Yuanpeng Li
AI4CE
304
1
0
22 Nov 2022
Contrastive language and vision learning of general fashion concepts
Scientific Reports (Sci Rep), 2022
P. Chia
Giuseppe Attanasio
Federico Bianchi
Silvia Terragni
A. Magalhães
Diogo Gonçalves
C. Greco
Jacopo Tagliabue
CLIP
425
64
0
08 Apr 2022
CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
IEEE Robotics and Automation Letters (RA-L), 2021
Oier Mees
Lukás Hermann
Erick Rosete-Beas
Wolfram Burgard
LM&Ro
539
417
0
06 Dec 2021
Explainable Semantic Space by Grounding Language to Vision with Cross-Modal Contrastive Learning
Neural Information Processing Systems (NeurIPS), 2021
Yizhen Zhang
Minkyu Choi
Kuan Han
Zhongming Liu
VLM
136
19
0
13 Nov 2021
In a Nutshell, the Human Asked for This: Latent Goals for Following Temporal Specifications
Borja G. Leon
Murray Shanahan
Francesco Belardinelli
AI4CE
280
20
0
18 Oct 2021
Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
Linlu Qiu
Hexiang Hu
Bowen Zhang
Peter Shaw
Fei Sha
169
23
0
25 Sep 2021
Evolving Decomposed Plasticity Rules for Information-Bottlenecked Meta-Learning
Fan Wang
Hao Tian
Haoyi Xiong
Hua Wu
Jie Fu
Yang Cao
Yu Kang
Haifeng Wang
AI4CE
366
4
0
08 Sep 2021
Learning Visual-Audio Representations for Voice-Controlled Robots
IEEE International Conference on Robotics and Automation (ICRA), 2021
Peixin Chang
Shuijing Liu
D. L. McPherson
Katherine Driggs-Campbell
SSL
237
8
0
07 Sep 2021
Vision-Language Navigation: A Survey and Taxonomy
Wansen Wu
Tao Chang
Xinmeng Li
LM&Ro
333
47
0
26 Aug 2021
Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene
IEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2021
Qi Wu
Cheng-Ju Wu
Yixin Zhu
Jungseock Joo
242
18
0
05 Aug 2021
Interactive Explanations: Diagnosis and Repair of Reinforcement Learning Based Agent Behaviors
Christian Arzate Cruz
Takeo Igarashi
233
7
0
27 May 2021
Fast and Slow Learning of Recurrent Independent Mechanisms
International Conference on Learning Representations (ICLR), 2021
Kanika Madan
Rosemary Nan Ke
Anirudh Goyal
Bernhard Schölkopf
Yoshua Bengio
OCL
250
40
0
18 May 2021
Language in a (Search) Box: Grounding Language Learning in Real-World Human-Machine Interaction
North American Chapter of the Association for Computational Linguistics (NAACL), 2021
Federico Bianchi
C. Greco
Jacopo Tagliabue
189
9
0
18 Apr 2021
Reinforcement Learning of Implicit and Explicit Control Flow in Instructions
International Conference on Machine Learning (ICML), 2021
Ethan A. Brooks
Janarthanan Rajendran
Richard L. Lewis
Satinder Singh
139
10
0
25 Feb 2021
LTL2Action: Generalizing LTL Instructions for Multi-Task RL
International Conference on Machine Learning (ICML), 2021
Pashootan Vaezipoor
Andrew C. Li
Rodrigo Toro Icarte
Sheila A. McIlraith
OffRL
AI4CE
327
95
0
13 Feb 2021
A Survey on Deep Reinforcement Learning for Audio-Based Applications
Artificial Intelligence Review (AIR), 2021
S. Latif
Heriberto Cuayáhuitl
Farrukh Pervez
Fahad Shamshad
Hafiz Shehbaz Ali
Xiaoshi Zhong
OffRL
338
88
0
01 Jan 2021
Visually Grounding Language Instruction for History-Dependent Manipulation
IEEE International Conference on Robotics and Automation (ICRA), 2020
Hyemin Ahn
Obin Kwon
Kyungdo Kim
Jaeyeon Jeong
Howoong Jun
Hongjung Lee
Dongheui Lee
Songhwai Oh
LM&Ro
280
7
0
16 Dec 2020
Ask Your Humans: Using Human Instructions to Improve Generalization in Reinforcement Learning
International Conference on Learning Representations (ICLR), 2020
Valerie Chen
Abhinav Gupta
Kenneth Marino
OffRL
361
44
0
01 Nov 2020
Multimodal Aggregation Approach for Memory Vision-Voice Indoor Navigation with Meta-Learning
IEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2020
Liqi Yan
Dongfang Liu
Yaoxian Song
Changbin (Brad) Yu
128
19
0
01 Sep 2020
Compositional Networks Enable Systematic Generalization for Grounded Language Understanding
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Yen-Ling Kuo
Boris Katz
Andrei Barbu
393
24
0
06 Aug 2020
Systematic Generalisation through Task Temporal Logic and Deep Reinforcement Learning
Borja G. Leon
Murray Shanahan
Francesco Belardinelli
NAI
AI4CE
266
32
0
12 Jun 2020
Probing Emergent Semantics in Predictive Agents via Question Answering
International Conference on Machine Learning (ICML), 2020
Abhishek Das
Federico Carnevale
Hamza Merzic
Laura Rimell
R. Schneider
...
Alden Hung
Arun Ahuja
S. Clark
Greg Wayne
Felix Hill
226
18
0
01 Jun 2020
Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text
Felix Hill
Soňa Mokrá
Nathaniel Wong
Tim Harley
LM&Ro
221
90
0
19 May 2020
Language Conditioned Imitation Learning over Unstructured Data
Corey Lynch
P. Sermanet
LM&Ro
321
282
0
15 May 2020
Robust and Interpretable Grounding of Spatial References with Relation Networks
Findings (Findings), 2020
Tsung-Yen Yang
Andrew S. Lan
Karthik Narasimham
280
12
0
02 May 2020
Zero-Shot Compositional Policy Learning via Language Grounding
Tianshi Cao
Jingkang Wang
Yining Zhang
S. Manivasagam
LM&Ro
224
3
0
15 Apr 2020
Exploiting Language Instructions for Interpretable and Compositional Reinforcement Learning
Michiel van der Meer
Matteo Pirotta
Elia Bruni
164
1
0
13 Jan 2020
Look, Listen, and Act: Towards Audio-Visual Embodied Navigation
IEEE International Conference on Robotics and Automation (ICRA), 2019
Chuang Gan
Yiwei Zhang
Jiajun Wu
Boqing Gong
J. Tenenbaum
215
151
0
25 Dec 2019
Learning to Request Guidance in Emergent Communication
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Benjamin Kolb
Leon Lang
H. Bartsch
Arwin Gansekoele
Raymond Koopmanschap
Leonardo Romor
David Speck
Mathijs Mul
Elia Bruni
153
0
0
11 Dec 2019
Automated curriculum generation for Policy Gradients from Demonstrations
A. Srinivasan
Dzmitry Bahdanau
Maxime Chevalier-Boisvert
Yoshua Bengio
129
2
0
01 Dec 2019
Emergence of Numeric Concepts in Multi-Agent Autonomous Communication
Shangmin Guo
LLMAG
172
3
0
04 Nov 2019
Task-Oriented Language Grounding for Language Input with Multiple Sub-Goals of Non-Linear Order
Vladislav Kurenkov
Bulat Maksudov
Adil Khan
99
1
0
27 Oct 2019
Environmental drivers of systematicity and generalization in a situated agent
International Conference on Learning Representations (ICLR), 2019
Felix Hill
Andrew Kyle Lampinen
R. Schneider
S. Clark
M. Botvinick
James L. McClelland
Adam Santoro
OOD
355
109
0
01 Oct 2019
Robot Sound Interpretation: Combining Sight and Sound in Learning-Based Control
IEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2019
Peixin Chang
Shuijing Liu
Haonan Chen
Katherine Driggs-Campbell
199
13
0
19 Sep 2019
Mastering emergent language: learning to guide in simulated navigation
Mathijs Mul
Diane Bouchacourt
Elia Bruni
LLMAG
145
9
0
14 Aug 2019
Why Build an Assistant in Minecraft?
Arthur Szlam
Jonathan Gray
Kavya Srinet
Yacine Jernite
Armand Joulin
...
Siddharth Goyal
Demi Guo
Dan Rothermel
C. L. Zitnick
Jason Weston
LLMAG
276
31
0
22 Jul 2019
A Survey of Reinforcement Learning Informed by Natural Language
International Joint Conference on Artificial Intelligence (IJCAI), 2019
Jelena Luketina
Nantas Nardelli
Gregory Farquhar
Jakob N. Foerster
Jacob Andreas
Edward Grefenstette
Shimon Whiteson
Tim Rocktaschel
LM&Ro
KELM
OffRL
LRM
218
302
0
10 Jun 2019
REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments
Yuankai Qi
Qi Wu
Peter Anderson
Xinze Wang
Wenjie Wang
Chunhua Shen
Anton Van Den Hengel
LM&Ro
350
426
0
23 Apr 2019
ACTRCE: Augmenting Experience via Teacher's Advice For Multi-Goal Reinforcement Learning
Harris Chan
Yuhuai Wu
J. Kiros
Sanja Fidler
Jimmy Ba
195
34
0
12 Feb 2019
Embodied Multimodal Multitask Learning
Devendra Singh Chaplot
Lisa Lee
Ruslan Salakhutdinov
Devi Parikh
Dhruv Batra
LM&Ro
181
24
0
04 Feb 2019
Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning
Mitchell Wortsman
Kiana Ehsani
Mohammad Rastegari
Ali Farhadi
Roozbeh Mottaghi
SSL
379
247
0
03 Dec 2018
Object-oriented Targets for Visual Navigation using Rich Semantic Representations
Jean-Benoit Delbrouck
Stéphane Dupont
154
3
0
22 Nov 2018
Neural Modular Control for Embodied Question Answering
Abhishek Das
Georgia Gkioxari
Stefan Lee
Devi Parikh
Dhruv Batra
LM&Ro
423
141
0
26 Oct 2018
Visual Semantic Navigation using Scene Priors
Wei Yang
Xinyu Wang
Ali Farhadi
Abhinav Gupta
Roozbeh Mottaghi
LM&Ro
276
351
0
15 Oct 2018
1
2
Next
