Building Generalizable Agents with a Realistic and Rich 3D Environment

7 January 2018

Papers citing "Building Generalizable Agents with a Realistic and Rich 3D Environment"

50 / 225 papers shown

Title
Hierarchical and Partially Observable Goal-driven Policy Learning with Goals Relational Graph Xin Ye Yezhou Yang 19 22 0 01 Mar 2021
Unlocking Pixels for Reinforcement Learning via Implicit Attention K. Choromanski Deepali Jain Wenhao Yu Xingyou Song Jack Parker-Holder ... Aldo Pacchiano Anirban Santara Yunhao Tang Jie Tan Adrian Weller OffRL 25 3 0 08 Feb 2021
ArraMon: A Joint Navigation-Assembly Instruction Interpretation Task in Dynamic Environments Hyounghun Kim Abhaysinh Zala Graham Burri Hao Tan Mohit Bansal LM&Ro 11 16 0 15 Nov 2020
End-To-End Semi-supervised Learning for Differentiable Particle Filters Hao Wen Xiongjie Chen Georgios Papagiannis Conghui Hu Yunpeng Li 15 17 0 11 Nov 2020
Learning from THEODORE: A Synthetic Omnidirectional Top-View Indoor Dataset for Deep Transfer Learning Tobias Scheck Roman Seidel G. Hirtz 11 22 0 11 Nov 2020
Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding Mike Roberts Jason Ramapuram Anurag Ranjan Atulit Kumar Miguel Angel Bautista Nathan Paczan Russ Webb Joshua M. Susskind 24 368 0 04 Nov 2020
Unsupervised Domain Adaptation for Visual Navigation Shangda Li Devendra Singh Chaplot Yao-Hung Hubert Tsai Yue Wu Louis-Philippe Morency Ruslan Salakhutdinov EgoV 17 9 0 27 Oct 2020
On Embodied Visual Navigation in Real Environments Through Habitat Marco Rosano Antonino Furnari Luigi Gulino G. Farinella 6 18 0 26 Oct 2020
Visual Navigation in Real-World Indoor Environments Using End-to-End Deep Reinforcement Learning Jonáš Kulhánek Erik Derner Robert Babuška 23 39 0 21 Oct 2020
Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration Xavier Puig Tianmin Shu Shuang Li Zilin Wang Yuan-Hong Liao J. Tenenbaum Sanja Fidler Antonio Torralba LM&Ro 96 123 0 19 Oct 2020
Efficient Robotic Object Search via HIEM: Hierarchical Policy Learning with Intrinsic-Extrinsic Modeling Xin Ye Yezhou Yang 12 14 0 16 Oct 2020
Towards Target-Driven Visual Navigation in Indoor Scenes via Generative Imitation Learning Qiaoyun Wu Xiaoxi Gong Kai Xu Dinesh Manocha Jingxuan Dong Jun Wang 16 31 0 30 Sep 2020
Generative Language-Grounded Policy in Vision-and-Language Navigation with Bayes' Rule Shuhei Kurita Kyunghyun Cho LM&Ro 9 23 0 16 Sep 2020
Multimodal Aggregation Approach for Memory Vision-Voice Indoor Navigation with Meta-Learning Liqi Yan Dongfang Liu Yaoxian Song Changbin (Brad) Yu 6 14 0 01 Sep 2020
Next-Best View Policy for 3D Reconstruction Daryl Peralta Joel Casimiro A. M. Nilles Justine Aletta Aguilar Rowel Atienza R. Cajote 8 49 0 28 Aug 2020
Meta-Sim2: Unsupervised Learning of Scene Structure for Synthetic Data Generation Jeevan Devaranjan Amlan Kar Sanja Fidler 20 88 0 20 Aug 2020
OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasets Zhengqin Li Ting Yu S. Sang Sarah Wang Meng Song ... Hong-Xing Yu Kalyan Sunkavalli Milovs Havsan R. Ramamoorthi Manmohan Chandraker 3DV 18 84 0 25 Jul 2020
PackIt: A Virtual Environment for Geometric Planning Ankit Goyal Jia Deng 28 13 0 21 Jul 2020
Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation Medhini Narasimhan Erik Wijmans Xinlei Chen Trevor Darrell Dhruv Batra Devi Parikh Amanpreet Singh 18 56 0 20 Jul 2020
ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation Chuang Gan Jeremy Schwartz S. Alter Damian Mrowca Martin Schrimpf ... Antonio Torralba J. DiCarlo J. Tenenbaum Josh H. McDermott Daniel L. K. Yamins VGen 30 303 0 09 Jul 2020
Learning to simulate complex scenes Zhenfeng Xue W. Mao Liang Zheng 3DV 8 6 0 25 Jun 2020
Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text Felix Hill Soňa Mokrá Nathaniel Wong Tim Harley LM&Ro 11 81 0 19 May 2020
SurfelGAN: Synthesizing Realistic Sensor Data for Autonomous Driving Zhenpei Yang Yuning Chai Dragomir Anguelov Yin Zhou Pei Sun D. Erhan Sean M. Rafferty Henrik Kretzschmar 13 100 0 08 May 2020
Improving Target-driven Visual Navigation with Attention on 3D Spatial Relationships Yunlian Lv Ning Xie Yimin Shi Zijiao Wang H. Shen 11 0 0 29 Apr 2020
Spatial Action Maps for Mobile Manipulation Jimmy Wu Xingyuan Sun Andy Zeng Shuran Song Johnny Lee Szymon Rusinkiewicz Thomas Funkhouser 11 70 0 20 Apr 2020
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense Yixin Zhu Tao Gao Lifeng Fan Siyuan Huang Mark Edmonds ... Chi Zhang Siyuan Qi Ying Nian Wu J. Tenenbaum Song-Chun Zhu 19 128 0 20 Apr 2020
Zero-Shot Compositional Policy Learning via Language Grounding Tianshi Cao Jingkang Wang Yining Zhang S. Manivasagam LM&Ro 31 1 0 15 Apr 2020
RoboTHOR: An Open Simulation-to-Real Embodied AI Platform Matt Deitke Winson Han Alvaro Herrasti Aniruddha Kembhavi Eric Kolve ... Eli VanderBilt Matthew Wallingford Luca Weihs Mark Yatskar Ali Farhadi LM&Ro 18 231 0 14 Apr 2020
SAPIEN: A SimulAted Part-based Interactive ENvironment Fanbo Xiang Yuzhe Qin Kaichun Mo Yikuan Xia Hao Zhu ... He-Nan Wang Li Yi Angel X. Chang Leonidas J. Guibas Hao Su 204 485 0 19 Mar 2020
Vision-Dialog Navigation by Exploring Cross-modal Memory Yi Zhu Fengda Zhu Zhaohuan Zhan Bingqian Lin Jianbin Jiao Xiaojun Chang Xiaodan Liang VLM 27 49 0 15 Mar 2020
Environment-agnostic Multitask Learning for Natural Language Grounded Navigation X. Wang Vihan Jain Eugene Ie William Yang Wang Zornitsa Kozareva Sujith Ravi LM&Ro 30 63 0 01 Mar 2020
Multiplicative Gaussian Particle Filter Xuan Su W. Lee Zhen Zhang 6 2 0 29 Feb 2020
From Seeing to Moving: A Survey on Learning for Visual Indoor Navigation (VIN) Xin Ye Yezhou Yang SSL 12 16 0 26 Feb 2020
Level Three Synthetic Fingerprint Generation André Brasil Vieira Wyzykowski Maurício Pamplona Segundo Rubisley de P. Lemes 20 26 0 05 Feb 2020
Exploiting Language Instructions for Interpretable and Compositional Reinforcement Learning Michiel van der Meer Matteo Pirotta Elia Bruni 14 1 0 13 Jan 2020
Learning to Move with Affordance Maps William Qi Ravi Teja Mullapudi Saurabh Gupta Deva Ramanan 8 35 0 08 Jan 2020
Reinforcement Learning-based Visual Navigation with Information-Theoretic Regularization Qiaoyun Wu Kai Xu Jun Wang Mingliang Xu Xiaoxi Gong Dinesh Manocha 6 30 0 09 Dec 2019
Simultaneous Mapping and Target Driven Navigation G. Georgakis Yimeng Li Jana Kosecka 9 16 0 18 Nov 2019
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks Fengda Zhu Yi Zhu Xiaojun Chang Xiaodan Liang LRM 14 238 0 18 Nov 2019
Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation Juncheng Li X. Wang Siliang Tang Haizhou Shi Fei Wu Yueting Zhuang William Yang Wang SSL 27 68 0 18 Nov 2019
Language coverage and generalization in RNN-based continuous sentence embeddings for interacting agents Luca Herranz-Celotti Simon Brodeur Jean Rouat 11 0 0 05 Nov 2019
Influence-Based Multi-Agent Exploration Tonghan Wang Jianhao Wang Yi Wu Chongjie Zhang 16 137 0 12 Oct 2019
CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoning Rohit Girdhar Deva Ramanan 19 176 0 10 Oct 2019
CityLearn: Diverse Real-World Environments for Sample-Efficient Navigation Policy Learning Marvin Chancán Michael Milford SSL 13 5 0 10 Oct 2019
Synthetic Data for Deep Learning Sergey I. Nikolenko 36 348 0 25 Sep 2019
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations Rogerio Bonatti Ratnesh Madaan Vibhav Vineet S. Scherer Ashish Kapoor SSL 21 39 0 16 Sep 2019
Bayesian Relational Memory for Semantic Visual Navigation Yi Wu Yuxin Wu Aviv Tamar Stuart J. Russell Georgia Gkioxari Yuandong Tian BDL 8 104 0 10 Sep 2019
Planning Beyond the Sensing Horizon Using a Learned Context M. Everett Justin Miller Jonathan P. How 14 15 0 24 Aug 2019
Training Deep Learning Models via Synthetic Data: Application in Unmanned Aerial Vehicles A. Kamilaris Corjan van den Brink S. Karatsiolis 6 15 0 18 Aug 2019
PHYRE: A New Benchmark for Physical Reasoning A. Bakhtin L. V. D. van der Maaten Justin Johnson Laura Gustafson Ross B. Girshick LRM 11 121 0 15 Aug 2019