Building Generalizable Agents with a Realistic and Rich 3D Environment

7 January 2018

Papers citing "Building Generalizable Agents with a Realistic and Rich 3D Environment"

50 / 225 papers shown

Title
Mastering emergent language: learning to guide in simulated navigation Mathijs Mul Diane Bouchacourt Elia Bruni LLMAG 16 9 0 14 Aug 2019
VideoNavQA: Bridging the Gap between Visual and Embodied Question Answering Cătălina Cangea Eugene Belilovsky Pietro Lió Aaron Courville 16 16 0 14 Aug 2019
A Review of Cooperative Multi-Agent Deep Reinforcement Learning Afshin Oroojlooyjadid Davood Hajinezhad 38 408 0 11 Aug 2019
A Mask-RCNN Baseline for Probabilistic Object Detection Phil Ammirato Alexander C. Berg 14 18 0 09 Aug 2019
Vision-based Navigation Using Deep Reinforcement Learning Jonáš Kulhánek Erik Derner T. D. Bruin Robert Babuška 6 57 0 08 Aug 2019
Walking with MIND: Mental Imagery eNhanceD Embodied QA Juncheng Li Siliang Tang Fei Wu Yueting Zhuang 11 22 0 05 Aug 2019
Why Build an Assistant in Minecraft? Arthur Szlam Jonathan Gray Kavya Srinet Yacine Jernite Armand Joulin ... Siddharth Goyal Demi Guo Dan Rothermel C. L. Zitnick Jason Weston LLMAG 12 28 0 22 Jul 2019
Learning to Generate Synthetic 3D Training Data through Hybrid Gradient Dawei Yang Jia Deng 3DH 11 5 0 29 Jun 2019
Emergence of Exploratory Look-Around Behaviors through Active Observation Completion Santhosh Kumar Ramakrishnan Dinesh Jayaraman Kristen Grauman 8 40 0 27 Jun 2019
Continual Reinforcement Learning with Diversity Exploration and Adversarial Self-Correction Fengda Zhu Xiaojun Chang Runhao Zeng Mingkui Tan CLL 8 3 0 21 Jun 2019
NeoNav: Improving the Generalization of Visual Navigation via Generating Next Expected Observations Qiaoyun Wu Dinesh Manocha Jun Wang Kai Xu 8 15 0 17 Jun 2019
Cross-view Semantic Segmentation for Sensing Surroundings Bowen Pan Jiankai Sun Ho Yin Tiga Leung A. Andonian Bolei Zhou 13 263 0 09 Jun 2019
Arena: A General Evaluation Platform and Building Toolkit for Multi-Agent Intelligence Yuhang Song Andrzej Wojcicki Thomas Lukasiewicz Jianyi Wang Abi Aryan Zhenghua Xu Mai Xu Zihan Ding Lianlong Wu AI4CE ELM 17 33 0 17 May 2019
Meta-Sim: Learning to Generate Synthetic Datasets Amlan Kar Aayush Prakash Ming-Yu Liu Eric Cameracci Justin Yuan Matt Rusiniak David Acuna Antonio Torralba Sanja Fidler 8 247 0 25 Apr 2019
REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments Yuankai Qi Qi Wu Peter Anderson X. Wang W. Wang Chunhua Shen A. Hengel LM&Ro 12 316 0 23 Apr 2019
Synthetic Examples Improve Generalization for Rare Classes Sara Beery Yang Liu Dan Morris Jim Piavis Ashish Kapoor M. Meister Neel Joshi Pietro Perona 10 94 0 11 Apr 2019
Two Body Problem: Collaborative Visual Task Completion Unnat Jain Luca Weihs Eric Kolve Mohammad Rastegari Svetlana Lazebnik Ali Farhadi A. Schwing Aniruddha Kembhavi 14 70 0 11 Apr 2019
Learning to Generate Synthetic Data via Compositing Shashank Tripathi Siddhartha Chandra Amit Agrawal A. Tyagi James M. Rehg Visesh Chari 4 118 0 10 Apr 2019
Multi-Target Embodied Question Answering Licheng Yu Xinlei Chen Georgia Gkioxari Mohit Bansal Tamara L. Berg Dhruv Batra 19 102 0 09 Apr 2019
Embodied Visual Recognition Jianwei Yang Zhile Ren Mingze Xu Xinlei Chen David J. Crandall Devi Parikh Dhruv Batra 32 26 0 09 Apr 2019
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Hao Tan Licheng Yu Mohit Bansal SSL 17 315 0 08 Apr 2019
Revisiting EmbodiedQA: A Simple Baseline and Beyond Yuehua Wu Lu Jiang Yi Yang LM&Ro 34 30 0 08 Apr 2019
Sim-Real Joint Reinforcement Transfer for 3D Indoor Navigation Fengda Zhu Linchao Zhu Yi Yang 11 26 0 08 Apr 2019
Embodied Question Answering in Photorealistic Environments with Point Cloud Perception Erik Wijmans Samyak Datta Oleksandr Maksymets Abhishek Das Georgia Gkioxari Stefan Lee Irfan Essa Devi Parikh Dhruv Batra 3DPC LM&Ro 16 164 0 06 Apr 2019
Habitat: A Platform for Embodied AI Research Manolis Savva Abhishek Kadian Oleksandr Maksymets Yili Zhao Erik Wijmans ... Jia-Wei Liu V. Koltun Jitendra Malik Devi Parikh Dhruv Batra LM&Ro 23 1,372 0 02 Apr 2019
Long Range Neural Navigation Policies for the Real World Ayzaan Wahid Alexander Toshev Marek Fiser T. Lee 22 17 0 23 Mar 2019
VRKitchen: an Interactive 3D Virtual Environment for Task-oriented Learning Xiaofeng Gao Ran Gong Tianmin Shu Xu Xie Shu Wang Song-Chun Zhu 12 61 0 13 Mar 2019
Scene Memory Transformer for Embodied Agents in Long-Horizon Tasks Kuan Fang Alexander Toshev Li Fei-Fei Silvio Savarese OffRL 11 199 0 09 Mar 2019
Learning to Speak and Act in a Fantasy Text Adventure Game Jack Urbanek Angela Fan Siddharth Karamcheti Saachi Jain Samuel Humeau Emily Dinan Tim Rocktaschel Douwe Kiela Arthur Szlam Jason Weston LLMAG 20 204 0 07 Mar 2019
Learning Exploration Policies for Navigation Tao Chen Saurabh Gupta Abhinav Gupta EgoV 11 233 0 05 Mar 2019
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation Chih-Yao Ma Zuxuan Wu G. Al-Regib Caiming Xiong Z. Kira LM&Ro 16 172 0 05 Mar 2019
The StreetLearn Environment and Dataset Piotr Wojciech Mirowski Andras Banki-Horvath Keith Anderson Denis Teplyashin Karl Moritz Hermann ... Matthew Koichi Grimes Karen Simonyan Koray Kavukcuoglu Andrew Zisserman R. Hadsell 3DV 11 64 0 04 Mar 2019
A Behavioral Approach to Visual Navigation with Graph Localization Networks Kevin Chen Juan Pablo de Vicente G. Sepulveda Fei Xia Á. Soto Marynel Vázquez Silvio Savarese GNN 12 100 0 01 Mar 2019
Learning To Follow Directions in Street View Karl Moritz Hermann Mateusz Malinowski Piotr Wojciech Mirowski Andras Banki-Horvath Keith Anderson R. Hadsell SSL 16 66 0 01 Mar 2019
DIViS: Domain Invariant Visual Servoing for Collision-Free Goal Reaching Fereshteh Sadeghi 13 28 0 18 Feb 2019
Embodied Multimodal Multitask Learning Devendra Singh Chaplot Lisa Lee Ruslan Salakhutdinov Devi Parikh Dhruv Batra LM&Ro 16 24 0 04 Feb 2019
Benchmarking Classic and Learned Navigation in Complex 3D Environments Dmytro Mishkin Alexey Dosovitskiy V. Koltun 18 75 0 30 Jan 2019
The RobotriX: An eXtremely Photorealistic and Very-Large-Scale Indoor Dataset of Sequences with Robot Trajectories and Interactions Alberto Garcia-Garcia P. Martinez-Gonzalez Sergiu Oprea John Alejandro Castro-Vargas Sergio Orts Jose Garcia-Rodriguez Alvaro Jover-Alvarez VGen 14 34 0 19 Jan 2019
What Should I Do Now? Marrying Reinforcement Learning and Symbolic Planning Daniel Gordon D. Fox Ali Farhadi 11 20 0 06 Jan 2019
Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Intervention Khanh Nguyen Debadeepta Dey Chris Brockett W. Dolan LM&Ro 15 129 0 10 Dec 2018
Coarse-Graining Auto-Encoders for Molecular Dynamics Wujie Wang Rafael Gómez-Bombarelli AI4CE 11 165 0 06 Dec 2018
Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Models Daniel E. Ritchie Kai Wang Yu-An Lin 3DV 8 155 0 29 Nov 2018
Environments for Lifelong Reinforcement Learning Khimya Khetarpal Shagun Sodhani A. Chandar Doina Precup OffRL CLL 11 8 0 26 Nov 2018
Unsupervised learning with sparse space-and-time autoencoders Benjamin Graham 3DPC 6 1 0 26 Nov 2018
Early Fusion for Goal Directed Robotic Vision Aaron Walsman Yonatan Bisk Saadia Gabriel Dipendra Kumar Misra Yoav Artzi Yejin Choi D. Fox 9 9 0 21 Nov 2018
Blindfold Baselines for Embodied QA Ankesh Anand Eugene Belilovsky Kyle Kastner Hugo Larochelle Aaron Courville 24 44 0 12 Nov 2018
Shifting the Baseline: Single Modality Performance on Visual Navigation & QA Jesse Thomason Daniel Gordon Yonatan Bisk 26 75 0 01 Nov 2018
TarMAC: Targeted Multi-Agent Communication Abhishek Das Théophile Gervet Joshua Romoff Dhruv Batra Devi Parikh Michael G. Rabbat Joelle Pineau 19 378 0 26 Oct 2018
Neural Modular Control for Embodied Question Answering Abhishek Das Georgia Gkioxari Stefan Lee Devi Parikh Dhruv Batra LM&Ro 125 127 0 26 Oct 2018
BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning Maxime Chevalier-Boisvert Dzmitry Bahdanau Salem Lahlou Lucas Willems Chitwan Saharia Thien Huu Nguyen Yoshua Bengio ELM 16 229 0 18 Oct 2018