Building Generalizable Agents with a Realistic and Rich 3D Environment

7 January 2018

Papers citing "Building Generalizable Agents with a Realistic and Rich 3D Environment"

50 / 225 papers shown

Title
Silver-Bullet-3D at ManiSkill 2021: Learning-from-Demonstrations and Heuristic Rule-based Methods for Object Manipulation Yingwei Pan Yehao Li Yiheng Zhang Qi Cai Fuchen Long Zhaofan Qiu Ting Yao Tao Mei 13 3 0 13 Jun 2022
SAMPLE-HD: Simultaneous Action and Motion Planning Learning Environment Michal Nazarczuk Tony Ng K. Mikolajczyk 12 0 0 01 Jun 2022
MVMO: A Multi-Object Dataset for Wide Baseline Multi-View Semantic Segmentation Aitor Alvarez-Gila Joost van de Weijer Yaxing Wang Estíbaliz Garrote 20 0 0 30 May 2022
Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learning Maximilian Du Olivia Y. Lee Suraj Nair Chelsea Finn OffRL 49 32 0 30 May 2022
HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers Yu-Wei Chao Chris Paxton Yu Xiang Wei Yang Balakumar Sundaralingam Tao Chen Adithyavairavan Murali Maya Cakmak D. Fox 60 17 0 19 May 2022
MIDGARD: A Simulation Platform for Autonomous Navigation in Unstructured Environments Giuseppe Vecchio S. Palazzo D. Guastella Ignacio Carlucho Stefano V. Albrecht Giovanni Muscato C. Spampinato 11 0 0 17 May 2022
Cross-View Cross-Scene Multi-View Crowd Counting Qi Zhang Wei Lin Antoni B. Chan 36 62 0 03 May 2022
Unbiased Directed Object Attention Graph for Object Navigation Ronghao Dang Zhuofan Shi Liuyi Wang Zongtao He Chengju Liu Qi Chen 11 27 0 09 Apr 2022
Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions Jing Gu Eliana Stefani Qi Wu Jesse Thomason X. Wang LM&Ro 30 103 0 22 Mar 2022
Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation Yicong Hong Zun Wang Qi Wu Stephen Gould 3DV 24 63 0 05 Mar 2022
Multi-view and Multi-modal Event Detection Utilizing Transformer-based Multi-sensor fusion Masahiro Yasuda Yasunori Ohishi Shoichiro Saito N. Harada 29 13 0 18 Feb 2022
Navigating to Objects in Unseen Environments by Distance Prediction Minzhao Zhu Binglei Zhao Tao Kong 13 32 0 08 Feb 2022
Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models, Benchmark and Efficient Evaluation Marco Rosano Antonino Furnari Luigi Gulino C. Santoro G. Farinella EgoV 37 5 0 02 Feb 2022
ScanQA: 3D Question Answering for Spatial Scene Understanding Daich Azuma Taiki Miyanishi Shuhei Kurita M. Kawanabe 32 172 0 20 Dec 2021
Explore the Potential Performance of Vision-and-Language Navigation Model: a Snapshot Ensemble Method Wenda Qin Teruhisa Misu Derry Wijaya UQCV LM&Ro 17 5 0 28 Nov 2021
Autonomous Exploration Development Environment and the Planning Algorithms Chao Cao H. Zhu Fan Yang Yukun Xia Howie Choset Jean Oh Ji Zhang 25 77 0 27 Oct 2021
Goal-Aware Cross-Entropy for Multi-Target Reinforcement Learning Kibeom Kim Min Whoo Lee Yoonsung Kim Je-hwan Ryu Minsu Lee Byoung-Tak Zhang 11 8 0 25 Oct 2021
Explore before Moving: A Feasible Path Estimation and Memory Recalling Framework for Embodied Navigation Yang Wu Shirui Feng Guanbin Li Liang Lin 8 0 0 16 Oct 2021
Are you doing what I say? On modalities alignment in ALFRED Ting-Rui Chiang Yi-Ting Yeh Ta-Chung Chi Yau-Shian Wang 22 1 0 12 Oct 2021
$Pano-AVQA: Grounded Audio-Visual Question Answering on 360$^\circ$ Videos$ Pano-AVQA: Grounded Audio-Visual Question Answering on 360 $^\circ$ Videos Heeseung Yun Youngjae Yu Wonsuk Yang Kangil Lee Gunhee Kim 18 78 0 11 Oct 2021
Reinforced Natural Language Interfaces via Entropy Decomposition Xiaoran Wu Yipeng Kang LLMAG 22 0 0 23 Sep 2021
Predicting Performance of SLAM Algorithms Matteo Luperto Valerio Castelli Francesco Amigoni 26 4 0 06 Sep 2021
The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation Xiaoming Zhao Harsh Agrawal Dhruv Batra A. Schwing 28 40 0 26 Aug 2021
Vision-Language Navigation: A Survey and Taxonomy Wansen Wu Tao Chang Xinmeng Li LM&Ro 6 19 0 26 Aug 2021
Embodied AI-Driven Operation of Smart Cities: A Concise Review Farzan Shenavarmasouleh F. Mohammadi M. Amini H. Arabnia 17 8 0 22 Aug 2021
Image-Goal Navigation in Complex Environments via Modular Learning Qiaoyun Wu Jun Wang Jing Liang Xiaoxi Gong Dinesh Manocha 28 12 0 13 Aug 2021
DRQN-based 3D Obstacle Avoidance with a Limited Field of View Yuán Chen Guangda Chen Lifan Pan Jun Ma Yu Zhang Yanyong Zhang Jianmin Ji 13 7 0 12 Aug 2021
Mis-spoke or mis-lead: Achieving Robustness in Multi-Agent Communicative Reinforcement Learning Wanqi Xue Wei Qiu Bo An Zinovi Rabinovich S. Obraztsova C. Yeo AAML 45 34 0 09 Aug 2021
Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene Qi Wu Cheng-Ju Wu Yixin Zhu Jungseock Joo 38 14 0 05 Aug 2021
MFuseNet: Robust Depth Estimation with Learned Multiscopic Fusion Weihao Yuan Rui Fan M. Y. Wang Qifeng Chen MDE 11 6 0 05 Aug 2021
ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrations Tongzhou Mu Z. Ling Fanbo Xiang Derek Yang Xuanlin Li Stone Tao Zhiao Huang Zhiwei Jia Hao Su 34 130 0 30 Jul 2021
Adversarial Reinforced Instruction Attacker for Robust Vision-Language Navigation Bingqian Lin Yi Zhu Yanxin Long Xiaodan Liang QiXiang Ye Liang Lin AAML 31 16 0 23 Jul 2021
MINERVAS: Massive INterior EnviRonments VirtuAl Synthesis Haocheng Ren Hao Zhang Jia Zheng Jiaxiang Zheng Rui Tang Yuchi Huo Hujun Bao Rui Wang SyDa 3DV VGen 23 4 0 13 Jul 2021
A Systematic Survey of Text Worlds as Embodied Natural Language Environments Peter Alexander Jansen LM&Ro 10 21 0 08 Jul 2021
Deep Learning for Embodied Vision Navigation: A Survey Fengda Zhu Yi Zhu Vincent CS Lee Xiaodan Liang Xiaojun Chang EgoV LM&Ro 34 0 0 07 Jul 2021
Collaborative Visual Navigation Haiyang Wang Wenguan Wang Xizhou Zhu Jifeng Dai Liwei Wang EgoV 18 20 0 02 Jul 2021
Learning to Map for Active Semantic Goal Navigation G. Georgakis Bernadette Bucher Karl Schmeckpeper Siddharth Singh Kostas Daniilidis 25 73 0 29 Jun 2021
Habitat 2.0: Training Home Assistants to Rearrange their Habitat Andrew Szot Alexander William Clegg Eric Undersander Erik Wijmans Yili Zhao ... Z. Kira V. Koltun Jitendra Malik Manolis Savva Dhruv Batra LM&Ro 28 497 0 28 Jun 2021
Core Challenges in Embodied Vision-Language Planning Jonathan M Francis Nariaki Kitamura Felix Labelle Xiaopeng Lu Ingrid Navarro Jean Oh LM&Ro 39 45 0 26 Jun 2021
Vision-Language Navigation with Random Environmental Mixup Chong Liu Fengda Zhu Xiaojun Chang Xiaodan Liang Zongyuan Ge Yi-Dong Shen LM&Ro 48 85 0 15 Jun 2021
3DB: A Framework for Debugging Computer Vision Models Guillaume Leclerc Hadi Salman Andrew Ilyas Sai H. Vemprala Logan Engstrom ... Pengchuan Zhang Shibani Santurkar Greg Yang Ashish Kapoor A. Madry 32 40 0 07 Jun 2021
Look Wide and Interpret Twice: Improving Performance on Interactive Instruction-following Tasks Van-Quang Nguyen Masanori Suganuma Takayuki Okatani LM&Ro 11 35 0 01 Jun 2021
Fast and Slow Learning of Recurrent Independent Mechanisms Kanika Madan Rosemary Nan Ke Anirudh Goyal Bernhard Schölkopf Yoshua Bengio OCL 11 40 0 18 May 2021
Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation Muhammad Zubair Irshad Chih-Yao Ma Z. Kira LM&Ro 16 49 0 21 Apr 2021
A Self-Supervised Auxiliary Loss for Deep RL in Partially Observable Settings Eltayeb Ahmed L. Zintgraf Christian Schroeder de Witt Nicolas Usunier SSL 11 0 0 17 Apr 2021
SOON: Scenario Oriented Object Navigation with Graph-based Exploration Fengda Zhu Xiwen Liang Yi Zhu Xiaojun Chang Xiaodan Liang 11 121 0 31 Mar 2021
The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AI Chuang Gan Siyuan Zhou Jeremy Schwartz S. Alter Abhishek Bhandwaldar ... Daniel L. K. Yamins J. DiCarlo Josh H. McDermott Antonio Torralba J. Tenenbaum LM&Ro 30 74 0 25 Mar 2021
Scene-Intuitive Agent for Remote Embodied Visual Grounding Xiangru Lin Guanbin Li Yizhou Yu LM&Ro 22 52 0 24 Mar 2021
Deep Learning Based 3D Segmentation: A Survey Yong-xing He Hongshan Yu Xiao-Yang Liu Zhengeng Yang Wei Sun Ajmal Saeed Mian 3DPC 28 70 0 09 Mar 2021
Discovering Diverse Multi-Agent Strategic Behavior via Reward Randomization Zhen-Yu Tang Chao Yu Boyuan Chen Huazhe Xu Xiaolong Wang Fei Fang S. Du Yu Wang Yi Wu 25 53 0 08 Mar 2021