Learning to Act by Predicting the Future

6 November 2016

Alexey Dosovitskiy

Papers citing "Learning to Act by Predicting the Future"

41 / 41 papers shown

Title
Temporal Representation Alignment: Successor Features Enable Emergent Compositionality in Robot Instruction Following Vivek Myers Bill Chunyuan Zheng Anca Dragan Kuan Fang Sergey Levine 60 0 0 08 Feb 2025
Learning to Navigate in Mazes with Novel Layouts using Abstract Top-down Maps Linfeng Zhao Lawson L. S. Wong 74 1 0 16 Dec 2024
Active Perception using Neural Radiance Fields Siming He Christopher D. Hsu Dexter Ong Yifei Shao Pratik Chaudhari AI4CE 41 8 0 15 Oct 2023
Navigating to Objects in the Real World Théophile Gervet Soumith Chintala Dhruv Batra Jitendra Malik Devendra Singh Chaplot 27 122 0 02 Dec 2022
EgoEnv: Human-centric environment representations from egocentric video Tushar Nagarajan Santhosh Kumar Ramakrishnan Ruta Desai James M. Hillis Kristen Grauman EgoV 21 19 0 22 Jul 2022
Contrastive Learning as Goal-Conditioned Reinforcement Learning Benjamin Eysenbach Tianjun Zhang Ruslan Salakhutdinov Sergey Levine SSL OffRL 23 137 0 15 Jun 2022
GraphMapper: Efficient Visual Navigation by Scene Graph Generation Zachary Seymour Niluthpol Chowdhury Mithun Han-Pang Chiu S. Samarasekera Rakesh Kumar 16 8 0 17 May 2022
Navigating to Objects in Unseen Environments by Distance Prediction Minzhao Zhu Binglei Zhao Tao Kong 13 32 0 08 Feb 2022
Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigation Pierre Marza L. Matignon Olivier Simonin Christian Wolf 26 23 0 13 Jul 2021
Which Mutual-Information Representation Learning Objectives are Sufficient for Control? Kate Rakelly Abhishek Gupta Carlos Florensa Sergey Levine SSL 13 38 0 14 Jun 2021
MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigation Zachary Seymour Kowshik Thopalli Niluthpol Chowdhury Mithun Han-Pang Chiu S. Samarasekera Rakesh Kumar 3DPC 13 18 0 21 Mar 2021
Foresee then Evaluate: Decomposing Value Estimation with Latent Future Prediction Hongyao Tang Jianye Hao Guangyong Chen Pengfei Chen C. L. P. Chen Yaodong Yang Lu Zhang Wulong Liu Zhaopeng Meng OffRL 10 4 0 03 Mar 2021
An analysis of Reinforcement Learning applied to Coach task in IEEE Very Small Size Soccer Carlos H. C. Pena Mateus G. Machado M. S. Barros José D. P. Silva Lucas D. Maciel Ing Ren Tsang Edna N. S. Barros Pedro H. M. Braga H. Bassani 18 1 0 23 Nov 2020
Deep Affordance Foresight: Planning Through What Can Be Done in the Future Danfei Xu Ajay Mandlekar Roberto Martín-Martín Yuke Zhu Silvio Savarese Li Fei-Fei 17 70 0 17 Nov 2020
Semantic Curiosity for Active Visual Learning Devendra Singh Chaplot Helen Jiang Saurabh Gupta Abhinav Gupta ObjD 16 72 0 16 Jun 2020
Deep Visual Reasoning: Learning to Predict Action Sequences for Task and Motion Planning from an Initial Scene Image Danny Driess Jung-Su Ha Marc Toussaint LRM 11 100 0 09 Jun 2020
Mathematical Reasoning in Latent Space Dennis Lee Christian Szegedy M. Rabe Sarah M. Loos Kshitij Bansal 9 33 0 26 Sep 2019
Learning Your Way Without Map or Compass: Panoramic Target Driven Visual Navigation David Watkins-Valls Jingxi Xu Nicholas R. Waytowich Peter K. Allen SSL 22 15 0 20 Sep 2019
Learning Belief Representations for Imitation Learning in POMDPs Tanmay Gangwani Joel Lehman Qiang Liu Jian Peng 11 36 0 22 Jun 2019
NeoNav: Improving the Generalization of Visual Navigation via Generating Next Expected Observations Qiaoyun Wu Dinesh Manocha Jun Wang Kai Xu 8 15 0 17 Jun 2019
Self-Adapting Goals Allow Transfer of Predictive Models to New Tasks K. Ellefsen J. Tørresen 8 1 0 04 Apr 2019
DIViS: Domain Invariant Visual Servoing for Collision-Free Goal Reaching Fereshteh Sadeghi 13 28 0 18 Feb 2019
Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Control F. Ebert Chelsea Finn Sudeep Dasari Annie Xie Alex X. Lee Sergey Levine SSL 18 377 0 03 Dec 2018
Neural Predictive Belief Representations Z. Guo M. G. Azar Bilal Piot Bernardo Avila-Pires Rémi Munos SSL 11 80 0 15 Nov 2018
ViZDoom Competitions: Playing Doom from Pixels Marek Wydmuch Michal Kempka Wojciech Ja'skowski 18 119 0 10 Sep 2018
Expert-augmented actor-critic for ViZDoom and Montezumas Revenge Michal Garmulewicz Henryk Michalewski Piotr Milos 14 8 0 10 Sep 2018
Unity: A General Platform for Intelligent Agents Arthur Juliani Vincent-Pierre Berges Esh Vckay Andrew Cohen Jonathan Harper ... Chris Goy Yuan Gao Hunter Henry Marwan Mattar Danny Lange 11 807 0 07 Sep 2018
CIRL: Controllable Imitative Reinforcement Learning for Vision-based Self-driving Xiaodan Liang Tairui Wang Luona Yang Eric P. Xing 19 266 0 10 Jul 2018
Variance Reduction for Reinforcement Learning in Input-Driven Environments Hongzi Mao S. Venkatakrishnan Malte Schwarzkopf Mohammad Alizadeh OffRL 25 94 0 06 Jul 2018
A neural network trained to predict future video frames mimics critical properties of biological neuronal responses and perception William Lotter Gabriel Kreiman David D. Cox 27 31 0 28 May 2018
Automated Curriculum Learning by Rewarding Temporally Rare Events Niels Justesen S. Risi OffRL 19 20 0 19 Mar 2018
Temporal Difference Models: Model-Free Deep RL for Model-Based Control Vitchyr H. Pong S. Gu Murtaza Dalal Sergey Levine OffRL 63 237 0 25 Feb 2018
Building machines that adapt and compute like brains Brenden Lake J. Tenenbaum AI4CE FedML NAI AILaw 245 890 0 11 Nov 2017
CARLA: An Open Urban Driving Simulator Alexey Dosovitskiy G. Ros Felipe Codevilla Antonio M. López V. Koltun VLM 43 5,052 0 10 Nov 2017
Neural Task Programming: Learning to Generalize Across Hierarchical Tasks Danfei Xu Suraj Nair Yuke Zhu J. Gao Animesh Garg Li Fei-Fei Silvio Savarese 14 193 0 04 Oct 2017
Autoencoder-augmented Neuroevolution for Visual Doom Playing Samuel Alvernaz Julian Togelius 15 62 0 12 Jul 2017
ScaleNet: Guiding Object Proposal Generation in Supermarkets and Beyond Siyuan Qiao Wei Shen Weichao Qiu Chenxi Liu Alan Yuille 14 36 0 22 Apr 2017
Predicting Deeper into the Future of Semantic Segmentation Pauline Luc Natalia Neverova Camille Couprie Jakob Verbeek Yann LeCun 21 241 0 22 Mar 2017
Deep Reinforcement Learning: An Overview Yuxi Li OffRL VLM 80 1,502 0 25 Jan 2017
Loss is its own Reward: Self-Supervision for Reinforcement Learning Evan Shelhamer Parsa Mahmoudieh Max Argus Trevor Darrell SSL 10 186 0 21 Dec 2016
Playing Doom with SLAM-Augmented Deep Reinforcement Learning Shehroze Bhatti Alban Desmaison O. Mikšík Nantas Nardelli N. Siddharth Philip H. S. Torr OffRL 24 69 0 01 Dec 2016