Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Control

3 December 2018

Papers citing "Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Control"

50 / 61 papers shown

Title
Generative Artificial Intelligence in Robotic Manipulation: A Survey Kun Zhang Peng Yun Jun Cen Junhao Cai DiDi Zhu ... Qifeng Chen Jia Pan Wei K. Zhang Bo Yang Hua Chen 59 1 0 05 Mar 2025
Rapidly Adapting Policies to the Real World via Simulation-Guided Fine-Tuning Patrick Yin Tyler Westenbroek Simran Bagaria Kevin Huang Ching-an Cheng Andrey Kobolov Abhishek Gupta 70 2 0 04 Feb 2025
OMG-RL:Offline Model-based Guided Reward Learning for Heparin Treatment Yooseok Lim Sujee Lee OffRL 146 0 0 03 Jan 2025
Perception Stitching: Zero-Shot Perception Encoder Transfer for Visuomotor Robot Policies Pingcheng Jian Easop Lee Zachary I. Bell Michael M. Zavlanos Boyuan Chen 65 1 0 03 Jan 2025
BaB-ND: Long-Horizon Motion Planning with Branch-and-Bound and Neural Dynamics Keyi Shen Jiangwei Yu Huan Zhang Yunzhu Li Yunzhu Li 81 1 0 12 Dec 2024
Prioritized Generative Replay Renhao Wang Kevin Frans Pieter Abbeel Sergey Levine Alexei A. Efros OnRL DiffM 106 2 0 23 Oct 2024
Dynamic Cloth Manipulation Considering Variable Stiffness and Material Change Using Deep Predictive Model with Parametric Bias Kento Kawaharazuka Akihiro Miki Masahiro Bando Kei Okada Masayuki Inaba AI4CE 29 10 0 24 Sep 2024
Points2Plans: From Point Clouds to Long-Horizon Plans with Composable Relational Dynamics Yixuan Huang Christopher Agia Jimmy Wu Tucker Hermans Jeannette Bohg 3DPC 46 1 0 27 Aug 2024
Adapt2Reward: Adapting Video-Language Models to Generalizable Robotic Rewards via Failure Prompts Yanting Yang Minghao Chen Qibo Qiu Jiahao Wu Wenxiao Wang Binbin Lin Ziyu Guan Xiaofei He LM&Ro 37 2 0 20 Jul 2024
VLMPC: Vision-Language Model Predictive Control for Robotic Manipulation Wentao Zhao Jiaming Chen Ziyu Meng Donghui Mao Ran Song Wei Zhang 35 8 0 13 Jul 2024
Hierarchical World Models as Visual Whole-Body Humanoid Controllers Nicklas Hansen V. JyothirS Vlad Sobal Yann LeCun Xiaolong Wang Hao Su VGen 48 10 0 28 May 2024
Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability Shenyuan Gao Jiazhi Yang Li Chen Kashyap Chitta Yihang Qiu Andreas Geiger Jun Zhang Hongyang Li 60 75 0 27 May 2024
iVideoGPT: Interactive VideoGPTs are Scalable World Models Jialong Wu Shaofeng Yin Ningya Feng Xu He Dong Li Jianye Hao Mingsheng Long VGen 35 23 0 24 May 2024
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset Alexander Khazatsky Karl Pertsch Suraj Nair Ashwin Balakrishna Sudeep Dasari ... Thomas Kollar Sergey Levine Chelsea Finn Sergey Levine Chelsea Finn 41 176 0 19 Mar 2024
On Bringing Robots Home Nur Muhammad (Mahi) Shafiullah Anant Rai Haritheja Etukuru Yiqian Liu Ishan Misra Soumith Chintala Lerrel Pinto 27 76 0 27 Nov 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 21 85 0 21 Aug 2023
Actor-Critic Model Predictive Control Angel Romero Yunlong Song Davide Scaramuzza 33 35 0 16 Jun 2023
TOM: Learning Policy-Aware Models for Model-Based Reinforcement Learning via Transition Occupancy Matching Yecheng Jason Ma K. Sivakumar Jason Yan Osbert Bastani Dinesh Jayaraman OffRL MU 19 5 0 22 May 2023
Robust Body Exposure (RoBE): A Graph-based Dynamics Modeling Approach to Manipulating Blankets over People Kavya Puthuveetil S. Wald Atharva Pusalkar Pratyusha Karnati Zackory M. Erickson 19 4 0 10 Apr 2023
Failure-aware Policy Learning for Self-assessable Robotics Tasks Kechun Xu Runjian Chen Shuqing Zhao Zizhang Li Hongxiang Yu Ci Chen Yue Wang R. Xiong 14 1 0 25 Feb 2023
A Simple Decentralized Cross-Entropy Method Zichen Zhang Jun Jin Martin Jägersand Jun-Jie Luo Dale Schuurmans 11 8 0 16 Dec 2022
Composing Ensembles of Pre-trained Models via Iterative Consensus Shuang Li Yilun Du J. Tenenbaum Antonio Torralba Igor Mordatch MoMe 19 23 0 20 Oct 2022
DayDreamer: World Models for Physical Robot Learning Philipp Wu Alejandro Escontrela Danijar Hafner Ken Goldberg Pieter Abbeel 38 276 0 28 Jun 2022
MaskViT: Masked Visual Pre-Training for Video Prediction Agrim Gupta Stephen Tian Yunzhi Zhang Jiajun Wu Roberto Martín-Martín Li Fei-Fei 100 110 0 23 Jun 2022
Vision-Based Manipulators Need to Also See from Their Hands Kyle Hsu Moo Jin Kim Rafael Rafailov Jiajun Wu Chelsea Finn 22 43 0 15 Mar 2022
Graph Neural Networks for Relational Inductive Bias in Vision-based Deep Reinforcement Learning of Robot Control Marco Oliva Soubarna Banik Josip Josifovski Alois C. Knoll 19 5 0 11 Mar 2022
Temporal Difference Learning for Model Predictive Control Nicklas Hansen Xiaolong Wang H. Su PINN MU 31 219 0 09 Mar 2022
The Information Geometry of Unsupervised Reinforcement Learning Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine SSL OffRL 53 31 0 06 Oct 2021
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets F. Ebert Yanlai Yang Karl Schmeckpeper Bernadette Bucher G. Georgakis Kostas Daniilidis Chelsea Finn Sergey Levine 161 218 0 27 Sep 2021
Example-Driven Model-Based Reinforcement Learning for Solving Long-Horizon Visuomotor Tasks Bohan Wu Suraj Nair Li Fei-Fei Chelsea Finn OffRL LM&Ro 38 24 0 21 Sep 2021
Stabilizing Deep Q-Learning with ConvNets and Vision Transformers under Data Augmentation Nicklas Hansen H. Su Xiaolong Wang OffRL 10 132 0 01 Jul 2021
Pushing it out of the Way: Interactive Visual Navigation Kuo-Hao Zeng Luca Weihs Ali Farhadi Roozbeh Mottaghi 15 30 0 28 Apr 2021
MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale Dmitry Kalashnikov Jacob Varley Yevgen Chebotar Benjamin Swanson Rico Jonschkowski Chelsea Finn Sergey Levine Karol Hausman OffRL 35 270 0 16 Apr 2021
Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videos Annie S. Chen Suraj Nair Chelsea Finn 17 136 0 31 Mar 2021
HyperDynamics: Meta-Learning Object and Agent Dynamics with Hypernetworks Zhou Xian Shamit Lal H. Tung Emmanouil Antonios Platanios Katerina Fragkiadaki AI4CE 20 23 0 17 Mar 2021
Cloth Manipulation Planning on Basis of Mesh Representations with Incomplete Domain Knowledge and Voxel-to-Mesh Estimation S. Arnold Daisuke Tanaka Kimitoshi Yamazaki 16 4 0 15 Mar 2021
Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction Bohan Wu Suraj Nair Roberto Martin-Martin Li Fei-Fei Chelsea Finn DRL 16 99 0 06 Mar 2021
Deep Affordance Foresight: Planning Through What Can Be Done in the Future Danfei Xu Ajay Mandlekar Roberto Martín-Martín Yuke Zhu Silvio Savarese Li Fei-Fei 17 70 0 17 Nov 2020
A Long Horizon Planning Framework for Manipulating Rigid Pointcloud Objects Anthony Simeonov Yilun Du Beomjoon Kim F. Hogan J. Tenenbaum Pulkit Agrawal Alberto Rodriguez 3DPC 17 49 0 16 Nov 2020
Learning World Transition Model for Socially Aware Robot Navigation Yuxiang Cui Haodong Zhang Yue Wang R. Xiong 25 17 0 08 Nov 2020
COG: Connecting New Skills to Past Experience with Offline Reinforcement Learning Avi Singh Albert Yu Jonathan Yang Jesse Zhang Aviral Kumar Sergey Levine SSL OffRL OnRL 21 103 0 27 Oct 2020
Keypoints into the Future: Self-Supervised Correspondence in Model-Based Reinforcement Learning Lucas Manuelli Yunzhu Li Peter R. Florence Russ Tedrake SSL 14 102 0 10 Sep 2020
Learning Long-term Visual Dynamics with Region Proposal Interaction Networks Haozhi Qi Xiaolong Wang Deepak Pathak Yi-An Ma Jitendra Malik 28 56 0 05 Aug 2020
Self-Supervised Policy Adaptation during Deployment Nicklas Hansen Rishabh Jangir Yu Sun Guillem Alenyà Pieter Abbeel Alexei A. Efros Lerrel Pinto Xiaolong Wang 25 159 0 08 Jul 2020
Language Conditioned Imitation Learning over Unstructured Data Corey Lynch P. Sermanet LM&Ro 25 241 0 15 May 2020
Learning Dense Visual Correspondences in Simulation to Smooth and Fold Real Fabrics Aditya Ganapathi Priya Sundaresan Brijen Thananjeyan Ashwin Balakrishna Daniel Seita ... Joseph E. Gonzalez Nawid Jamali K. Yamane Soshi Iba Ken Goldberg 17 27 0 28 Mar 2020
Probably Approximately Correct Vision-Based Planning using Motion Primitives Sushant Veer Anirudha Majumdar 3DV 6 21 0 28 Feb 2020
Disentangling Controllable Object through Video Prediction Improves Visual Reinforcement Learning Yuanyi Zhong A. Schwing Jian Peng DRL 8 5 0 21 Feb 2020
Causally Correct Partial Models for Reinforcement Learning Danilo Jimenez Rezende Ivo Danihelka George Papamakarios Nan Rosemary Ke Ray Jiang ... Jane X. Wang Jovana Mitrović F. Besse Ioannis Antonoglou Lars Buesing AI4TS 11 32 0 07 Feb 2020
Learning Predictive Models From Observation and Interaction Karl Schmeckpeper Annie Xie Oleh Rybkin Stephen Tian Kostas Daniilidis Sergey Levine Chelsea Finn DRL 22 60 0 30 Dec 2019