Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Control

3 December 2018

Papers citing "Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Control"

50 / 70 papers shown

Title
Generative Artificial Intelligence in Robotic Manipulation: A Survey Kun Zhang Peng Yun Jun Cen Junhao Cai DiDi Zhu ... Qifeng Chen Jia Pan Wei K. Zhang Bo Yang Hua Chen 59 1 0 05 Mar 2025
Rapidly Adapting Policies to the Real World via Simulation-Guided Fine-Tuning Patrick Yin Tyler Westenbroek Simran Bagaria Kevin Huang Ching-an Cheng Andrey Kobolov Abhishek Gupta 70 2 0 04 Feb 2025
Perception Stitching: Zero-Shot Perception Encoder Transfer for Visuomotor Robot Policies Pingcheng Jian Easop Lee Zachary I. Bell Michael M. Zavlanos Boyuan Chen 67 1 0 03 Jan 2025
OMG-RL:Offline Model-based Guided Reward Learning for Heparin Treatment Yooseok Lim Sujee Lee OffRL 146 0 0 03 Jan 2025
BaB-ND: Long-Horizon Motion Planning with Branch-and-Bound and Neural Dynamics Keyi Shen Jiangwei Yu Huan Zhang Yunzhu Li Yunzhu Li 84 1 0 12 Dec 2024
Prioritized Generative Replay Renhao Wang Kevin Frans Pieter Abbeel Sergey Levine Alexei A. Efros OnRL DiffM 111 2 0 23 Oct 2024
Dynamic Cloth Manipulation Considering Variable Stiffness and Material Change Using Deep Predictive Model with Parametric Bias Kento Kawaharazuka Akihiro Miki Masahiro Bando Kei Okada Masayuki Inaba AI4CE 32 10 0 24 Sep 2024
Points2Plans: From Point Clouds to Long-Horizon Plans with Composable Relational Dynamics Yixuan Huang Christopher Agia Jimmy Wu Tucker Hermans Jeannette Bohg 3DPC 49 1 0 27 Aug 2024
Adapt2Reward: Adapting Video-Language Models to Generalizable Robotic Rewards via Failure Prompts Yanting Yang Minghao Chen Qibo Qiu Jiahao Wu Wenxiao Wang Binbin Lin Ziyu Guan Xiaofei He LM&Ro 37 2 0 20 Jul 2024
VLMPC: Vision-Language Model Predictive Control for Robotic Manipulation Wentao Zhao Jiaming Chen Ziyu Meng Donghui Mao Ran Song Wei Zhang 37 8 0 13 Jul 2024
Hierarchical World Models as Visual Whole-Body Humanoid Controllers Nicklas Hansen V. JyothirS Vlad Sobal Yann LeCun Xiaolong Wang Hao Su VGen 48 10 0 28 May 2024
Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability Shenyuan Gao Jiazhi Yang Li Chen Kashyap Chitta Yihang Qiu Andreas Geiger Jun Zhang Hongyang Li 60 75 0 27 May 2024
iVideoGPT: Interactive VideoGPTs are Scalable World Models Jialong Wu Shaofeng Yin Ningya Feng Xu He Dong Li Jianye Hao Mingsheng Long VGen 37 23 0 24 May 2024
Model-based Reinforcement Learning for Parameterized Action Spaces Renhao Zhang Haotian Fu Yilin Miao G. Konidaris 26 3 0 03 Apr 2024
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset Alexander Khazatsky Karl Pertsch Suraj Nair Ashwin Balakrishna Sudeep Dasari ... Thomas Kollar Sergey Levine Chelsea Finn Sergey Levine Chelsea Finn 44 176 0 19 Mar 2024
On Bringing Robots Home Nur Muhammad (Mahi) Shafiullah Anant Rai Haritheja Etukuru Yiqian Liu Ishan Misra Soumith Chintala Lerrel Pinto 31 76 0 27 Nov 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 30 85 0 21 Aug 2023
Actor-Critic Model Predictive Control Angel Romero Yunlong Song Davide Scaramuzza 36 35 0 16 Jun 2023
TOM: Learning Policy-Aware Models for Model-Based Reinforcement Learning via Transition Occupancy Matching Yecheng Jason Ma K. Sivakumar Jason Yan Osbert Bastani Dinesh Jayaraman OffRL MU 24 5 0 22 May 2023
Robust Body Exposure (RoBE): A Graph-based Dynamics Modeling Approach to Manipulating Blankets over People Kavya Puthuveetil S. Wald Atharva Pusalkar Pratyusha Karnati Zackory M. Erickson 19 4 0 10 Apr 2023
Failure-aware Policy Learning for Self-assessable Robotics Tasks Kechun Xu Runjian Chen Shuqing Zhao Zizhang Li Hongxiang Yu Ci Chen Yue Wang R. Xiong 14 1 0 25 Feb 2023
A Simple Decentralized Cross-Entropy Method Zichen Zhang Jun Jin Martin Jägersand Jun-Jie Luo Dale Schuurmans 13 8 0 16 Dec 2022
MoDem: Accelerating Visual Model-Based Reinforcement Learning with Demonstrations Nicklas Hansen Yixin Lin H. Su Xiaolong Wang Vikash Kumar Aravind Rajeswaran OffRL 24 49 0 12 Dec 2022
Composing Ensembles of Pre-trained Models via Iterative Consensus Shuang Li Yilun Du J. Tenenbaum Antonio Torralba Igor Mordatch MoMe 19 23 0 20 Oct 2022
Masked World Models for Visual Control Younggyo Seo Danijar Hafner Hao Liu Fangchen Liu Stephen James Kimin Lee Pieter Abbeel OffRL 77 145 0 28 Jun 2022
DayDreamer: World Models for Physical Robot Learning Philipp Wu Alejandro Escontrela Danijar Hafner Ken Goldberg Pieter Abbeel 44 276 0 28 Jun 2022
MaskViT: Masked Visual Pre-Training for Video Prediction Agrim Gupta Stephen Tian Yunzhi Zhang Jiajun Wu Roberto Martín-Martín Li Fei-Fei 100 110 0 23 Jun 2022
A Survey on Model-based Reinforcement Learning Fan Luo Tian Xu Hang Lai Xiong-Hui Chen Weinan Zhang Yang Yu OffRL LRM 39 101 0 19 Jun 2022
Vision-Based Manipulators Need to Also See from Their Hands Kyle Hsu Moo Jin Kim Rafael Rafailov Jiajun Wu Chelsea Finn 24 44 0 15 Mar 2022
Graph Neural Networks for Relational Inductive Bias in Vision-based Deep Reinforcement Learning of Robot Control Marco Oliva Soubarna Banik Josip Josifovski Alois C. Knoll 24 5 0 11 Mar 2022
Temporal Difference Learning for Model Predictive Control Nicklas Hansen Xiaolong Wang H. Su PINN MU 36 219 0 09 Mar 2022
You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstration Bowen Wen Wenzhao Lian Kostas Bekris S. Schaal 12 89 0 30 Jan 2022
The Information Geometry of Unsupervised Reinforcement Learning Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine SSL OffRL 53 31 0 06 Oct 2021
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets F. Ebert Yanlai Yang Karl Schmeckpeper Bernadette Bucher G. Georgakis Kostas Daniilidis Chelsea Finn Sergey Levine 161 218 0 27 Sep 2021
Example-Driven Model-Based Reinforcement Learning for Solving Long-Horizon Visuomotor Tasks Bohan Wu Suraj Nair Li Fei-Fei Chelsea Finn OffRL LM&Ro 38 24 0 21 Sep 2021
Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotation Suraj Nair E. Mitchell Kevin Chen Brian Ichter Silvio Savarese Chelsea Finn LM&Ro OffRL 23 154 0 02 Sep 2021
Stabilizing Deep Q-Learning with ConvNets and Vision Transformers under Data Augmentation Nicklas Hansen H. Su Xiaolong Wang OffRL 15 133 0 01 Jul 2021
Pushing it out of the Way: Interactive Visual Navigation Kuo-Hao Zeng Luca Weihs Ali Farhadi Roozbeh Mottaghi 18 30 0 28 Apr 2021
MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale Dmitry Kalashnikov Jacob Varley Yevgen Chebotar Benjamin Swanson Rico Jonschkowski Chelsea Finn Sergey Levine Karol Hausman OffRL 35 270 0 16 Apr 2021
Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videos Annie S. Chen Suraj Nair Chelsea Finn 27 136 0 31 Mar 2021
Unsupervised Feature Learning for Manipulation with Contrastive Domain Randomization Carmel Rabinovitz Niko A. Grupen Aviv Tamar OOD SSL 12 3 0 20 Mar 2021
HyperDynamics: Meta-Learning Object and Agent Dynamics with Hypernetworks Zhou Xian Shamit Lal H. Tung Emmanouil Antonios Platanios Katerina Fragkiadaki AI4CE 30 23 0 17 Mar 2021
Cloth Manipulation Planning on Basis of Mesh Representations with Incomplete Domain Knowledge and Voxel-to-Mesh Estimation S. Arnold Daisuke Tanaka Kimitoshi Yamazaki 16 4 0 15 Mar 2021
Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction Bohan Wu Suraj Nair Roberto Martin-Martin Li Fei-Fei Chelsea Finn DRL 16 99 0 06 Mar 2021
Deep Affordance Foresight: Planning Through What Can Be Done in the Future Danfei Xu Ajay Mandlekar Roberto Martín-Martín Yuke Zhu Silvio Savarese Li Fei-Fei 25 70 0 17 Nov 2020
A Long Horizon Planning Framework for Manipulating Rigid Pointcloud Objects Anthony Simeonov Yilun Du Beomjoon Kim F. Hogan J. Tenenbaum Pulkit Agrawal Alberto Rodriguez 3DPC 17 49 0 16 Nov 2020
Learning World Transition Model for Socially Aware Robot Navigation Yuxiang Cui Haodong Zhang Yue Wang R. Xiong 28 17 0 08 Nov 2020
COG: Connecting New Skills to Past Experience with Offline Reinforcement Learning Avi Singh Albert Yu Jonathan Yang Jesse Zhang Aviral Kumar Sergey Levine SSL OffRL OnRL 27 103 0 27 Oct 2020
Keypoints into the Future: Self-Supervised Correspondence in Model-Based Reinforcement Learning Lucas Manuelli Yunzhu Li Peter R. Florence Russ Tedrake SSL 22 102 0 10 Sep 2020
Learning Long-term Visual Dynamics with Region Proposal Interaction Networks Haozhi Qi Xiaolong Wang Deepak Pathak Yi-An Ma Jitendra Malik 28 56 0 05 Aug 2020