Deep Visual Foresight for Planning Robot Motion

3 October 2016

Papers citing "Deep Visual Foresight for Planning Robot Motion"

50 / 139 papers shown

Title
Pixel Motion as Universal Representation for Robot Control Kanchana Ranasinghe Xiang Li Cristina Mata J. Park Michael S. Ryoo VGen 32 0 0 12 May 2025
Generative Artificial Intelligence in Robotic Manipulation: A Survey Anton van den Hengel Peng Yun Jun Cen Junhao Cai DiDi Zhu ... Qifeng Chen Jia Pan Wei Zhang Bo Yang Hua Chen 59 1 0 05 Mar 2025
Steganography Beyond Space-Time with Chain of Multimodal AI Ching-Chun Chang Isao Echizen 74 0 0 25 Feb 2025
BaB-ND: Long-Horizon Motion Planning with Branch-and-Bound and Neural Dynamics Keyi Shen Jiangwei Yu Huan Zhang Yunzhu Li Yunzhu Li 87 1 0 12 Dec 2024
Navigation World Models Amir Bar G. Zhou Danny Tran Trevor Darrell Yann LeCun VGen EgoV 82 14 0 04 Dec 2024
VideoAgent: Self-Improving Video Generation Achint Soni Sreyas Venkataraman Abhranil Chandra Sebastian Fischmeister Percy Liang Bo Dai Sherry Yang LM&Ro VGen 58 7 0 14 Oct 2024
StackGen: Generating Stable Structures from Silhouettes via Diffusion Luzhe Sun Takuma Yoneda Samuel Wheeler Tianchong Jiang Matthew R. Walter DiffM 39 0 0 26 Sep 2024
DiSPo: Diffusion-SSM based Policy Learning for Coarse-to-Fine Action Discretization Nayoung Oh Jaehyeong Jang Moonkyeong Jung Daehyung Park 158 0 0 23 Sep 2024
Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulators Fabian Baumeister Lukas Mack Joerg Stueckler 34 2 0 20 Sep 2024
Embodiment-Agnostic Action Planning via Object-Part Scene Flow Weiliang Tang Jia-Hui Pan Wei Zhan Jianshu Zhou Huaxiu Yao Yun-Hui Liu M. Tomizuka Mingyu Ding Chi-Wing Fu 50 0 0 16 Sep 2024
VLMPC: Vision-Language Model Predictive Control for Robotic Manipulation Wentao Zhao Jiaming Chen Ziyu Meng Donghui Mao Ran Song Wei Zhang 43 8 0 13 Jul 2024
Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability Shenyuan Gao Jiazhi Yang Li Chen Kashyap Chitta Yihang Qiu Andreas Geiger Jun Zhang Hongyang Li 65 75 0 27 May 2024
iVideoGPT: Interactive VideoGPTs are Scalable World Models Jialong Wu Shaofeng Yin Ningya Feng Xu He Dong Li Jianye Hao Mingsheng Long VGen 46 22 0 24 May 2024
Action-conditioned video data improves predictability Meenakshi Sarkar Debasish Ghose VGen 43 0 0 08 Apr 2024
On Bringing Robots Home Nur Muhammad (Mahi) Shafiullah Anant Rai Haritheja Etukuru Yiqian Liu Ishan Misra Soumith Chintala Lerrel Pinto 33 76 0 27 Nov 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 41 86 0 21 Aug 2023
DREAMWALKER: Mental Planning for Continuous Vision-Language Navigation Hanqing Wang Wei Liang Luc Van Gool Wenguan Wang LM&Ro 33 28 0 14 Aug 2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control Anthony Brohan Noah Brown Justice Carbajal Yevgen Chebotar Xi Chen ... Ted Xiao Peng-Tao Xu Sichun Xu Tianhe Yu Brianna Zitkovich LM&Ro LRM 30 1,100 0 28 Jul 2023
TOM: Learning Policy-Aware Models for Model-Based Reinforcement Learning via Transition Occupancy Matching Yecheng Jason Ma K. Sivakumar Jason Yan Osbert Bastani Dinesh Jayaraman OffRL MU 26 5 0 22 May 2023
3D-IntPhys: Towards More Generalized 3D-grounded Visual Intuitive Physics under Challenging Scenes Haotian Xue Antonio Torralba J. Tenenbaum Daniel L. K. Yamins Yunzhu Li H. Tung PINN VGen AI4CE 61 8 0 22 Apr 2023
Towards Autonomous Selective Harvesting: A Review of Robot Perception, Robot Design, Motion Planning and Control S. VishnuRajendran Bappaditya Debnath Bappaditya Debnath Sariah Mghames Willow Mandil Soran Parsa Simon Parsons Amir M. Ghalamzan-E. 32 26 0 19 Apr 2023
Ensemble Latent Space Roadmap for Improved Robustness in Visual Action Planning M. Lippi Michael C. Welle Andrea Gasparri Danica Kragic 19 0 0 27 Mar 2023
PDPP: Projected Diffusion for Procedure Planning in Instructional Videos Hanlin Wang Yilu Wu Sheng Guo Limin Wang VGen DiffM 73 30 0 26 Mar 2023
Recent Advances of Deep Robotic Affordance Learning: A Reinforcement Learning Perspective Xintong Yang Ze Ji Jing Wu Yunyu Lai 33 12 0 09 Mar 2023
Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learning Archit Sharma Ahmed M. Ahmed Rehaan Ahmad Chelsea Finn SSL 51 17 0 02 Mar 2023
Open-World Object Manipulation using Pre-trained Vision-Language Models Austin Stone Ted Xiao Yao Lu K. Gopalakrishnan Kuang-Huei Lee ... Sean Kirmani Brianna Zitkovich F. Xia Chelsea Finn Karol Hausman LM&Ro 150 145 0 02 Mar 2023
DeFNet: Deconstructed Strategy for Multi-step Fabric Folding Tasks Ningquan Gu R. He Lianqing Yu 27 1 0 01 Mar 2023
Failure-aware Policy Learning for Self-assessable Robotics Tasks Kechun Xu Runjian Chen Shuqing Zhao Zizhang Li Hongxiang Yu Ci Chen Yue Wang R. Xiong 20 1 0 25 Feb 2023
A Simple Decentralized Cross-Entropy Method Zichen Zhang Jun Jin Martin Jägersand Jun Luo Dale Schuurmans 13 8 0 16 Dec 2022
CACTI: A Framework for Scalable Multi-Task Multi-Scene Visual Imitation Learning Zhao Mandi Homanga Bharadhwaj Vincent Moens Shuran Song Aravind Rajeswaran Vikash Kumar LM&Ro 28 68 0 12 Dec 2022
Learning Sampling Distributions for Model Predictive Control Jacob Sacks Byron Boots 11 21 0 05 Dec 2022
Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimization T. Lew Sumeet Singh M. Prats Jeffrey Bingham Jonathan Weisz ... Fei Xia Peng-Tao Xu Tingnan Zhang Jie Tan Montserrat Gonzalez 32 15 0 19 Oct 2022
On the Feasibility of Cross-Task Transfer with Model-Based Reinforcement Learning Yifan Xu Nicklas Hansen Zirui Wang Yung-Chieh Chan H. Su Z. Tu OffRL 28 15 0 19 Oct 2022
DALL-E-Bot: Introducing Web-Scale Diffusion Models to Robotics Ivan Kapelyukh Vitalis Vosylius Edward Johns LM&Ro DiffM 110 145 0 05 Oct 2022
T3VIP: Transformation-based 3D Video Prediction Iman Nematollahi Erick Rosete-Beas Seyed Mahdi B. Azad Raghunandan Rajan Frank Hutter Wolfram Burgard VGen 55 1 0 19 Sep 2022
Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation Mohit Shridhar Lucas Manuelli D. Fox LM&Ro 161 457 0 12 Sep 2022
Task-Agnostic Learning to Accomplish New Tasks Xianqi Zhang Xingtao Wang Xu Liu Wenrui Wang Xiaopeng Fan Debin Zhao OffRL 85 0 0 09 Sep 2022
Learning Switching Criteria for Sim2Real Transfer of Robotic Fabric Manipulation Policies Satvik Sharma Ellen R. Novoseller Vainavi Viswanath Zaynah Javed R. Parikh Ryan Hoque Ashwin Balakrishna Daniel S. Brown Ken Goldberg 21 8 0 02 Jul 2022
Masked World Models for Visual Control Younggyo Seo Danijar Hafner Hao Liu Fangchen Liu Stephen James Kimin Lee Pieter Abbeel OffRL 87 146 0 28 Jun 2022
DayDreamer: World Models for Physical Robot Learning Philipp Wu Alejandro Escontrela Danijar Hafner Ken Goldberg Pieter Abbeel 47 277 0 28 Jun 2022
MaskViT: Masked Visual Pre-Training for Video Prediction Agrim Gupta Stephen Tian Yunzhi Zhang Jiajun Wu Roberto Martín-Martín Li Fei-Fei 107 110 0 23 Jun 2022
P3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervision Henghui Zhao Isma Hadji Nikita Dvornik Konstantinos G. Derpanis Richard P. Wildes Allan D. Jepson 26 45 0 04 May 2022
Training and Evaluation of Deep Policies using Reinforcement Learning and Generative Models Ali Ghadirzadeh Petra Poklukar Karol Arndt Chelsea Finn Ville Kyrki Danica Kragic Marten Bjorkman OffRL 22 1 0 18 Apr 2022
Simple and Effective Synthesis of Indoor 3D Scenes Jing Yu Koh Harsh Agrawal Dhruv Batra Richard Tucker Austin Waters Honglak Lee Yinfei Yang Jason Baldridge Peter Anderson VGen 3DV 21 29 0 06 Apr 2022
Augment-Connect-Explore: a Paradigm for Visual Action Planning with Data Scarcity M. Lippi Michael C. Welle Petra Poklukar Alessandro Marino Danica Kragic 24 3 0 24 Mar 2022
ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation Bokui Shen Zhenyu Jiang Chris Choy Leonidas J. Guibas Silvio Savarese Anima Anandkumar Yuke Zhu AI4CE 14 41 0 14 Mar 2022
All You Need is LUV: Unsupervised Collection of Labeled Images using Invisible UV Fluorescent Indicators Brijen Thananjeyan J. Kerr Huang Huang Joseph E. Gonzalez Ken Goldberg 28 9 0 09 Mar 2022
BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning Eric Jang A. Irpan Mohi Khansari Daniel Kappler F. Ebert Corey Lynch Sergey Levine Chelsea Finn LM&Ro 72 518 0 04 Feb 2022
Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoning Dhruv Shah Peng-Tao Xu Yao Lu Ted Xiao Alexander Toshev Sergey Levine Brian Ichter OffRL 29 41 0 04 Nov 2021
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets F. Ebert Yanlai Yang Karl Schmeckpeper Bernadette Bucher G. Georgakis Kostas Daniilidis Chelsea Finn Sergey Levine 169 219 0 27 Sep 2021