DayDreamer: World Models for Physical Robot Learning

28 June 2022

Pieter Abbeel

Papers citing "DayDreamer: World Models for Physical Robot Learning"

50 / 208 papers shown

Title
ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation Guanxing Lu Shiyi Zhang Ziwei Wang Changliu Liu Jiwen Lu Yansong Tang 41 49 0 13 Mar 2024
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation Guosheng Zhao Xiaofeng Wang Zheng Zhu Xinze Chen Guan Huang Xiaoyi Bao Xingang Wang VGen 20 14 0 11 Mar 2024
World Models for Autonomous Driving: An Initial Survey Yanchen Guan Haicheng Liao Zhenning Li Jia Hu Runze Yuan Yunjian Li Guohui Zhang Chengzhong Xu 21 30 0 05 Mar 2024
An Efficient Model-Based Approach on Learning Agile Motor Skills without Reinforcement Hao-bin Shi Tingguang Li Qing Zhu Jiapeng Sheng Lei Han Max Q.-H. Meng 17 1 0 04 Mar 2024
Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2) Qifeng Li Xiaosong Jia Shaobo Wang Junchi Yan 12 27 0 26 Feb 2024
Revisiting Experience Replayable Conditions Taisuke Kobayashi 19 3 0 15 Feb 2024
Learning Interpretable Policies in Hindsight-Observable POMDPs through Partially Supervised Reinforcement Learning Michael Lanier Ying Xu Nathan Jacobs Chongjie Zhang Yevgeniy Vorobeychik 16 2 0 14 Feb 2024
Exploration Without Maps via Zero-Shot Out-of-Distribution Deep Reinforcement Learning Shathushan Sivashangaran Apoorva Khairnar A. Eskandarian OffRL 32 0 0 07 Feb 2024
Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control Zhongyu Li Xue Bin Peng Pieter Abbeel Sergey Levine Glen Berseth K. Sreenath 14 25 0 30 Jan 2024
SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning Jianlan Luo Zheyuan Hu Charles Xu You Liang Tan Jacob Berg Archit Sharma S. Schaal Chelsea Finn Abhishek Gupta Sergey Levine OffRL OnRL 34 39 0 29 Jan 2024
WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens Xiaofeng Wang Zheng Zhu Guan Huang Boyuan Wang Xinze Chen Jiwen Lu VGen 19 32 0 18 Jan 2024
Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities Xu Yan Haiming Zhang Yingjie Cai Jingming Guo Weichao Qiu ... Lihui Jiang Wei Zhang Hongbo Zhang Dengxin Dai Bingbing Liu 51 16 0 16 Jan 2024
Task-Oriented Active Learning of Model Preconditions for Inaccurate Dynamics Models A. LaGrassa Moonyoung Lee Oliver Kroemer 9 2 0 08 Jan 2024
Model-Based Control with Sparse Neural Dynamics Ziang Liu Genggeng Zhou Jeff He Tobia Marcucci Fei-Fei Li Jiajun Wu Yunzhu Li AI4CE 19 6 0 20 Dec 2023
Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response Junfeng Long Zirui Wang Quanyi Li Jiawei Gao Liu Cao Jiangmiao Pang 48 25 0 18 Dec 2023
Sample-Efficient Learning to Solve a Real-World Labyrinth Game Using Data-Augmented Model-Based Reinforcement Learning Thomas Bi Raffaello DÁndrea 9 6 0 15 Dec 2023
Small Dataset, Big Gains: Enhancing Reinforcement Learning by Offline Pre-Training with Model Based Augmentation Girolamo Macaluso Alessandro Sestini Andrew D. Bagdanov OffRL OnRL 19 3 0 15 Dec 2023
ReCoRe: Regularized Contrastive Representation Learning of World Model Rudra P. K. Poudel Harit Pandya Stephan Liwicki Roberto Cipolla DRL OffRL 10 3 0 14 Dec 2023
Pearl: A Production-ready Reinforcement Learning Agent Zheqing Zhu Rodrigo de Salvo Braz Jalaj Bhandari Daniel Jiang Yi Wan ... D. Korenkevych Ürün Dogan Frank Cheng Zheng Wu Wanqiao Xu VLM OffRL OnRL 18 6 0 06 Dec 2023
Building Ears for Robots: Machine Hearing in the Age of Autonomy Xuan Zhong 8 0 0 04 Dec 2023
Spacewalk-18: A Benchmark for Multimodal and Long-form Procedural Video Understanding in Novel Domains Rohan Myer Krishnan Zitian Tang Zhiqiu Yu Chen Sun 33 1 0 30 Nov 2023
Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving Yu-Quan Wang Jiawei He Lue Fan Hongxin Li Yuntao Chen Zhaoxiang Zhang VGen 33 116 0 29 Nov 2023
Robot Learning in the Era of Foundation Models: A Survey Xuan Xiao Jiahang Liu Zhipeng Wang Yanmin Zhou Yong Qi Qian Cheng Bin He Shuo Jiang AI4CE LM&Ro 16 25 0 24 Nov 2023
ADriver-I: A General World Model for Autonomous Driving Fan Jia Weixin Mao Yingfei Liu Yucheng Zhao Yuqing Wen Chi Zhang Xiangyu Zhang Tiancai Wang 16 63 0 22 Nov 2023
Towards Continual Reinforcement Learning for Quadruped Robots G. Minelli V. Vassiliades CLL 4 1 0 12 Nov 2023
TWIST: Teacher-Student World Model Distillation for Efficient Sim-to-Real Transfer Jun Yamada Marc Rigter Jack Collins Ingmar Posner 16 5 0 07 Nov 2023
Autonomous Robotic Reinforcement Learning with Asynchronous Human Feedback Max Balsells M. Torné Zihan Wang Samedh Desai Pulkit Agrawal Abhishek Gupta 37 10 0 31 Oct 2023
Grow Your Limits: Continuous Improvement with Real-World RL for Robotic Locomotion Laura M. Smith Yunhao Cao Sergey Levine OffRL 10 18 0 26 Oct 2023
Model-Based Runtime Monitoring with Interactive Imitation Learning Huihan Liu Shivin Dass Roberto Martín-Martín Yuke Zhu 24 19 0 26 Oct 2023
Finetuning Offline World Models in the Real World Yunhai Feng Nicklas Hansen Ziyan Xiong Chandramouli Rajagopalan Xiaolong Wang OffRL OnRL 9 20 0 24 Oct 2023
Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models Kevin Black Mitsuhiko Nakamoto P. Atreya Homer Walke Chelsea Finn Aviral Kumar Sergey Levine DiffM LM&Ro 13 130 0 16 Oct 2023
Learning Object Permanence from Videos via Latent Imaginations Manuel Traub Frederic Becker S. Otte Martin Volker Butz 25 1 0 16 Oct 2023
DexCatch: Learning to Catch Arbitrary Objects with Dexterous Hands Fengbo Lan Shengjie Wang Yunzhe Zhang Haotian Xu Oluwatosin Oseni Yang Gao Tao Zhang 29 0 0 13 Oct 2023
Unifying Foundation Models with Quadrotor Control for Visual Tracking Beyond Object Categories Alessandro Saviolo P. Rao Vivek Radhakrishnan Jiuhong Xiao Giuseppe Loianno 15 5 0 07 Oct 2023
Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models Xiaoxiao Sun Yang Yang Michal Shlapentokh-Rothman Haohan Wang Yu-xiong Wang LRM AI4CE LM&Ro LLMAG 26 183 0 06 Oct 2023
Differentially Encoded Observation Spaces for Perceptive Reinforcement Learning Lev Grossman Brian Plancher OffRL 13 0 0 03 Oct 2023
HarmonyDream: Task Harmonization Inside World Models Haoyu Ma Jialong Wu Ningya Feng Chenjun Xiao Dong Li Jianye Hao Jianmin Wang Mingsheng Long 25 7 0 30 Sep 2023
GAIA-1: A Generative World Model for Autonomous Driving Masane Fuchi Lloyd Russell Hudson Yeo Zak Murez Hiroto Minami Alex Kendall Tomohiro Takagi Gianluca Corrado VGen 11 215 0 29 Sep 2023
Extreme Parkour with Legged Robots Xuxin Cheng Kexin Shi Ananye Agarwal Deepak Pathak 17 146 0 25 Sep 2023
MoDem-V2: Visuo-Motor World Models for Real-World Robot Manipulation Patrick E. Lancaster Nicklas Hansen Aravind Rajeswaran Vikash Kumar LM&Ro 17 14 0 25 Sep 2023
Prompt a Robot to Walk with Large Language Models Yen-Jen Wang Bike Zhang Jianyu Chen K. Sreenath LM&Ro LLMAG 10 25 0 18 Sep 2023
DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving Xiaofeng Wang Zheng Hua Zhu Guan Huang Xinze Chen Jiagang Zhu Jiwen Lu VGen 8 148 0 18 Sep 2023
From Knowing to Doing: Learning Diverse Motor Skills through Instruction Learning Linqi Ye Jiayi Li Yi Cheng Xianhao Wang Bin Liang Yan Peng 8 7 0 17 Sep 2023
Predicting Routine Object Usage for Proactive Robot Assistance Maithili Patel Aswin Prakash Sonia Chernova AI4TS 21 8 0 12 Sep 2023
RePo: Resilient Model-Based Reinforcement Learning by Regularizing Posterior Predictability Chuning Zhu Max Simchowitz Siri Gadipudi Abhishek Gupta 26 13 0 31 Aug 2023
Learning to Navigate from Scratch using World Models and Curiosity: the Good, the Bad, and the Ugly Daria de Tinguy Sven Remmery Pietro Mazzaglia Tim Verbelen Bart Dhoedt 13 0 0 30 Aug 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 13 85 0 21 Aug 2023
Robust Quadrupedal Locomotion via Risk-Averse Policy Learning Jiyuan Shi Chenjia Bai Haoran He Lei Han Dong Wang Bin Zhao Mingguo Zhao Xiuyang Li Xuelong Li OffRL OOD 6 9 0 18 Aug 2023
Consciousness in Artificial Intelligence: Insights from the Science of Consciousness Patrick Butlin R. Long Eric Elmoznino Yoshua Bengio Jonathan C. P. Birch ... L. Mudrik Megan A. K. Peters Eric Schwitzgebel Jonathan Simon Rufin VanRullen LLMAG 16 95 0 17 Aug 2023
On-Robot Bayesian Reinforcement Learning for POMDPs Hai V. Nguyen Sammie Katt Yuchen Xiao Chris Amato OffRL 10 1 0 22 Jul 2023