DayDreamer: World Models for Physical Robot Learning

28 June 2022

Pieter Abbeel

Papers citing "DayDreamer: World Models for Physical Robot Learning"

50 / 208 papers shown

Title
LoopSR: Looping Sim-and-Real for Lifelong Policy Adaptation of Legged Robots Peilin Wu Weiji Xie Jiahang Cao Hang Lai Weinan Zhang 18 0 0 26 Sep 2024
World Model-based Perception for Visual Legged Locomotion Hang Lai Jiahang Cao Jiafeng Xu Hongtao Wu Yunfeng Lin Tao Kong Yong Yu Weinan Zhang VGen 19 2 0 25 Sep 2024
Mitigating Covariate Shift in Imitation Learning for Autonomous Vehicles Using Latent Space Generative World Models A. Popov Alperen Degirmenci David Wehr Shashank Hegde Ryan Oldja ... David Nistér Urs Muller Ruchi Bhargava Stan Birchfield Nikolai Smolyanskiy 75 9 0 25 Sep 2024
One-shot World Models Using a Transformer Trained on a Synthetic Prior Fabio Ferreira Moreno Schlageter Raghu Rajan André Biedenkapp Frank Hutter 20 0 0 21 Sep 2024
SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experience Elliot Chane-Sane Joseph Amigo Thomas Flayols Ludovic Righetti Nicolas Mansard 35 5 0 20 Sep 2024
No Saved Kaleidosope: an 100% Jitted Neural Network Coding Language with Pythonic Syntax Augusto Seben da Rosa Marlon Daniel Angeli Jorge Aikes Junior Alef Iury Ferreira L. Gris Anderson da Silva Soares Arnaldo Candido Junior Frederico Santos de Oliveira Gabriel Trevisan Damke Rafael Teixeira Sousa 13 0 0 17 Sep 2024
Critic as Lyapunov function (CALF): a model-free, stability-ensuring agent Pavel Osinenko Grigory Yaremenko Roman Zashchitin Anton Bolychev Sinan Ibrahim D. Dobriborsci 15 1 0 15 Sep 2024
PIP-Loco: A Proprioceptive Infinite Horizon Planning Framework for Quadrupedal Robot Locomotion Aditya Shirwatkar Naman Saxena Kishore Chandra Shishir N Y Kolathaya 28 3 0 14 Sep 2024
$DexSim2Real$^{2}$: Building Explicit World Model for Precise Articulated Object Dexterous Manipulation$ DexSim2Real $^{2}$ : Building Explicit World Model for Precise Articulated Object Dexterous Manipulation Taoran Jiang Liqian Ma Yixuan Guan Jiaojiao Meng Weihang Chen Zecui Zeng Lusong Li Dan Wu Jing Xu Rui Chen 18 0 0 13 Sep 2024
Online Decision MetaMorphFormer: A Casual Transformer-Based Reinforcement Learning Framework of Universal Embodied Intelligence Luo Ji Runji Lin OffRL AI4CE LM&Ro 19 0 0 11 Sep 2024
Autonomous Iterative Motion Learning (AI-MOLE) of a SCARA Robot for Automated Myocardial Injection Michael Meindl Raphael Monkemoller Thomas Seel 25 0 0 10 Sep 2024
Learning Multi-agent Multi-machine Tending by Mobile Robots Abdalwhab Abdalwhab Giovanni Beltrame Samira Ebrahimi Kahou David St-Onge 23 1 0 29 Aug 2024
Controlling the World by Sleight of Hand Sruthi Sudhakar Ruoshi Liu Basile Van Hoorick Carl Vondrick Richard Zemel 22 3 0 13 Aug 2024
Body Transformer: Leveraging Robot Embodiment for Policy Learning Carmelo Sferrazza Dun-Ming Huang Fangchen Liu Jongmin Lee Pieter Abbeel LM&Ro 25 9 0 12 Aug 2024
Navigating the Human Maze: Real-Time Robot Pathfinding with Generative Imitation Learning Martin Moder Stephen Adhisaputra Josef Pauli 16 0 0 07 Aug 2024
Automatic Environment Shaping is the Next Frontier in RL Younghyo Park G. Margolis Pulkit Agrawal OffRL 32 3 0 23 Jul 2024
APriCoT: Action Primitives based on Contact-state Transition for In-Hand Tool Manipulation Daichi Saito Atsushi Kanehira Kazuhiro Sasabuchi Naoki Wake Jun Takamatsu Hideki Koike Katsushi Ikeuchi 21 0 0 16 Jul 2024
Over the Edge of Chaos? Excess Complexity as a Roadblock to Artificial General Intelligence Teo Susnjak Timothy R. McIntosh A. Barczak N. Reyes Tong Liu Paul Watters Malka N. Halgamuge 25 1 0 04 Jul 2024
DextrAH-G: Pixels-to-Action Dexterous Arm-Hand Grasping with Geometric Fabrics Tyler Ga Wei Lum Martin Matak Viktor Makoviychuk Ankur Handa Arthur Allshire Tucker Hermans Nathan D. Ratliff Karl Van Wyk 14 13 0 02 Jul 2024
RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packing Bo Ai Stephen Tian Haochen Shi Yixuan Wang Cheston Tan Yunzhu Li Jiajun Wu 31 3 0 01 Jul 2024
Non-Prehensile Aerial Manipulation using Model-Based Deep Reinforcement Learning Cora A. Dimmig Marin Kobilarov 18 1 0 01 Jul 2024
BricksRL: A Platform for Democratizing Robotics and Reinforcement Learning Research and Education with LEGO Sebastian Dittert Vincent Moens Gianni de Fabritiis 21 1 0 25 Jun 2024
KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty P. Becker Niklas Freymuth Gerhard Neumann Mamba 16 2 0 21 Jun 2024
IRASim: Learning Interactive Real-Robot Action Simulators Fangqi Zhu Hongtao Wu Song Guo Yuxiao Liu Chilam Cheang Tao Kong 72 11 0 20 Jun 2024
Act Better by Timing: A timing-Aware Reinforcement Learning for Autonomous Driving Guanzhou Li Jianping Wu Yujing He 17 0 0 19 Jun 2024
Demonstrating Agile Flight from Pixels without State Estimation Ismail Geles L. Bauersfeld Angel Romero Jiaxu Xing Davide Scaramuzza 29 22 0 18 Jun 2024
Learning-based legged locomotion; state of the art and future perspectives Sehoon Ha Joonho Lee M. van de Panne Zhaoming Xie Wenhao Yu Majid Khadiv 39 15 0 03 Jun 2024
Transformers and Slot Encoding for Sample Efficient Physical World Modelling Francesco Petri Luigi Asprino Aldo Gangemi OCL ViT 27 0 0 30 May 2024
Empowering Embodied Manipulation: A Bimanual-Mobile Robot Manipulation Dataset for Household Tasks Tianle Zhang Dongjiang Li Yihang Li Zecui Zeng Lin Zhao ... Yue Chen Xuelong Wei Yibing Zhan Lusong Li Xiaodong He 19 6 0 29 May 2024
World Models for General Surgical Grasping Hongbin Lin Bin Li Chun Wai Wong Juan Rojas X. Chu K. W. S. Au 19 3 0 28 May 2024
Ego-Foresight: Agent Visuomotor Prediction as Regularization for RL Manuel S. Nunes Atabak Dehban Y. Demiris J. Santos-Victor 30 0 0 27 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 60 38 0 23 May 2024
Diffusion for World Modeling: Visual Details Matter in Atari Eloi Alonso Adam Jelley Vincent Micheli Anssi Kanervisto Amos Storkey Tim Pearce Franccois Fleuret 31 37 0 20 May 2024
vMFER: Von Mises-Fisher Experience Resampling Based on Uncertainty of Gradient Directions for Policy Improvement Yiwen Zhu Jinyi Liu Wenya Wei Qianyi Fu Yujing Hu Zhou Fang Bo An Jianye Hao Tangjie Lv Changjie Fan 21 3 0 14 May 2024
RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigation Sourav Garg Krishan Rana M. Hosseinzadeh Lachlan Mares Niko Sünderhauf Feras Dayoub Ian Reid 31 17 0 09 May 2024
Information-driven Affordance Discovery for Efficient Robotic Manipulation Pietro Mazzaglia Taco Cohen Daniel Dijkman 24 2 0 06 May 2024
Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond Zheng Zhu Xiaofeng Wang Wangbo Zhao Chen Min Nianchen Deng ... Dawei Zhao Liang Xiao Jian-jun Zhao Jiwen Lu Guan Huang VGen LM&Ro 76 35 0 06 May 2024
Learning Tactile Insertion in the Real World Daniel Palenicek Theo Gruner Tim Schneider Alina Böhm Janis Lenz Inga Pfenning Eric Krämer Jan Peters 20 2 0 01 May 2024
WorldGPT: Empowering LLM as Multimodal World Model Zhiqi Ge Hongzhe Huang Mingze Zhou Juncheng Li Guoming Wang Siliang Tang Yueting Zhuang 29 26 0 28 Apr 2024
Deep Reinforcement Learning for Bipedal Locomotion: A Brief Survey Lingfan Bao Josephine N. Humphreys Tianhu Peng Chengxu Zhou 65 5 0 25 Apr 2024
Continuous Control Reinforcement Learning: Distributed Distributional DrQ Algorithms Zehao Zhou OffRL 19 0 0 16 Apr 2024
AI-MOLE: Autonomous Iterative Motion Learning for Unknown Nonlinear Dynamics with Extensive Experimental Validation Michael Meindl Simon Bachhuber Thomas Seel 25 4 0 09 Apr 2024
InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction Sirui Xu Ziyin Wang Yu-Xiong Wang Liangyan Gui 37 24 0 28 Mar 2024
CaT: Constraints as Terminations for Legged Locomotion Reinforcement Learning Elliot Chane-Sane Pierre-Alexandre Leziart T. Flayols O. Stasse Philippe Souères Nicolas Mansard 22 3 0 27 Mar 2024
Bridging the Sim-to-Real Gap with Bayesian Inference Jonas Rothfuss Bhavya Sukhija Lenart Treven Florian Dorfler Stelian Coros Andreas Krause AI4CE 21 2 0 25 Mar 2024
Learning Quadruped Locomotion Using Differentiable Simulation Yunlong Song Sangbae Kim Davide Scaramuzza 19 10 0 21 Mar 2024
Constrained Reinforcement Learning with Smoothed Log Barrier Function Baohe Zhang Yuan Zhang Lilli Frison Thomas Brox Joschka Bödecker 29 8 0 21 Mar 2024
Tell Me What You Want (What You Really, Really Want): Addressing the Expectation Gap for Goal Conveyance from Humans to Robots Kevin J. Leahy H. Siu 17 2 0 21 Mar 2024
A Contact Model based on Denoising Diffusion to Learn Variable Impedance Control for Contact-rich Manipulation Masashi Okada Mayumi Komatsu Tadahiro Taniguchi DiffM 22 0 0 20 Mar 2024
Dreaming of Many Worlds: Learning Contextual World Models Aids Zero-Shot Generalization Sai Prasanna Karim Farid Raghu Rajan André Biedenkapp 43 2 0 16 Mar 2024