Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulation

6 March 2024

Tao Chen

Abhishek Gupta

Pulkit Agrawal

ArXiv PDF HTML

Papers citing "Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulation"

21 / 21 papers shown

Title
FalconWing: An Open-Source Platform for Ultra-Light Fixed-Wing Aircraft Research Yan Miao Will Shen Hang Cui Sayan Mitra 39 0 0 02 May 2025
PRISM: Projection-based Reward Integration for Scene-Aware Real-to-Sim-to-Real Transfer with Few Demonstrations Haowen Sun H. Wang Chengzhong Ma Shaolong Zhang Jiawei Ye Xingyu Chen Xuguang Lan OffRL 51 1 0 29 Apr 2025
DRAWER: Digital Reconstruction and Articulation With Environment Realism Hongchi Xia Entong Su Marius Memmel Arhan Jain Raymond Yu Numfor Mbiziwo-Tiapo Ali Farhadi Abhishek Gupta Shenlong Wang Wei-Chiu Ma VGen 19 0 0 21 Apr 2025
Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstration Tyler Ga Wei Lum Olivia Y. Lee C. Karen Liu Jeannette Bohg 25 0 0 17 Apr 2025
Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation Abhiram Maddukuri Z. L. Jiang L. Chen Soroush Nasiriany Yuqi Xie ... Scott Reed Ken Goldberg Ajay Mandlekar Linxi Fan Yuke Zhu 50 1 0 31 Mar 2025
Few-shot Sim2Real Based on High Fidelity Rendering with Force Feedback Teleoperation Yanwen Zou Junda Huang Boyuan Liang Honghao Guo Zhengyang Liu Xin Ma Jianshu Zhou M. Tomizuka 76 1 0 03 Mar 2025
Scalable Real2Sim: Physics-Aware Asset Generation Via Robotic Pick-and-Place Setups Nicholas Pfaff Evelyn Fu Jeremy Binagia Phillip Isola Russ Tedrake 31 2 0 01 Mar 2025
ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting Yu Liu Baoxiong Jia Ruijie Lu Junfeng Ni Song-Chun Zhu Siyuan Huang 3DGS 61 7 0 26 Feb 2025
CAST: Component-Aligned 3D Scene Reconstruction from an RGB Image Kaixin Yao Longwen Zhang Xinhao Yan Yan Zeng Qixuan Zhang Wei Yang Lan Xu Jiayuan Gu Jingyi Yu 14 0 0 18 Feb 2025
A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewards Shivansh Patel Xinchen Yin Wenlong Huang Shubham Garg H. Nayyeri Li Fei-Fei Svetlana Lazebnik Y. Li 81 0 0 12 Feb 2025
HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation Yi Li Yuquan Deng J. Zhang Joel Jang Marius Memme ... Fabio Ramos Dieter Fox Anqi Li Abhishek Gupta Ankit Goyal LM&Ro 68 5 0 08 Feb 2025
Rapidly Adapting Policies to the Real World via Simulation-Guided Fine-Tuning Patrick Yin Tyler Westenbroek Simran Bagaria Kevin Huang Ching-an Cheng Andrey Kobolov Abhishek Gupta 68 2 0 04 Feb 2025
NeRF-Aug: Data Augmentation for Robotics with Neural Radiance Fields Eric Zhu Mara Levy M. Gwilliam Abhinav Shrivastava 33 0 0 04 Nov 2024
GRS: Generating Robotic Simulation Tasks from Real-World Images Alex Zook Fan-Yun Sun Josef Spjut Valts Blukis Stan Birchfield Jonathan Tremblay 28 4 0 20 Oct 2024
PoCo: Policy Composition from and for Heterogeneous Robot Learning Lirui Wang Jialiang Zhao Yilun Du Edward H. Adelson Russ Tedrake 40 26 0 04 Feb 2024
Autonomous Robotic Reinforcement Learning with Asynchronous Human Feedback Max Balsells M. Torné Zihan Wang Samedh Desai Pulkit Agrawal Abhishek Gupta 29 10 0 31 Oct 2023
NeRF2Real: Sim2real Transfer of Vision-guided Bipedal Motion Skills using Neural Radiance Fields Arunkumar Byravan Jan Humplik Leonard Hasenclever Arthur Brussee F. Nori ... Ben Moran Steven Bohez Fereshteh Sadeghi Bojan Vujatovic N. Heess 46 53 0 10 Oct 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
What Matters in Learning from Offline Human Demonstrations for Robot Manipulation Ajay Mandlekar Danfei Xu J. Wong Soroush Nasiriany Chen Wang Rohun Kulkarni Li Fei-Fei Silvio Savarese Yuke Zhu Roberto Martín-Martín OffRL 139 461 0 06 Aug 2021
Reset-Free Reinforcement Learning via Multi-Task Learning: Learning Dexterous Manipulation Behaviors without Human Intervention Abhishek Gupta Justin Yu Tony Zhao Vikash Kumar Aaron Rovinsky Kelvin Xu Thomas Devlin Sergey Levine OffRL 67 94 0 22 Apr 2021
Convolutional Occupancy Networks Songyou Peng Michael Niemeyer L. Mescheder Marc Pollefeys Andreas Geiger 3DV AI4CE 206 860 0 10 Mar 2020