v1v2v3 (latest)

Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots

15 February 2024

Shuran Song

ArXiv (abs)PDF HTML HuggingFace (15 upvotes)

Papers citing "Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots"

50 / 202 papers shown

Title
Diff-DAgger: Uncertainty Estimation with Diffusion Policy for Robotic Manipulation Sung-Wook Lee Yen-Ling Kuo Yen-Ling Kuo 265 9 0 18 Oct 2024
Vision-Language-Action Model and Diffusion Policy Switching Enables Dexterous Control of an Anthropomorphic Hand Cheng Pan Kai Junge Josie Hughes 87 9 0 17 Oct 2024
ALOHA Unleashed: A Simple Recipe for Robot Dexterity Tony Zhao Jonathan Tompson Danny Driess Pete Florence Kamyar Ghasemipour Chelsea Finn Ayzaan Wahid 144 109 0 17 Oct 2024
M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenes Sixu Yan Zeyu Zhang Muzhi Han Zaijin Wang Qi Xie Zhitian Li Zhehan Li Hangxin Liu Xinggang Wang Song-Chun Zhu 133 17 0 15 Oct 2024
DeformPAM: Data-Efficient Learning for Long-horizon Deformable Object Manipulation via Preference-based Action Alignment Wendi Chen Han Xue Fangyuan Zhou Yuan Fang Cewu Lu 157 2 0 15 Oct 2024
Learning from 10 Demos: Generalisable and Sample-Efficient Policy Learning with Oriented Affordance Frames Krishan Rana Jad Abou-Chakra Sourav Garg Robert Lee Ian Reid Niko Suenderhauf 92 6 0 15 Oct 2024
ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulation Wenhai Liu Junbo Wang Yiming Wang Weiming Wang Cewu Lu 156 24 0 10 Oct 2024
Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress Christopher Agia Rohan Sinha Jingyun Yang Zi-ang Cao Rika Antonova Marco Pavone Jeannette Bohg 135 18 0 06 Oct 2024
LeLaN: Learning A Language-Conditioned Navigation Policy from In-the-Wild Videos Noriaki Hirose Catherine Glossop A. Sridhar Dhruv Shah Oier Mees Sergey Levine LM&Ro 134 18 0 04 Oct 2024
FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Dataset Ziniu Wu Tianyu Wang Zhaxizhuoma Chuyue Guan Zhongjie Jia ... Zhigang Wang Nieqing Cao Yan Ding Bin Zhao Xuelong Li 137 8 0 29 Sep 2024
An Augmented Reality Interface for Teleoperating Robot Manipulators Aliyah Smith Monroe Kennedy III 168 1 0 27 Sep 2024
Flatñ'Fold: A Diverse Multi-Modal Dataset for Garment Perception and Manipulation Lipeng Zhuang Shiyu Fan Yingdong Ru Florent P. Audonnet Paul Henderson Gerardo Aragon-Camarasa 100 1 0 26 Sep 2024
Active Vision Might Be All You Need: Exploring Active Vision in Bimanual Robotic Manipulation Ian Chuang Andrew Lee Dechen Gao M-Mahdi Naddaf-Sh Iman Soltani 233 14 0 26 Sep 2024
Embedded IPC: Fast and Intersection-free Simulation in Reduced Subspace for Robot Manipulation Wenxin Du Chang Yu Siyu Ma Ying Jiang Zeshun Zong Yin Yang Joe Masterjohn Alejandro M. Castro Xuchen Han Chenfanfu Jiang 87 0 0 24 Sep 2024
ARCH: Hierarchical Hybrid Learning for Long-Horizon Contact-Rich Robotic Assembly Jiankai Sun Aidan Curtis Yang You Yan Xu Michael Koehle ... Sachin Chitta Leonidas Guibas Sachin Chitta Mac Schwager Hui Li 145 0 0 24 Sep 2024
In the Wild Ungraspable Object Picking with Bimanual Nonprehensile Manipulation Albert Wu Dan Kruse 93 2 0 23 Sep 2024
Hand-Object Interaction Pretraining from Videos Himanshu Gaurav Singh Antonio Loquercio Carmelo Sferrazza Jane Wu Haozhi Qi Pieter Abbeel Jitendra Malik 122 22 0 12 Sep 2024
Robot Utility Models: General Policies for Zero-Shot Deployment in New Environments Haritheja Etukuru Norihito Naka Zijin Hu Seungjae Lee Julian Mehu Aaron Edsinger Chris Paxton Soumith Chintala Lerrel Pinto Nur Muhammad (Mahi) Shafiullah LM&Ro 121 31 0 09 Sep 2024
View-Invariant Policy Learning via Zero-Shot Novel View Synthesis Stephen Tian Blake Wulfe Kyle Sargent Katherine Liu Sergey Zakharov Vitor Campagnolo Guizilini Jiajun Wu 309 16 0 05 Sep 2024
GraspSplats: Efficient Manipulation with 3D Feature Splatting Mazeyu Ji Ri-Zhao Qiu Xueyan Zou Xiaolong Wang 3DGS 144 29 0 03 Sep 2024
Affordance-based Robot Manipulation with Flow Matching Fan Zhang Michael Gienger 318 26 0 02 Sep 2024
Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Sampling Yuejiang Liu Jubayer Ibn Hamid Annie Xie Yoonho Lee Maximilian Du Chelsea Finn OffRL 193 0 0 30 Aug 2024
ACE: A Cross-Platform Visual-Exoskeletons System for Low-Cost Dexterous Teleoperation Shiqi Yang Minghuan Liu Yuzhe Qin Runyu Ding Jialong Li Xuxin Cheng Ruihan Yang Sha Yi Xiaolong Wang 137 36 0 21 Aug 2024
All Robots in One: A New Standard and Unified Dataset for Versatile, General-Purpose Embodied Agents Zhiqiang Wang Hao Zheng Yunshuang Nie Wenjun Xu Qingwei Wang ... Wanxi Dong Chang Cai Liang Lin Feng Zheng Xiaodan Liang 101 10 0 20 Aug 2024
UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers Huy Ha Yihuai Gao Zipeng Fu Jie Tan Shuran Song 145 69 0 14 Jul 2024
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI Zehua Wang Weixing Chen Yongjie Bai Xiaodan Liang Guanbin Li Wen Gao Liang Lin LM&Ro SyDa AI4CE 257 106 0 09 Jul 2024
LDP: A Local Diffusion Planner for Efficient Robot Navigation and Collision Avoidance Wenhao Yu Jie Peng Huanyu Yang Junrui Zhang YiFan Duan Jianmin Ji Yanyong Zhang 145 16 0 02 Jul 2024
Open-TeleVision: Teleoperation with Immersive Active Visual Feedback Xuxin Cheng Jialong Li Shiqi Yang Ge Yang Xiaolong Wang 224 153 0 01 Jul 2024
Unfolding the Literature: A Review of Robotic Cloth Manipulation Alberta Longhini Yufei Wang Irene Garcia-Camacho David Blanco-Mulero Marco Moletta ... Hang Yin Zackory M. Erickson David Held J´ulia Borras Danica Kragic AI4CE 143 21 0 01 Jul 2024
PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigators Kuo-Hao Zeng Zichen Zhang Kiana Ehsani Rose Hendrix Jordi Salvador Alvaro Herrasti Ross Girshick Aniruddha Kembhavi Luca Weihs LM&Ro OffRL 123 34 0 28 Jun 2024
ManiWAV: Learning Robot Manipulation from In-the-Wild Audio-Visual Data Zeyi Liu Cheng Chi Eric A. Cousineau Naveen Kuppuswamy Benjamin Burchfiel Shuran Song VGen 124 38 0 27 Jun 2024
Dreamitate: Real-World Visuomotor Policy Learning via Video Generation Junbang Liang Ruoshi Liu Ege Ozguroglu Sruthi Sudhakar Achal Dave P. Tokmakov Shuran Song Carl Vondrick VGen 117 37 0 24 Jun 2024
HumanPlus: Humanoid Shadowing and Imitation from Humans Zipeng Fu Qingqing Zhao Qi Wu Gordon Wetzstein Chelsea Finn SyDa 156 144 0 15 Jun 2024
BiKC: Keypose-Conditioned Consistency Policy for Bimanual Robotic Manipulation Dongjie Yu Hang Xu Yizhou Chen Yi Ren Jia Pan 149 6 0 14 Jun 2024
Dynamic Throwing with Robotic Material Handling Machines Lennart Werner Fang Nan Pol Eyschen Filippo A. Spinelli Hongyi Yang Marco Hutter 118 5 0 29 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 421 85 0 23 May 2024
From Sora What We Can See: A Survey of Text-to-Video Generation Rui Sun Yumin Zhang Tejal Shah Jiahao Sun Shuoying Zhang Wenqi Li Haoran Duan Bo Wei R. Ranjan EGVM 162 24 0 17 May 2024
What Foundation Models can Bring for Robot Learning in Manipulation : A Survey Dingzhe Li Yixiang Jin A. Yong Yong A Hongze Yu ... Huaping Liu Gang Hua F. Sun Jianwei Zhang Bin Fang AI4CE LM&Ro 315 21 0 28 Apr 2024
Learning Visuotactile Skills with Two Multifingered Hands Toru Lin Yu Zhang Qiyang Li Haozhi Qi Brent Yi Sergey Levine Jitendra Malik 145 75 0 25 Apr 2024
Leveraging Pretrained Latent Representations for Few-Shot Imitation Learning on a Dexterous Robotic Hand Davide Liconti Yasunori Toshimitsu Robert K. Katzschmann 103 3 0 25 Apr 2024
One-Shot Transfer of Long-Horizon Extrinsic Manipulation Through Contact Retargeting Albert Wu Ruocheng Wang Sirui Chen Clemens Eppner Chenxi Liu 131 6 0 11 Apr 2024
EVE: Enabling Anyone to Train Robots using Augmented Reality Jun Wang Chun-Cheng Chang Jiafei Duan Dieter Fox Ranjay Krishna 140 5 0 09 Apr 2024
Humanoid Robots at work: where are we ? Fabrice R. Noreils 135 2 0 05 Apr 2024
Grounding Language Plans in Demonstrations Through Counterfactual Perturbations Yanwei Wang Tsun-Hsuan Wang Jiayuan Mao Michael Hagenow Julie Shah LLMAG LM&Ro LRM 144 11 0 25 Mar 2024
VIHE: Virtual In-Hand Eye Transformer for 3D Robotic Manipulation Weiyao Wang Yutian Lei Shiyu Jin Gregory D. Hager Liangjun Zhang 109 4 0 18 Mar 2024
DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation Chen Wang Haochen Shi Weizhuo Wang Ruohan Zhang Fei-Fei Li Karen Liu 152 145 0 12 Mar 2024
Learning Human-to-Humanoid Real-Time Whole-Body Teleoperation Tairan He Zhengyi Luo Wenli Xiao Chong Zhang Kris Kitani Changliu Liu Guanya Shi 121 131 0 07 Mar 2024
3D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representations Yanjie Ze Gu Zhang Kangning Zhang Chenyuan Hu Muhan Wang Huazhe Xu VGen 307 115 0 06 Mar 2024
Twisting Lids Off with Two Hands Toru Lin Zhao-Heng Yin Haozhi Qi Pieter Abbeel Jitendra Malik 129 35 0 04 Mar 2024
Diffusion Meets DAgger: Supercharging Eye-in-hand Imitation Learning Xiaoyu Zhang Matthew Chang Pranav Kumar Saurabh Gupta DiffM OffRL 176 19 0 27 Feb 2024