Vision-Based Manipulators Need to Also See from Their Hands

15 March 2022

Jiajun Wu

Papers citing "Vision-Based Manipulators Need to Also See from Their Hands"

41 / 41 papers shown

Title
D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentation Isabella Liu Jason Chen Gaurav Sukhatme Daniel Seita 44 0 0 08 May 2025
Merging and Disentangling Views in Visual Reinforcement Learning for Robotic Manipulation Abdulaziz Almuzairee Rohan Patil Dwait Bhatt Henrik I. Christensen 22 0 0 07 May 2025
Real-is-Sim: Bridging the Sim-to-Real Gap with a Dynamic Digital Twin for Real-World Robot Policy Evaluation Jad Abou-Chakra Lingfeng Sun Krishan Rana Brandon B. May Karl Schmeckpeper M. Minniti Laura Herlant OffRL 50 0 0 04 Apr 2025
AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletons Hongjie Fang Chenxi Wang Yiming Wang J. Chen Shangning Xia ... Xinyu Zhan Lixin Yang Weiming Wang Cewu Lu Hao-Shu Fang 80 1 0 05 Mar 2025
View-Invariant Policy Learning via Zero-Shot Novel View Synthesis Stephen Tian Blake Wulfe Kyle Sargent Katherine Liu Sergey Zakharov Vitor Campagnolo Guizilini Jiajun Wu 70 10 0 21 Feb 2025
RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulation Zixuan Chen Jing Huo Yangtao Chen Yang Gao 43 2 0 11 Jan 2025
Perception Stitching: Zero-Shot Perception Encoder Transfer for Visuomotor Robot Policies Pingcheng Jian Easop Lee Zachary I. Bell Michael M. Zavlanos Boyuan Chen 63 1 0 03 Jan 2025
Local Policies Enable Zero-shot Long-horizon Manipulation Murtaza Dalal Min Liu Walter Talbott Chen Chen Deepak Pathak Jian Zhang Ruslan Salakhutdinov 36 3 0 29 Oct 2024
Egocentric and Exocentric Methods: A Short Survey Anirudh Thatipelli Shao-Yuan Lo Amit K. Roy-Chowdhury EgoV 42 2 0 27 Oct 2024
GAP-RL: Grasps As Points for RL Towards Dynamic Object Grasping Pengwei Xie Siang Chen Qianrun Chen Wei Tang Dingchang Hu Yixiang Dai Rui Chen Guijin Wang 20 1 0 04 Oct 2024
Robust Imitation Learning for Mobile Manipulator Focusing on Task-Related Viewpoints and Regions Yutaro Ishida Yuki Noguchi Takayuki Kanai Kazuhiro Shintani Hiroshi Bito 19 1 0 02 Oct 2024
D5RL: Diverse Datasets for Data-Driven Deep Reinforcement Learning Rafael Rafailov Kyle Hatch Anikait Singh Laura Smith Aviral Kumar ... Victor Kolev Philip J. Ball Jiajun Wu Chelsea Finn Sergey Levine OffRL 16 3 0 15 Aug 2024
Tilde: Teleoperation for Dexterous In-Hand Manipulation Learning with a DeltaHand Zilin Si Kevin Zhang F. Z. Temel Oliver Kroemer 38 8 0 29 May 2024
Part-Guided 3D RL for Sim2Real Articulated Object Manipulation Pengwei Xie Rui Chen Siang Chen Yuzhe Qin Fanbo Xiang Tianyu Sun Jing Xu Guijin Wang Haoran Su 36 10 0 26 Apr 2024
Multi-view Disentanglement for Reinforcement Learning with Multiple Cameras Mhairi Dunion Stefano V. Albrecht 19 4 0 22 Apr 2024
JUICER: Data-Efficient Imitation Learning for Robotic Assembly Lars Ankile Anthony Simeonov Idan Shenfeld Pulkit Agrawal LM&Ro 27 14 0 04 Apr 2024
VIHE: Virtual In-Hand Eye Transformer for 3D Robotic Manipulation Weiyao Wang Yutian Lei Shiyu Jin Gregory D. Hager Liangjun Zhang 26 2 0 18 Mar 2024
Pushing the Limits of Cross-Embodiment Learning for Manipulation and Navigation Jonathan Yang Catherine Glossop Arjun Bhorkar Dhruv Shah Quan Vuong Chelsea Finn Dorsa Sadigh Sergey Levine 33 41 0 29 Feb 2024
Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation Zipeng Fu Tony Zhao Chelsea Finn 100 281 0 04 Jan 2024
Imitation Bootstrapped Reinforcement Learning Hengyuan Hu Suvir Mirchandani Dorsa Sadigh 17 24 0 03 Nov 2023
Learning Generalizable Manipulation Policies with Object-Centric 3D Representations Yifeng Zhu Zhenyu Jiang Peter Stone Yuke Zhu 3DPC 17 43 0 22 Oct 2023
One-Shot Imitation Learning: A Pose Estimation Perspective Pietro Vitiello Kamil Dreczkowski Edward Johns 6 18 0 18 Oct 2023
Multi-Stage Cable Routing through Hierarchical Imitation Learning Jianlan Luo Charles Xu Xinyang Geng Gilbert Feng Kuan Fang L. Tan S. Schaal Sergey Levine 24 52 0 18 Jul 2023
Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations Moo Jin Kim Jiajun Wu Chelsea Finn 13 7 0 12 Jul 2023
Polybot: Training One Policy Across Robots While Embracing Variability Jonathan Yang Dorsa Sadigh Chelsea Finn 16 33 0 07 Jul 2023
Active Vision Reinforcement Learning under Limited Visual Observability Jinghuan Shang Michael S. Ryoo 29 0 0 01 Jun 2023
Imitating Task and Motion Planning with Visuomotor Transformers Murtaza Dalal Ajay Mandlekar Caelan Reed Garrett Ankur Handa Ruslan Salakhutdinov D. Fox 24 52 0 25 May 2023
The Treachery of Images: Bayesian Scene Keypoints for Deep Policy Learning in Robotic Manipulation Jan Ole von Hartz Eugenio Chisari Tim Welschehold Wolfram Burgard Joschka Boedecker Abhinav Valada SSL 11 13 0 08 May 2023
When Learning Is Out of Reach, Reset: Generalization in Autonomous Visuomotor Reinforcement Learning Zichen Zhang Luca Weihs OffRL 11 5 0 30 Mar 2023
Visual-Policy Learning through Multi-Camera View to Single-Camera View Knowledge Distillation for Robot Manipulation Tasks C. Acar Kuluhan Binici Alp Tekirdag Yan Wu 16 1 0 13 Mar 2023
Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learning Archit Sharma Ahmed M. Ahmed Rehaan Ahmad Chelsea Finn SSL 46 17 0 02 Mar 2023
Multi-View Masked World Models for Visual Robotic Manipulation Younggyo Seo Junsup Kim Stephen James Kimin Lee Jinwoo Shin Pieter Abbeel VGen 10 54 0 05 Feb 2023
NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis Allan Zhou Moo Jin Kim Lirui Wang Peter R. Florence Chelsea Finn 10 48 0 18 Jan 2023
VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors Yifeng Zhu Abhishek Joshi Peter Stone Yuke Zhu LM&Ro 17 93 0 20 Oct 2022
Frame Mining: a Free Lunch for Learning Robotic Manipulation from 3D Point Clouds Minghua Liu Xuanlin Li Z. Ling Yangyan Li Hao Su 23 31 0 14 Oct 2022
DayDreamer: World Models for Physical Robot Learning Philipp Wu Alejandro Escontrela Danijar Hafner Ken Goldberg Pieter Abbeel 34 274 0 28 Jun 2022
Learning Viewpoint-Agnostic Visual Representations by Recovering Tokens in 3D Space Jinghuan Shang Srijan Das Michael S. Ryoo 36 13 0 23 Jun 2022
Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holes Liangru Xie Hongxiang Yu Kechun Xu Tong Yang Minhang Wang Haojian Lu R. Xiong Yue Wang 8 0 0 09 May 2022
A Workflow for Offline Model-Free Robotic Reinforcement Learning Aviral Kumar Anika Singh Stephen Tian Chelsea Finn Sergey Levine OffRL 138 84 0 22 Sep 2021
What Matters in Learning from Offline Human Demonstrations for Robot Manipulation Ajay Mandlekar Danfei Xu J. Wong Soroush Nasiriany Chen Wang Rohun Kulkarni Li Fei-Fei Silvio Savarese Yuke Zhu Roberto Martín-Martín OffRL 139 461 0 06 Aug 2021
KOVIS: Keypoint-based Visual Servoing with Zero-Shot Sim-to-Real Transfer for Robotics Manipulation En Yen Puang K. P. Tee Wei Jing 3DPC 14 42 0 28 Jul 2020