Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation

19 January 2022

Papers citing "Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation"

34 / 34 papers shown

Title
Merging and Disentangling Views in Visual Reinforcement Learning for Robotic Manipulation Abdulaziz Almuzairee Rohan Patil Dwait Bhatt Henrik I. Christensen 34 0 0 07 May 2025
Learning Fused State Representations for Control from Multi-View Observations Zeyu Wang Yao Li Xin Li Hongyu Zang Romain Laroche Riashat Islam OffRL 54 0 0 03 Feb 2025
Egocentric and Exocentric Methods: A Short Survey Anirudh Thatipelli Shao-Yuan Lo Amit K. Roy-Chowdhury EgoV 42 2 0 27 Oct 2024
Focus On What Matters: Separated Models For Visual-Based RL Generalization Di Zhang Bowen Lv Hai Zhang Feifan Yang Junqiao Zhao Hang Yu Chang Huang Hongtu Zhou Chen Ye Changjun Jiang 27 3 0 29 Sep 2024
Articulated Object Manipulation using Online Axis Estimation with SAM2-Based Tracking Xi Wang Tianxing Chen Qiaojun Yu Tianling Xu Zanxin Chen Yiting Fu Cewu Lu Cewu Lu Ping Luo Ping Luo 39 4 0 24 Sep 2024
Learning to Manipulate Anywhere: A Visual Generalizable Framework For Reinforcement Learning Zhecheng Yuan Tianming Wei Shuiqi Cheng Gu Zhang Yuanpei Chen Huazhe Xu 43 22 0 22 Jul 2024
Ego-to-Exo: Interfacing Third Person Visuals from Egocentric Views in Real-time for Improved ROV Teleoperation Adnan Abdullah Ruo Chen Ioannis M. Rekleitis Md Jahidul Islam 19 3 0 30 Jun 2024
RVT-2: Learning Precise Manipulation from Few Demonstrations Ankit Goyal Valts Blukis Jie Xu Yijie Guo Yu-Wei Chao Dieter Fox 25 38 0 12 Jun 2024
Multi-view Disentanglement for Reinforcement Learning with Multiple Cameras Mhairi Dunion Stefano V. Albrecht 27 4 0 22 Apr 2024
VIHE: Virtual In-Hand Eye Transformer for 3D Robotic Manipulation Weiyao Wang Yutian Lei Shiyu Jin Gregory D. Hager Liangjun Zhang 31 2 0 18 Mar 2024
Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos Mi Luo Zihui Xue Alex Dimakis Kristen Grauman EgoV DiffM 41 11 0 11 Mar 2024
POV: Prompt-Oriented View-Agnostic Learning for Egocentric Hand-Object Interaction in the Multi-View World Boshen Xu Sipeng Zheng Qin Jin 44 7 0 09 Mar 2024
Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Prior Kechun Xu Zhongxiang Zhou Jun Wu Haojian Lu Rong Xiong Yue Wang 35 2 0 23 Feb 2024
Finetuning Offline World Models in the Real World Yunhai Feng Nicklas Hansen Ziyan Xiong Chandramouli Rajagopalan Xiaolong Wang OffRL OnRL 17 20 0 24 Oct 2023
ImageManip: Image-based Robotic Manipulation with Affordance-guided Next View Selection Xiaoqi Li Yanzi Wang Yan Shen Ponomarenko Iaroslav Haoran Lu Qianxu Wang Boshi An Jiaming Liu Hao Dong 30 5 0 13 Oct 2023
Knolling Bot: Learning Robotic Object Arrangement from Tidy Demonstrations Yuhang Hu Zhizhuo Zhang Xinyue Zhu Ruibo Liu P. Wyder Hod Lipson LM&Ro SSL 23 0 0 06 Oct 2023
RGBManip: Monocular Image-based Robotic Manipulation through Active Object Pose Estimation Boshi An Yiran Geng Kai-xiang Chen Xiaoqi Li Qi Dou Hao Dong 26 14 0 05 Oct 2023
Dynamic Visual Prompt Tuning for Parameter Efficient Transfer Learning Chunqing Ruan Hongjian Wang VLM VPVLM 32 1 0 12 Sep 2023
Improving Generalization in Visual Reinforcement Learning via Conflict-aware Gradient Agreement Augmentation Siao Liu Zhaoyu Chen Yang Liu Yuzheng Wang Dingkang Yang ... Ziqing Zhou Xie Yi Wei Li Wenqiang Zhang Zhongxue Gan 31 22 0 02 Aug 2023
Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations Moo Jin Kim Jiajun Wu Chelsea Finn 21 7 0 12 Jul 2023
RVT: Robotic View Transformer for 3D Object Manipulation Ankit Goyal Jie Xu Yijie Guo Valts Blukis Yu-Wei Chao D. Fox LM&Ro 34 117 0 26 Jun 2023
Gender Bias in Transformer Models: A comprehensive survey Praneeth Nemani Yericherla Deepak Joel Pallavi Vijay Farhana Ferdousi Liza 24 3 0 18 Jun 2023
Visual-Policy Learning through Multi-Camera View to Single-Camera View Knowledge Distillation for Robot Manipulation Tasks C. Acar Kuluhan Binici Alp Tekirdag Yan Wu 24 1 0 13 Mar 2023
Multi-View Masked World Models for Visual Robotic Manipulation Younggyo Seo Junsup Kim Stephen James Kimin Lee Jinwoo Shin Pieter Abbeel VGen 17 55 0 05 Feb 2023
NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis Allan Zhou Moo Jin Kim Lirui Wang Peter R. Florence Chelsea Finn 20 48 0 18 Jan 2023
On Transforming Reinforcement Learning by Transformer: The Development Trajectory Shengchao Hu Li Shen Ya-Qin Zhang Yixin Chen Dacheng Tao OffRL 23 24 0 29 Dec 2022
VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors Yifeng Zhu Abhishek Joshi Peter Stone Yuke Zhu LM&Ro 25 124 0 20 Oct 2022
Frame Mining: a Free Lunch for Learning Robotic Manipulation from 3D Point Clouds Minghua Liu Xuanlin Li Z. Ling Yangyan Li Hao Su 29 31 0 14 Oct 2022
Visual Reinforcement Learning with Self-Supervised 3D Representations Yanjie Ze Nicklas Hansen Yinbo Chen Mohit Jain Xiaolong Wang SSL 22 49 0 13 Oct 2022
Look where you look! Saliency-guided Q-networks for generalization in visual Reinforcement Learning David Bertoin Adil Zouitine Mehdi Zouitine Emmanuel Rachelson 25 29 0 16 Sep 2022
Graph Inverse Reinforcement Learning from Diverse Videos Sateesh Kumar Jonathan Zamora Nicklas Hansen Rishabh Jangir Xiaolong Wang 27 53 0 28 Jul 2022
Learning Viewpoint-Agnostic Visual Representations by Recovering Tokens in 3D Space Jinghuan Shang Srijan Das Michael S. Ryoo 36 13 0 23 Jun 2022
AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition Shoufa Chen Chongjian Ge Zhan Tong Jiangliu Wang Yibing Song Jue Wang Ping Luo 143 637 0 26 May 2022
Vision-Based Manipulators Need to Also See from Their Hands Kyle Hsu Moo Jin Kim Rafael Rafailov Jiajun Wu Chelsea Finn 24 44 0 15 Mar 2022