Masked Visual Pre-training for Motor Control

11 March 2022

Papers citing "Masked Visual Pre-training for Motor Control"

50 / 218 papers shown

Title
Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Prior Kechun Xu Zhongxiang Zhou Jun Wu Haojian Lu Rong Xiong Yue Wang 267 7 0 23 Feb 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 212 28 0 22 Feb 2024
Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots Cheng Chi Zhenjia Xu Chuer Pan Eric A. Cousineau Benjamin Burchfiel Siyuan Feng Russ Tedrake Shuran Song 584 362 0 15 Feb 2024
Learning by Watching: A Review of Video-based Learning Approaches for Robot ManipulationIEEE Access (IEEE Access), 2024 Chrisantus Eze Christopher Crick SSL 361 16 0 11 Feb 2024
An Interactive Agent Foundation Model Zane Durante Bidipta Sarkar Ran Gong Rohan Taori Yusuke Noda ... Katsushi Ikeuchi Fei-Fei Li Jianfeng Gao Naoki Wake Qiuyuan Huang LM&Ro AI4CE LLMAG 265 33 0 08 Feb 2024
Real-World Robot Applications of Foundation Models: A Review Kento Kawaharazuka T. Matsushima Andrew Gambardella Jiaxian Guo Chris Paxton Andy Zeng OffRL VLM LM&Ro 233 85 0 08 Feb 2024
General Flow as Foundation Affordance for Scalable Robot LearningConference on Robot Learning (CoRL), 2024 Chengbo Yuan Chuan Wen Tong Zhang Yang Gao AI4CE 251 63 0 21 Jan 2024
Visual Robotic Manipulation with Depth-Aware PretrainingIEEE International Conference on Robotics and Biomimetics (ROBIO), 2024 Wanying Wang Jinming Li Yichen Zhu Zhiyuan Xu Zhengping Che Chaomin Shen Yaxin Peng Dong Liu Feifei Feng Jian Tang MDE 244 11 0 17 Jan 2024
Diffusion Reward: Learning Rewards via Conditional Video Diffusion Tao Huang Guangqi Jiang Yanjie Ze Huazhe Xu VGen 244 38 0 21 Dec 2023
Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation Hongtao Wu Ya Jing Chi-Hou Cheang Guangzeng Chen Jiafeng Xu Xinghang Li Minghuan Liu Hang Li Tao Kong 418 215 0 20 Dec 2023
Value Explicit Pretraining for Learning Transferable Representations Kiran Lekkala Henghui Bao Sumedh Anand Sontakke Laurent Itti SSL 201 0 0 19 Dec 2023
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 208 258 0 13 Dec 2023
FoMo Rewards: Can we cast foundation models as reward functions? Ekdeep Singh Lubana Johann Brehmer P. D. Haan Taco S. Cohen OffRL LRM 199 4 0 06 Dec 2023
Towards Generalizable Zero-Shot Manipulation via Translating Human Interaction PlansIEEE International Conference on Robotics and Automation (ICRA), 2023 Homanga Bharadhwaj Abhi Gupta Vikash Kumar Shubham Tulsiani LM&Ro 266 57 0 01 Dec 2023
Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning Yingdong Hu Fanqi Lin Tong Zhang Li Yi Yang Gao LM&Ro 311 182 0 29 Nov 2023
On Bringing Robots Home Nur Muhammad (Mahi) Shafiullah Anant Rai Haritheja Etukuru Yiqian Liu Ishan Misra Soumith Chintala Lerrel Pinto 370 125 0 27 Nov 2023
Generalizable Imitation Learning Through Pre-Trained RepresentationsIEEE International Conference on Robotics and Automation (ICRA), 2023 Wei-Di Chang F. Hogan David Meger Gregory Dudek Gregory Dudek 241 3 0 15 Nov 2023
Accelerating Exploration with Unlabeled Prior Data Qiyang Li Jason Zhang Dibya Ghosh Amy Zhang Sergey Levine OffRL OnRL 291 15 0 09 Nov 2023
What Makes Pre-Trained Visual Representations Successful for Robust Manipulation?Conference on Robot Learning (CoRL), 2023 Kaylee Burns Zach Witzel Jubayer Ibn Hamid Tianhe Yu Chelsea Finn Karol Hausman OOD SSL 260 33 0 03 Nov 2023
The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal LearningIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2023 Carmelo Sferrazza Younggyo Seo Hao Liu Youngwoon Lee Pieter Abbeel 277 27 0 02 Nov 2023
Learning to Discover Skills through GuidanceNeural Information Processing Systems (NeurIPS), 2023 Hyunseung Kim ByungKun Lee Hojoon Lee Dongyoon Hwang Sejik Park Kyushik Min Jaegul Choo 276 10 0 31 Oct 2023
Learning Generalizable Manipulation Policies with Object-Centric 3D RepresentationsConference on Robot Learning (CoRL), 2023 Yifeng Zhu Zhenyu Jiang Peter Stone Yuke Zhu 3DPC 194 64 0 22 Oct 2023
An Unbiased Look at Datasets for Visuo-Motor Pre-Training Sudeep Dasari Mohan Kumar Srirama Unnat Jain Abhinav Gupta SSL 225 51 0 13 Oct 2023
Open X-Embodiment: Robotic Learning Datasets and RT-X Models Open X-Embodiment Collaboration Abby OÑeill Abdul Rehman Abhinav Gupta Abhiram Maddukuri ... Zhuo Xu Zichen Jeff Cui Zichen Zhang Zipeng Fu Zipeng Lin LM&Ro 394 733 0 13 Oct 2023
Universal Visual Decomposer: Long-Horizon Manipulation Made EasyIEEE International Conference on Robotics and Automation (ICRA), 2023 Zichen Zhang Yunshuang Li Osbert Bastani Abhishek Gupta Dinesh Jayaraman Yecheng Jason Ma Luca Weihs 218 25 0 12 Oct 2023
What Matters to You? Towards Visual Representation Alignment for Robot LearningInternational Conference on Learning Representations (ICLR), 2023 Ran Tian Chenfeng Xu Masayoshi Tomizuka Jitendra Malik Andrea V. Bajcsy 187 15 0 11 Oct 2023
Revisiting Plasticity in Visual Reinforcement Learning: Data, Modules and Training StagesInternational Conference on Learning Representations (ICLR), 2023 Guozheng Ma Lu Li Sen Zhang Zixuan Liu Zhen Wang Yixin Chen Li Shen Xueqian Wang Dacheng Tao OffRL 211 25 0 11 Oct 2023
Human-oriented Representation Learning for Robotic Manipulation Mingxiao Huo Mingyu Ding Chenfeng Xu Thomas Tian Xinghao Zhu Yao Mu Lingfeng Sun Masayoshi Tomizuka Wei Zhan SSL 214 13 0 04 Oct 2023
H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous ManipulationNeural Information Processing Systems (NeurIPS), 2023 Yanjie Ze Yuyao Liu Ruizhe Shi Jiaxin Qin Zhecheng Yuan Jiashun Wang Huazhe Xu 262 1 0 02 Oct 2023
Diagnosing and exploiting the computational demands of videos games for deep reinforcement learning L. Govindarajan Rex G Liu Drew Linsley A. Ashok Max Reuter M. Frank Thomas Serre OffRL 130 0 0 22 Sep 2023
Robotic Offline RL from Internet Videos via Value-Function Pre-Training Chethan Bhateja Derek Guo Dibya Ghosh Anika Singh Manan Tomar Q. Vuong Yevgen Chebotar Sergey Levine Aviral Kumar OffRL 265 28 0 22 Sep 2023
Guide Your Agent with Adaptive Multimodal RewardsNeural Information Processing Systems (NeurIPS), 2023 Changyeon Kim Younggyo Seo Hao Liu Lisa Lee Jinwoo Shin Honglak Lee Kimin Lee 269 10 0 19 Sep 2023
General In-Hand Object Rotation with Vision and TouchConference on Robot Learning (CoRL), 2023 Haozhi Qi Brent Yi Sudharshan Suresh Mike Lambeta Yi Ma Roberto Calandra Jitendra Malik 243 128 0 18 Sep 2023
Efficient RL via Disentangled Environment and Agent RepresentationsInternational Conference on Machine Learning (ICML), 2023 Kevin Gmelin Shikhar Bahl Russell Mendonca Deepak Pathak DRL 219 14 0 05 Sep 2023
Language Reward Modulation for Pretraining Reinforcement Learning Ademi Adeniji Amber Xie Carmelo Sferrazza Younggyo Seo Stephen James Pieter Abbeel 169 39 0 23 Aug 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 204 136 0 21 Aug 2023
MOMA-Force: Visual-Force Imitation for Real-World Mobile ManipulationIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2023 Taozheng Yang Yaxing Jing Hongtao Wu Jiafeng Xu Kuankuan Sima Guangzeng Chen Qie Sima Tao Kong 192 26 0 07 Aug 2023
Exploring Visual Pre-training for Robot Manipulation: Datasets, Models and MethodsIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2023 Ya Jing Xuelin Zhu Xingbin Liu Qie Sima Taozheng Yang Yunhai Feng Tao Kong LM&Ro 159 18 0 07 Aug 2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic ControlConference on Robot Learning (CoRL), 2023 Anthony Brohan Noah Brown Justice Carbajal Yevgen Chebotar Xi Chen ... Ted Xiao Peng Xu Sichun Xu Tianhe Yu Brianna Zitkovich LM&Ro LRM 513 2,029 0 28 Jul 2023
XSkill: Cross Embodiment Skill DiscoveryConference on Robot Learning (CoRL), 2023 Mengda Xu Zhenjia Xu Cheng Chi Manuela Veloso Shuran Song 278 93 0 19 Jul 2023
Goal-Conditioned Predictive Coding for Offline Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2023 Zilai Zeng Ce Zhang Shijie Wang Chen Sun OffRL 185 12 0 07 Jul 2023
Policy Contrastive Imitation LearningInternational Conference on Machine Learning (ICML), 2023 Jialei Huang Zhao-Heng Yin Yingdong Hu Yang Gao 191 3 0 06 Jul 2023
Crossway Diffusion: Improving Diffusion-based Visuomotor Policy via Self-supervised LearningIEEE International Conference on Robotics and Automation (ICRA), 2023 Xiang Li Varun Belagali Jinghuan Shang Michael S. Ryoo 305 46 0 04 Jul 2023
TACO: Temporal Latent Action-Driven Contrastive Loss for Visual Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2023 Ruijie Zheng Xiyao Wang Yanchao Sun Shuang Ma Jieyu Zhao Huazhe Xu Hal Daumé Furong Huang 200 58 0 22 Jun 2023
SeMAIL: Eliminating Distractors in Visual Imitation via Separated ModelsInternational Conference on Machine Learning (ICML), 2023 Shenghua Wan Yucen Wang Minghao Shao Ruying Chen De-Chuan Zhan 223 12 0 19 Jun 2023
A Universal Semantic-Geometric Representation for Robotic ManipulationConference on Robot Learning (CoRL), 2023 Tong Zhang Yingdong Hu Hanchen Cui Hang Zhao Yang Gao 204 25 0 18 Jun 2023
VIBR: Learning View-Invariant Value Functions for Robust Visual Control Tom Dupuis Jaonary Rabarisoa Q. C. Pham David Filliat 259 0 0 14 Jun 2023
On the Efficacy of 3D Point Cloud Reinforcement Learning Z. Ling Xingtai Lv Xuanlin Li H. Su 3DPC 265 19 0 11 Jun 2023
LIV: Language-Image Representations and Rewards for Robotic ControlInternational Conference on Machine Learning (ICML), 2023 Yecheng Jason Ma William Liang Vaidehi Som Vikash Kumar Amy Zhang Osbert Bastani Dinesh Jayaraman LM&Ro 190 173 0 01 Jun 2023
Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2023 Jialong Wu Haoyu Ma Chao Deng Mingsheng Long OffRL 233 43 0 29 May 2023

All Papers

Masked Visual Pre-training for Motor Control

Papers citing "Masked Visual Pre-training for Motor Control"