Masked Visual Pre-training for Motor Control

11 March 2022

Papers citing "Masked Visual Pre-training for Motor Control"

50 / 218 papers shown

Title
Look Ma, No Hands! Agent-Environment Factorization of Egocentric VideosNeural Information Processing Systems (NeurIPS), 2023 Matthew Chang Aditya Prakash Saurabh Gupta DiffM 239 19 0 25 May 2023
Learning Better with Less: Effective Augmentation for Sample-Efficient Visual Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2023 Guozheng Ma Linrui Zhang Haoyu Wang Lu Li Zilin Wang Zhen Wang Li Shen Xueqian Wang Dacheng Tao 208 20 0 25 May 2023
Making Offline RL Online: Collaborative World Models for Offline Visual Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2023 Q. Wang Jun Yang Yunbo Wang Xin Jin Wenjun Zeng Xiaokang Yang OffRL OnRL 279 4 0 24 May 2023
DexPBT: Scaling up Dexterous Manipulation for Hand-Arm Systems with Population Based Training Aleksei Petrenko Arthur Allshire Gavriel State Ankur Handa Viktor Makoviychuk 171 30 0 20 May 2023
MIMEx: Intrinsic Rewards from Masked Input ModelingNeural Information Processing Systems (NeurIPS), 2023 Toru Lin Allan Jabri OffRL 211 7 0 15 May 2023
Learning Video-Conditioned Policies for Unseen Manipulation TasksIEEE International Conference on Robotics and Automation (ICRA), 2023 Elliot Chane-Sane Cordelia Schmid Ivan Laptev 180 25 0 10 May 2023
Masked Trajectory Models for Prediction, Representation, and ControlInternational Conference on Machine Learning (ICML), 2023 Philipp Wu Arjun Majumdar Kevin Stone Yixin Lin Igor Mordatch Pieter Abbeel Aravind Rajeswaran OffRL 146 49 0 04 May 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 339 354 0 24 Apr 2023
Behavior Retrieval: Few-Shot Imitation Learning by Querying Unlabeled Datasets Maximilian Du Suraj Nair Dorsa Sadigh Chelsea Finn OffRL 227 53 0 18 Apr 2023
Affordances from Human Videos as a Versatile Representation for RoboticsComputer Vision and Pattern Recognition (CVPR), 2023 Shikhar Bahl Russell Mendonca Lili Chen Unnat Jain Deepak Pathak 315 244 0 17 Apr 2023
Lossless Adaptation of Pretrained Vision Models For Robotic ManipulationInternational Conference on Learning Representations (ICLR), 2023 Mohit Sharma Claudio Fantacci Yuxiang Zhou Skanda Koppula N. Heess Jonathan Scholz Y. Aytar VLM 226 37 0 13 Apr 2023
Reinforcement Learning from Passive Data via Latent IntentionsInternational Conference on Machine Learning (ICML), 2023 Dibya Ghosh Chethan Bhateja Sergey Levine OffRL 197 58 0 10 Apr 2023
ENTL: Embodied Navigation Trajectory LearnerIEEE International Conference on Computer Vision (ICCV), 2023 Klemen Kotar Aaron Walsman Roozbeh Mottaghi 323 11 0 05 Apr 2023
Supervised Masked Knowledge Distillation for Few-Shot TransformersComputer Vision and Pattern Recognition (CVPR), 2023 Hanxi Lin G. Han Jiawei Ma Shiyuan Huang Xudong Lin Shih-Fu Chang 316 47 0 25 Mar 2023
GeoMIM: Towards Better 3D Knowledge Transfer via Masked Image Modeling for Multi-view 3D UnderstandingIEEE International Conference on Computer Vision (ICCV), 2023 Jihao Liu Tai Wang Boxiao Liu Qihang Zhang Yu Liu Jiaming Song 196 20 0 20 Mar 2023
A Survey of Demonstration Learning André Rosa de Sousa Porfírio Correia Luís A. Alexandre OffRL 186 28 0 20 Mar 2023
OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNav Karmesh Yadav Arjun Majumdar Ram Ramrakhya Naoki Yokoyama Alexei Baevski Z. Kira Oleksandr Maksymets Dhruv Batra ViT 257 71 0 14 Mar 2023
Foundation Models for Decision Making: Problems, Methods, and Opportunities Sherry Yang Ofir Nachum Yilun Du Jason W. Wei Pieter Abbeel Dale Schuurmans LM&Ro OffRL LRM AI4CE 328 205 0 07 Mar 2023
Teach a Robot to FISH: Versatile Imitation from One Minute of Demonstrations Siddhant Haldar Jyothish Pari A. Rai Lerrel Pinto 217 87 0 02 Mar 2023
Language-Driven Representation Learning for Robotics Siddharth Karamcheti Suraj Nair Annie S. Chen Thomas Kollar Chelsea Finn Dorsa Sadigh Abigail Z. Jacobs LM&Ro SSL 230 189 0 24 Feb 2023
MimicPlay: Long-Horizon Imitation Learning by Watching Human PlayConference on Robot Learning (CoRL), 2023 Chen Wang Linxi Fan Jiankai Sun Ruohan Zhang Li Fei-Fei Danfei Xu Yuke Zhu Anima Anandkumar 356 262 0 24 Feb 2023
Policy-Induced Self-Supervision Improves Representation Finetuning in Visual RL Sébastien M. R. Arnold Fei Sha SSL 106 0 0 12 Feb 2023
Cross-domain Random Pre-training with Prototypes for Reinforcement Learning Xin Liu Yaran Chen Haoran Li Boyu Li Dong Zhao SSL 437 12 0 11 Feb 2023
Combining Reconstruction and Contrastive Methods for Multimodal Representations in RL P. Becker Sebastian Mossburger Fabian Otto Gerhard Neumann SSL 171 7 0 10 Feb 2023
An Investigation into Pre-Training Object-Centric Representations for Reinforcement LearningInternational Conference on Machine Learning (ICML), 2023 Jaesik Yoon Yi-Fu Wu Heechul Bae Sungjin Ahn OCL 291 51 0 09 Feb 2023
Multi-View Masked World Models for Visual Robotic ManipulationInternational Conference on Machine Learning (ICML), 2023 Younggyo Seo Junsup Kim Stephen James Kimin Lee Jinwoo Shin Pieter Abbeel VGen 295 78 0 05 Feb 2023
Policy Pre-training for Autonomous Driving via Self-supervised Geometric ModelingInternational Conference on Learning Representations (ICLR), 2023 Peng Wu Li Chen Guoying Gu Xiaosong Jia Junchi Yan Yu Qiao 242 34 0 03 Jan 2023
Pre-Trained Image Encoder for Generalizable Visual Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2022 Zhecheng Yuan Zhengrong Xue Bo Yuan Xueqian Wang Yi Wu Yang Gao Huazhe Xu SSL OffRL 226 92 0 17 Dec 2022
Policy Adaptation from Foundation Model FeedbackComputer Vision and Pattern Recognition (CVPR), 2022 Yuying Ge Annabella Macaluso Erran L. Li Ping Luo Xiaolong Wang LM&Ro 157 18 0 14 Dec 2022
On Pre-Training for Visuo-Motor Control: Revisiting a Learning-from-Scratch BaselineInternational Conference on Machine Learning (ICML), 2022 Nicklas Hansen Zhecheng Yuan Yanjie Ze Tongzhou Mu Aravind Rajeswaran H. Su Huazhe Xu Xiaolong Wang 284 74 0 12 Dec 2022
MoDem: Accelerating Visual Model-Based Reinforcement Learning with DemonstrationsInternational Conference on Learning Representations (ICLR), 2022 Nicklas Hansen Yixin Lin H. Su Xiaolong Wang Vikash Kumar Aravind Rajeswaran OffRL 141 59 0 12 Dec 2022
VideoDex: Learning Dexterity from Internet VideosConference on Robot Learning (CoRL), 2022 Kenneth Shaw Shikhar Bahl Deepak Pathak 201 128 0 08 Dec 2022
Scaling Language-Image Pre-training via MaskingComputer Vision and Pattern Recognition (CVPR), 2022 Yanghao Li Haoqi Fan Ronghang Hu Christoph Feichtenhofer Kaiming He CLIP VLM 298 378 0 01 Dec 2022
Offline Q-Learning on Diverse Multi-Task Data Both Scales And GeneralizesInternational Conference on Learning Representations (ICLR), 2022 Aviral Kumar Rishabh Agarwal Xinyang Geng George Tucker Sergey Levine OffRL 261 67 0 28 Nov 2022
Learning to Imitate Object Interactions from Internet Videos Austin Patel Andrew E. Wang Ilija Radosavovic Jitendra Malik 164 29 0 23 Nov 2022
Masked Autoencoding for Scalable and Generalizable Decision MakingNeural Information Processing Systems (NeurIPS), 2022 Fangchen Liu Hao Liu Aditya Grover Pieter Abbeel OffRL 210 54 0 23 Nov 2022
Pretraining in Deep Reinforcement Learning: A Survey Zhihui Xie Zichuan Lin Junyou Li Shuai Li Deheng Ye OffRL OnRL AI4CE 158 30 0 08 Nov 2022
Learning and Retrieval from Prior Data for Skill-based Imitation LearningConference on Robot Learning (CoRL), 2022 Soroush Nasiriany Tian Gao Ajay Mandlekar Yuke Zhu SSL 263 71 0 20 Oct 2022
On the Feasibility of Cross-Task Transfer with Model-Based Reinforcement Learning Yifan Xu Nicklas Hansen Zirui Wang Yung-Chieh Chan H. Su Zhuowen Tu OffRL 188 18 0 19 Oct 2022
Simple Emergent Action Representations from Multi-Task Policy TrainingInternational Conference on Learning Representations (ICLR), 2022 Pu Hua Yubei Chen Huazhe Xu MLAU 171 7 0 18 Oct 2022
Visual Reinforcement Learning with Self-Supervised 3D RepresentationsIEEE Robotics and Automation Letters (RA-L), 2022 Yanjie Ze Nicklas Hansen Yinbo Chen Mohit Jain Xiaolong Wang SSL 255 69 0 13 Oct 2022
Retrospectives on the Embodied AI Workshop Matt Deitke Dhruv Batra Yonatan Bisk Tommaso Campari Angel X. Chang ... Jesse Thomason Alexander Toshev Joanne Truong Luca Weihs Jiajun Wu LM&Ro 297 53 0 13 Oct 2022
Pre-Training for Robots: Offline RL Enables Learning New Tasks from a Handful of Trials Aviral Kumar Anika Singh F. Ebert Mitsuhiko Nakamoto Yanlai Yang Chelsea Finn Sergey Levine OffRL OnRL 390 83 0 11 Oct 2022
A Comprehensive Survey of Data Augmentation in Visual Reinforcement LearningInternational Journal of Computer Vision (IJCV), 2022 Guozheng Ma Zhen Wang Zhecheng Yuan Xueqian Wang Bo Yuan Dacheng Tao OffRL 278 40 0 10 Oct 2022
Real-World Robot Learning with Masked Visual Pre-trainingConference on Robot Learning (CoRL), 2022 Ilija Radosavovic Tete Xiao Stephen James Pieter Abbeel Jitendra Malik Trevor Darrell SSL 386 296 0 06 Oct 2022
VIMA: General Robot Manipulation with Multimodal Prompts Yunfan Jiang Agrim Gupta Zichen Zhang Guanzhi Wang Yongqiang Dou Yanjun Chen Li Fei-Fei Anima Anandkumar Yuke Zhu Linxi Fan LM&Ro 303 457 0 06 Oct 2022
Extraneousness-Aware Imitation LearningIEEE International Conference on Robotics and Automation (ICRA), 2022 Rachel Zheng Kaizhe Hu Zhecheng Yuan Boyuan Chen Huazhe Xu SSL 232 4 0 04 Oct 2022
VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-TrainingInternational Conference on Learning Representations (ICLR), 2022 Yecheng Jason Ma Shagun Sodhani Dinesh Jayaraman Osbert Bastani Vikash Kumar Amy Zhang SSL OffRL 402 376 0 30 Sep 2022
Aerial View Localization with Reinforcement Learning: Towards Emulating Search-and-RescueAnnual Workshop of the Swedish Artificial Intelligence Society (ASAIS), 2022 Aleksis Pirinen A. Samuelsson John Backsund Kalle Åström 303 6 0 08 Sep 2022
A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyond Chaoning Zhang Chenshuang Zhang Junha Song John Seon Keun Yi Kang Zhang In So Kweon SSL 165 91 0 30 Jul 2022