Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation

11 July 2017

YuXuan Liu

Abhishek Gupta

Pieter Abbeel

Sergey Levine

ArXiv PDF HTML

Papers citing "Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation"

50 / 204 papers shown

Title
Learning non-Markovian Decision-Making from State-only Sequences Aoyang Qin Feng Gao Qing Li Song-Chun Zhu Sirui Xie 28 9 0 27 Jun 2023
CEIL: Generalized Contextual Imitation Learning Jinxin Liu Li He Yachen Kang Zifeng Zhuang Donglin Wang Huazhe Xu 33 18 0 26 Jun 2023
Learning Fine-grained View-Invariant Representations from Unpaired Ego-Exo Videos via Temporal Alignment Zihui Xue Kristen Grauman EgoV 38 31 0 08 Jun 2023
Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning Jialong Wu Haoyu Ma Chao Deng Mingsheng Long OffRL 28 24 0 29 May 2023
Video Prediction Models as Rewards for Reinforcement Learning Alejandro Escontrela Ademi Adeniji Wilson Yan Ajay Jain Xue Bin Peng Ken Goldberg Youngwoon Lee Danijar Hafner Pieter Abbeel 39 52 0 23 May 2023
Learning Video-Conditioned Policies for Unseen Manipulation Tasks Elliot Chane-Sane Cordelia Schmid Ivan Laptev 27 18 0 10 May 2023
Self-Supervised Adversarial Imitation Learning Juarez Monteiro Nathan Gavenski Felipe Meneguzzi Rodrigo C. Barros SSL 18 1 0 21 Apr 2023
Tool Learning with Foundation Models Yujia Qin Shengding Hu Yankai Lin Weize Chen Ning Ding ... Cheng Yang Tongshuang Wu Heng Ji Zhiyuan Liu Maosong Sun 42 200 0 17 Apr 2023
Aligning Step-by-Step Instructional Diagrams to Video Demonstrations Jiahao Zhang A. Cherian Yanbin Liu Yizhak Ben-Shabat Cristian Rodriguez-Opazo Stephen Gould 27 8 0 24 Mar 2023
A Survey of Demonstration Learning André Rosa de Sousa Porfírio Correia Luís A. Alexandre OffRL 30 17 0 20 Mar 2023
Programmatic Imitation Learning from Unlabeled and Noisy Demonstrations Jimmy Xin Linus Zheng Kia Rahmani Jiayi Wei Jarrett Holtz Işıl Dillig Joydeep Biswas 30 1 0 02 Mar 2023
MimicPlay: Long-Horizon Imitation Learning by Watching Human Play Chen Wang Linxi Fan Jiankai Sun Ruohan Zhang Li Fei-Fei Danfei Xu Yuke Zhu Anima Anandkumar 36 182 0 24 Feb 2023
Imitation from Observation With Bootstrapped Contrastive Learning M. Sonwa Johanna Hansen Eugene Belilovsky OffRL 30 0 0 13 Feb 2023
Guiding Online Reinforcement Learning with Action-Free Offline Pretraining Deyao Zhu Yuhui Wang Jürgen Schmidhuber Mohamed Elhoseiny OffRL OnRL 36 8 0 30 Jan 2023
What You Say Is What You Show: Visual Narration Detection in Instructional Videos Kumar Ashutosh Rohit Girdhar Lorenzo Torresani Kristen Grauman 24 4 0 05 Jan 2023
Genetic Imitation Learning by Reward Extrapolation Boyuan Zheng Jianlong Zhou Fang Chen 15 0 0 03 Jan 2023
HERD: Continuous Human-to-Robot Evolution for Learning from Human Demonstration Xingyu Liu Deepak Pathak Kris M. Kitani 21 7 0 08 Dec 2022
Self-supervised and Weakly Supervised Contrastive Learning for Frame-wise Action Representations Minghao Chen Renbo Tu Chenxi Huang Yuqi Lin Boxi Wu Deng Cai SSL AI4TS 24 1 0 06 Dec 2022
NeuroCERIL: Robotic Imitation Learning via Hierarchical Cause-Effect Reasoning in Programmable Attractor Neural Networks Gregory P. Davis Garrett E. Katz R. Gentili J. Reggia NAI 33 1 0 11 Nov 2022
D-Shape: Demonstration-Shaped Reinforcement Learning via Goal Conditioning Caroline Wang Garrett A. Warnell Peter Stone 34 3 0 26 Oct 2022
Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimization T. Lew Sumeet Singh M. Prats Jeffrey Bingham Jonathan Weisz ... Fei Xia Peng-Tao Xu Tingnan Zhang Jie Tan Montserrat Gonzalez 32 15 0 19 Oct 2022
Semi-Supervised Offline Reinforcement Learning with Action-Free Trajectories Qinqing Zheng Mikael Henaff Brandon Amos Aditya Grover OffRL 18 20 0 12 Oct 2022
K-VIL: Keypoints-based Visual Imitation Learning Jianfeng Gao Z. Tao Noémie Jaquier Tamim Asfour VGen SSL 44 23 0 07 Sep 2022
Some Supervision Required: Incorporating Oracle Policies in Reinforcement Learning via Epistemic Uncertainty Metrics Jun Jet Tai Jordan Terry M. Innocente J. Brusey N. Horri 19 1 0 22 Aug 2022
Basis for Intentions: Efficient Inverse Reinforcement Learning using Past Experience Marwa Abdulhai Natasha Jaques Sergey Levine OffRL 19 5 0 09 Aug 2022
Learning Object Manipulation Skills from Video via Approximate Differentiable Physics Vladimir Petrik M. N. Qureshi Josef Sivic Makarand Tapaswi 35 9 0 03 Aug 2022
Interactive Imitation Learning in Robotics based on Simulations Xinyi Liu 11 2 0 26 Jul 2022
Human-to-Robot Imitation in the Wild Shikhar Bahl Abhi Gupta Deepak Pathak 19 163 0 19 Jul 2022
Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos Bowen Baker Ilge Akkaya Peter Zhokhov Joost Huizinga Jie Tang Adrien Ecoffet Brandon Houghton Raul Sampedro Jeff Clune OffRL 34 285 0 23 Jun 2022
DcnnGrasp: Towards Accurate Grasp Pattern Recognition with Adaptive Regularizer Learning Xiaoqin Zhang Ziwei Huang Jingjing Zheng Shuo Wang Xianta Jiang 11 2 0 11 May 2022
From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperation Yuzhe Qin Hao Su Xiaolong Wang 19 98 0 26 Apr 2022
Imitation Learning from Observations under Transition Model Disparity Tanmay Gangwani Yuanfei Zhou Jian-wei Peng 22 12 0 25 Apr 2022
Frame-wise Action Representations for Long Videos via Sequence Contrastive Learning Minghao Chen Fangyun Wei Chong Li Deng Cai AI4TS 31 33 0 28 Mar 2022
Reinforcement Learning with Action-Free Pre-Training from Videos Younggyo Seo Kimin Lee Stephen James Pieter Abbeel SSL OnRL 18 117 0 25 Mar 2022
R3M: A Universal Visual Representation for Robot Manipulation Suraj Nair Aravind Rajeswaran Vikash Kumar Chelsea Finn Abhi Gupta LM&Ro 19 544 0 23 Mar 2022
Goal-conditioned dual-action imitation learning for dexterous dual-arm robot manipulation Heecheol Kim Y. Ohmura Y. Kuniyoshi 27 27 0 18 Mar 2022
Weakly Supervised Correspondence Learning Zihan Wang Zhangjie Cao Yilun Hao Dorsa Sadigh SSL 18 9 0 02 Mar 2022
LobsDICE: Offline Learning from Observation via Stationary Distribution Correction Estimation Geon-hyeong Kim Jongmin Lee Youngsoo Jang Hongseok Yang Kyungmin Kim OffRL 25 15 0 28 Feb 2022
Training Robots without Robots: Deep Imitation Learning for Master-to-Robot Policy Transfer Heecheol Kim Y. Ohmura Akihiko Nagakubo Y. Kuniyoshi 13 23 0 19 Feb 2022
Adversarial Imitation Learning from Video using a State Observer Haresh Karnan Garrett A. Warnell F. Torabi Peter Stone GAN 29 13 0 01 Feb 2022
DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video Priyanka Mandikal Kristen Grauman 141 94 0 01 Feb 2022
Contrastive Learning from Demonstrations André Rosa de Sousa Porfírio Correia L. A. Alexandre SSL 21 2 0 30 Jan 2022
Learning to Manipulate Tools by Aligning Simulation to Video Demonstration Kateryna Zorina Justin Carpentier Josef Sivic Vladimir Petrik 12 10 0 04 Nov 2021
Shaping embodied agent behavior with activity-context priors from egocentric video Tushar Nagarajan Kristen Grauman EgoV LM&Ro 43 13 0 14 Oct 2021
Cross-Domain Imitation Learning via Optimal Transport Arnaud Fickinger Samuel N. Cohen Stuart J. Russell Brandon Amos OT 45 48 0 07 Oct 2021
Learning Periodic Tasks from Human Demonstrations Jingyun Yang Junwu Zhang Connor Settle Akshara Rai Rika Antonova Jeannette Bohg 104 24 0 28 Sep 2021
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets F. Ebert Yanlai Yang Karl Schmeckpeper Bernadette Bucher G. Georgakis Kostas Daniilidis Chelsea Finn Sergey Levine 169 219 0 27 Sep 2021
POAR: Efficient Policy Optimization via Online Abstract State Representation Learning Zhaorun Chen Siqi Fan Yuan Tan Liang Gong Binhao Chen Te Sun David Filliat Natalia Díaz Rodríguez Chengliang Liu OffRL 30 0 0 17 Sep 2021
Cross Domain Robot Imitation with Invariant Representation Zhao-Heng Yin Lingfeng Sun Hengbo Ma M. Tomizuka Wu-Jun Li 24 13 0 13 Sep 2021
DexMV: Imitation Learning for Dexterous Manipulation from Human Videos Yuzhe Qin Yueh-hua Wu Shaowei Liu Hanwen Jiang Ruihan Yang Yang Fu Xiaolong Wang 125 188 0 12 Aug 2021