Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation

11 July 2017

YuXuan Liu

Abhishek Gupta

Pieter Abbeel

Sergey Levine

ArXiv PDF HTML

Papers citing "Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation"

50 / 204 papers shown

Title
Self-Supervised Disentangled Representation Learning for Third-Person Imitation Learning Jinghuan Shang Michael S. Ryoo SSL 24 24 0 02 Aug 2021
Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Tasks Ruohan Zhang F. Torabi Garrett A. Warnell Peter Stone 73 28 0 13 Jul 2021
Behavior Self-Organization Supports Task Inference for Continual Robot Learning Muhammad Burhan Hafez S. Wermter CLL SSL 13 11 0 09 Jul 2021
Imitation Learning: Progress, Taxonomies and Challenges Boyuan Zheng Sunny Verma Jianlong Zhou Ivor Tsang Fang Chen 22 85 0 23 Jun 2021
Learning by Watching Jimuyang Zhang Eshed Ohn-Bar EgoV 33 33 0 10 Jun 2021
XIRL: Cross-embodiment Inverse Reinforcement Learning Kevin Zakka Andy Zeng Peter R. Florence Jonathan Tompson Jeannette Bohg Debidatta Dwibedi SSL 30 118 0 07 Jun 2021
Cross-domain Imitation from Observations Dripta S. Raychaudhuri S. Paul J. Baar A. Roy-Chowdhury OOD 17 40 0 20 May 2021
VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigation Haresh Karnan Garrett A. Warnell Xuesu Xiao Peter Stone 22 57 0 19 May 2021
DisCo RL: Distribution-Conditioned Reinforcement Learning for General-Purpose Policies Soroush Nasiriany Vitchyr H. Pong Ashvin Nair Alexander Khazatsky Glen Berseth Sergey Levine OffRL 58 14 0 23 Apr 2021
Scalable Visual Attribute Extraction through Hidden Layers of a Residual ConvNet Andres Baloian Garrett A. Warnell J. M. Saavedra FAtt 28 5 0 31 Mar 2021
Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videos Annie S. Chen Suraj Nair Chelsea Finn 30 137 0 31 Mar 2021
User profile-driven large-scale multi-agent learning from demonstration in federated human-robot collaborative environments Georgios Th. Papadopoulos A. Leonidis M. Antona C. Stephanidis 14 7 0 30 Mar 2021
Manipulator-Independent Representations for Visual Imitation Yuxiang Zhou Y. Aytar Konstantinos Bousmalis LM&Ro 25 23 0 16 Mar 2021
Domain-Robust Visual Imitation Learning with Mutual Information Constraints Edoardo Cetin Oya Celiktutan OOD DRL 14 18 0 08 Mar 2021
Off-Policy Imitation Learning from Observations Zhuangdi Zhu Kaixiang Lin Bo Dai Jiayu Zhou OffRL 13 86 0 25 Feb 2021
PsiPhi-Learning: Reinforcement Learning with Demonstrations using Successor Features and Inverse Temporal Difference Learning Angelos Filos Clare Lyle Y. Gal Sergey Levine Natasha Jaques Gregory Farquhar 18 22 0 24 Feb 2021
Learning by Watching: Physical Imitation of Manipulation Skills from Human Videos Haoyu Xiong Quanzhou Li Yun-Chun Chen Homanga Bharadhwaj Samarth Sinha Animesh Garg SSL 128 93 0 18 Jan 2021
Learning Cross-Domain Correspondence for Control with Dynamics Cycle-Consistency Qiang Zhang Tete Xiao Alexei A. Efros Lerrel Pinto Xiaolong Wang 12 62 0 17 Dec 2020
Learning to Run with Potential-Based Reward Shaping and Demonstrations from Video Data Aleksandra Malysheva D. Kudenko A. Shpilman 11 5 0 16 Dec 2020
Towards open and expandable cognitive AI architectures for large-scale multi-agent human-robot collaborative learning Georgios Th. Papadopoulos M. Antona C. Stephanidis AI4CE 22 24 0 15 Dec 2020
Learning Object Manipulation Skills via Approximate State Estimation from Real Videos Vladimir Petrik Makarand Tapaswi Ivan Laptev Josef Sivic 14 23 0 13 Nov 2020
Reinforcement Learning with Videos: Combining Offline Observations with Interaction Karl Schmeckpeper Oleh Rybkin Kostas Daniilidis Sergey Levine Chelsea Finn OffRL 16 105 0 12 Nov 2020
CLOUD: Contrastive Learning of Unsupervised Dynamics Jianren Wang Yujie Lu Hang Zhao 28 5 0 23 Oct 2020
Model-Based Inverse Reinforcement Learning from Visual Demonstrations Neha Das Sarah Bechtle Todor Davchev Dinesh Jayaraman Akshara Rai Franziska Meier 116 82 0 18 Oct 2020
DORi: Discovering Object Relationship for Moment Localization of a Natural-Language Query in Video Cristian Rodriguez-Opazo Edison Marrese-Taylor Basura Fernando Hongdong Li Stephen Gould 134 11 0 13 Oct 2020
Learn by Observation: Imitation Learning for Drone Patrolling from Videos of A Human Navigator Yue Fan Shilei Chu Wei Zhang Ran Song Yibin Li SSL AI4TS 29 11 0 30 Aug 2020
Imitating Unknown Policies via Exploration Nathan Gavenski Juarez Monteiro R. Granada Felipe Meneguzzi Rodrigo C. Barros OffRL 15 7 0 13 Aug 2020
An Imitation from Observation Approach to Transfer Learning with Dynamics Mismatch Siddarth Desai Ishan Durugkar Haresh Karnan Garrett A. Warnell Josiah P. Hanna Peter Stone 12 5 0 04 Aug 2020
Interactive Imitation Learning in State-Space Snehal Jauhri C. Celemin Jens Kober 17 14 0 02 Aug 2020
Reparameterized Variational Divergence Minimization for Stable Imitation Dilip Arumugam Debadeepta Dey Alekh Agarwal Asli Celikyilmaz E. Nouri W. Dolan 25 3 0 18 Jun 2020
Semantic Visual Navigation by Watching YouTube Videos Matthew Chang Arjun Gupta Saurabh Gupta 6 80 0 17 Jun 2020
Cross-Domain Imitation Learning with a Dual Structure Sungho Choi Seungyul Han Woojun Kim Y. Sung 16 2 0 02 Jun 2020
Motion2Vec: Semi-Supervised Representation Learning from Surgical Videos A. Tanwani P. Sermanet Andy Yan Raghav V. Anand Mariano Phielipp Ken Goldberg SSL 16 36 0 31 May 2020
Towards intervention-centric causal reasoning in learning agents B. Lansdell LRM CML 6 0 0 26 May 2020
Augmented Behavioral Cloning from Observation Juarez Monteiro Nathan Gavenski R. Granada Felipe Meneguzzi Rodrigo C. Barros 19 12 0 28 Apr 2020
Transferable Active Grasping and Real Embodied Dataset Xiangyu Chen Zelin Ye Jiankai Sun Yuda Fan Fangwei Hu Chenxi Wang Cewu Lu 17 19 0 28 Apr 2020
The Ingredients of Real-World Robotic Reinforcement Learning Henry Zhu Justin Yu Abhishek Gupta Dhruv Shah Kristian Hartikainen Avi Singh Vikash Kumar Sergey Levine OffRL 55 171 0 27 Apr 2020
State-Only Imitation Learning for Dexterous Manipulation Ilija Radosavovic Xiaolong Wang Lerrel Pinto Jitendra Malik OffRL 19 121 0 07 Apr 2020
Visual Task Progress Estimation with Appearance Invariant Embeddings for Robot Control and Planning Guilherme J. Maeda Joni Väätäinen Hironori Yoshida 15 2 0 16 Mar 2020
Vision-based Robot Manipulation Learning via Human Demonstrations Zhixin Jia Mengxiang Lin Zhixin Chen Shibo Jian SSL 6 7 0 01 Mar 2020
Provably Efficient Third-Person Imitation from Offline Observation Aaron Zweig Joan Bruna OffRL 4 2 0 27 Feb 2020
State-only Imitation with Transition Dynamics Mismatch Tanmay Gangwani Jian Peng 12 49 0 27 Feb 2020
Estimating Q(s,s') with Deep Deterministic Dynamics Gradients Ashley D. Edwards Himanshu Sahni Rosanne Liu Jane Hung Ankit Jain Rui Wang Adrien Ecoffet Thomas Miconi Charles Isbell J. Yosinski OffRL 16 18 0 21 Feb 2020
Domain-Adversarial and Conditional State Space Model for Imitation Learning Ryogo Okumura Masashi Okada T. Taniguchi 21 11 0 31 Jan 2020
Learning Predictive Models From Observation and Interaction Karl Schmeckpeper Annie Xie Oleh Rybkin Stephen Tian Kostas Daniilidis Sergey Levine Chelsea Finn DRL 33 60 0 30 Dec 2019
To Follow or not to Follow: Selective Imitation Learning from Observations Youngwoon Lee E. Hu Zhengyu Yang Joseph J. Lim 22 15 0 16 Dec 2019
SMiRL: Surprise Minimizing Reinforcement Learning in Unstable Environments Glen Berseth Daniel Geng Coline Devin Nicholas Rhinehart Chelsea Finn Dinesh Jayaraman Sergey Levine 11 21 0 11 Dec 2019
AVID: Learning Multi-Stage Tasks via Pixel-Level Translation of Human Videos Laura M. Smith Nikita Dhawan Marvin Zhang Pieter Abbeel Sergey Levine 41 156 0 10 Dec 2019
State Alignment-based Imitation Learning Fangchen Liu Z. Ling Tongzhou Mu Hao Su 9 91 0 21 Nov 2019
Motion Reasoning for Goal-Based Imitation Learning De-An Huang Yu-Wei Chao Chris Paxton Xinke Deng Li Fei-Fei Juan Carlos Niebles Animesh Garg D. Fox 26 12 0 13 Nov 2019