Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation

11 July 2017

YuXuan Liu

Abhishek Gupta

Pieter Abbeel

Sergey Levine

ArXiv PDF HTML

Papers citing "Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation"

50 / 204 papers shown

Title
MA-ROESL: Motion-aware Rapid Reward Optimization for Efficient Robot Skill Learning from Single Videos Xinyu Wang Xinming Zhang Yanjun Chen Xiaoyu Shen Wei Zhang 24 0 0 13 May 2025
CLAM: Continuous Latent Action Models for Robot Learning from Unlabeled Demonstrations Anthony Liang Pavel Czempin Matthew Hong Yutai Zhou Erdem Biyik Stephen Tu 47 0 0 08 May 2025
Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models Chen Wang Fei Xia Wenhao Yu Tingnan Zhang Ruohan Zhang Ce Liu Li Fei-Fei Jie Tan Jacky Liang 33 0 0 17 Apr 2025
FADConv: A Frequency-Aware Dynamic Convolution for Farmland Non-agriculturalization Identification and Segmentation Tan Shu Li Shen 46 0 0 04 Apr 2025
Slot-Level Robotic Placement via Visual Imitation from Single Human Video Dandan Shan Kaichun Mo Wei Yang Yu-Wei Chao David Fouhey Dieter Fox Arsalan Mousavian 36 0 0 02 Apr 2025
Geometrically-Aware One-Shot Skill Transfer of Category-Level Objects Cristiana Miranda de Farias Luis F. C. Figueredo Riddhiman Laha Maxime Adjigble Brahim Tamadazte Rustam Stolkin Sami Haddadin Naresh Marturi 46 0 0 19 Mar 2025
Feasibility-aware Imitation Learning from Observations through a Hand-mounted Demonstration Interface Kei Takahashi Hikaru Sasaki Takamitsu Matsubara 43 0 0 13 Mar 2025
Human2Robot: Learning Robot Actions from Paired Human-Robot Videos Sicheng Xie Haidong Cao Zejia Weng Zhen Xing Shiwei Shen Jiaqi Leng Xipeng Qiu Yanwei Fu Zuxuan Wu Yu Jiang 56 0 0 23 Feb 2025
Off-Dynamics Reinforcement Learning via Domain Adaptation and Reward Augmented Imitation Yihong Guo Yixuan Wang Yuanyuan Shi Pan Xu Anqi Liu 24 3 0 15 Nov 2024
VLMimic: Vision Language Models are Visual Imitation Learner for Fine-grained Actions Guanyan Chen Hao Wu Te Cui Yao Mu Haoyang Lu ... Mengxiao Hu Haizhou Li Y. Li Yi Yang Yufeng Yue VLM 26 3 0 28 Oct 2024
Language-Model-Assisted Bi-Level Programming for Reward Learning from Internet Videos Harsh Mahesheka Zhixian Xie Zhilin Wang Wanxin Jin 29 0 0 11 Oct 2024
Imitation Learning with Limited Actions via Diffusion Planners and Deep Koopman Controllers Jianxin Bi Kelvin Lim Kaiqi Chen Yifei Huang Harold Soh 29 0 0 10 Oct 2024
Embodiment-Agnostic Action Planning via Object-Part Scene Flow Weiliang Tang Jia-Hui Pan Wei Zhan Jianshu Zhou Huaxiu Yao Yun-Hui Liu M. Tomizuka Mingyu Ding Chi-Wing Fu 50 0 0 16 Sep 2024
xTED: Cross-Domain Adaptation via Diffusion-Based Trajectory Editing Haoyi Niu Qimao Chen Tenglong Liu Jianxiong Li Guyue Zhou Yi Zhang Jianming Hu Xianyuan Zhan 34 0 0 13 Sep 2024
Representation Alignment from Human Feedback for Cross-Embodiment Reward Learning from Mixed-Quality Demonstrations Connor Mattson Anurag Aribandi Daniel S. Brown 38 0 0 10 Aug 2024
Cross-Domain Policy Transfer by Representation Alignment via Multi-Domain Behavioral Cloning Hayato Watahiki Ryo Iwase Ryosuke Unno Yoshimasa Tsuruoka 35 0 0 24 Jul 2024
Flow as the Cross-Domain Manipulation Interface Mengda Xu Zhenjia Xu Yinghao Xu Cheng Chi Gordon Wetzstein Manuela Veloso Shuran Song AI4CE 37 36 0 21 Jul 2024
Adapt2Reward: Adapting Video-Language Models to Generalizable Robotic Rewards via Failure Prompts Yanting Yang Minghao Chen Qibo Qiu Jiahao Wu Wenxiao Wang Binbin Lin Ziyu Guan Xiaofei He LM&Ro 42 2 0 20 Jul 2024
Visually Robust Adversarial Imitation Learning from Videos with Contrastive Learning Vittorio Giammarino James Queeney I. Paschalidis 24 1 0 18 Jun 2024
HumanPlus: Humanoid Shadowing and Imitation from Humans Zipeng Fu Qingqing Zhao Qi Wu Gordon Wetzstein Chelsea Finn SyDa 30 88 0 15 Jun 2024
Vision-based Manipulation from Single Human Video with Open-World Object Graphs Yifeng Zhu Arisrei Lim Peter Stone Yuke Zhu 31 33 0 30 May 2024
Hand-Object Interaction Controller (HOIC): Deep Reinforcement Learning for Reconstructing Interactions with Physics Haoyu Hu Xinyu Yi Zhe Cao Jun-hai Yong Feng Xu 38 2 0 04 May 2024
Imitation Learning: A Survey of Learning Methods, Environments and Metrics Nathan Gavenski Odinaldo Rodrigues Michael Luck 32 135 0 30 Apr 2024
VIEW: Visual Imitation Learning with Waypoints Ananth Jonnavittula Sagar Parekh Dylan P. Losey SSL 91 9 0 27 Apr 2024
Learning Symbolic Task Representation from a Human-Led Demonstration: A Memory to Store, Retrieve, Consolidate, and Forget Experiences Luca Buoncompagni Fulvio Mastrogiovanni 21 0 0 16 Apr 2024
Learning Prehensile Dexterity by Imitating and Emulating State-only Observations Yunhai Han Zhenyang Chen Harish Ravichandar 30 5 0 08 Apr 2024
Fusion Dynamical Systems with Machine Learning in Imitation Learning: A Comprehensive Overview Yingbai Hu Fares J. Abu-Dakka Fei Chen Xiao Luo Zheng Li Alois C. Knoll Weiping Ding AI4CE 38 7 0 29 Mar 2024
Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers Vidhi Jain Maria Attarian Nikhil J. Joshi Ayzaan Wahid Danny Driess ... Stefan Welker Christine Chan Igor Gilitschenski Yonatan Bisk Debidatta Dwibedi 68 29 0 19 Mar 2024
Deep Reinforcement Learning for Modelling Protein Complexes Ziqi Gao Tao Feng Jiaxuan You Chenyi Zi Yan Zhou Chen Zhang Jia Li 48 5 0 11 Mar 2024
Cross Domain Policy Transfer with Effect Cycle-Consistency Ruiqi Zhu Tianhong Dai Oya Celiktutan 36 3 0 04 Mar 2024
Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Painting L. Chen Kush Hari K. Dharmarajan Chenfeng Xu Quan Vuong Ken Goldberg 49 20 0 29 Feb 2024
A Model-Based Approach for Improving Reinforcement Learning Efficiency Leveraging Expert Observations E. C. Ozcan Vittorio Giammarino James Queeney I. Paschalidis OffRL 34 0 0 29 Feb 2024
SemTra: A Semantic Skill Translator for Cross-Domain Zero-Shot Policy Adaptation Sangwoo Shin Minjong Yoo Jeongwoo Lee Honguk Woo 43 4 0 12 Feb 2024
Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulation Chrisantus Eze Christopher Crick SSL 82 12 0 11 Feb 2024
A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents Haoyi Niu Jianming Hu Guyue Zhou Xianyuan Zhan 23 10 0 07 Feb 2024
ILBiT: Imitation Learning for Robot Using Position and Torque Information based on Bilateral Control with Transformer Masato Kobayashi Thanpimon Buamanee Yuki Uranishi Haruo Takemura 26 8 0 30 Jan 2024
Context-Former: Stitching via Latent Conditioned Sequence Modeling Ziqi Zhang Jingzehua Xu Jinxin Liu Zifeng Zhuang Donglin Wang Miao Liu Shuai Zhang OffRL 42 4 0 29 Jan 2024
Domain Adaptive Imitation Learning with Visual Observation Sungho Choi Seungyul Han Woojun Kim Jongseong Chae Whiyoung Jung Young-Jin Sung OOD 19 5 0 01 Dec 2023
Transfer Learning in Robotics: An Upcoming Breakthrough? A Review of Promises and Challenges Noémie Jaquier Michael C. Welle A. Gams Kunpeng Yao Bernardo Fichera A. Billard Aleš Ude Tamim Asfour Danica Kragic 30 14 0 29 Nov 2023
Invariant Causal Imitation Learning for Generalizable Policies Ioana Bica Daniel Jarrett Mihaela van der Schaar CML OffRL OOD 57 33 0 02 Nov 2023
Sim-to-Real Transfer of Adaptive Control Parameters for AUV Stabilization under Current Disturbance Thomas Chaffre J. Wheare A. Lammas Paulo E. Santos G. Chenadec Karl Sammut Benoit Clement 23 1 0 17 Oct 2023
Open X-Embodiment: Robotic Learning Datasets and RT-X Models Open X-Embodiment Collaboration Abby OÑeill Abdul Rehman Abhinav Gupta Abhiram Maddukuri ... Zhuo Xu Zichen Jeff Cui Zichen Zhang Zipeng Fu Zipeng Lin LM&Ro 44 460 0 13 Oct 2023
Adversarial Imitation Learning from Visual Observations using Latent Information Vittorio Giammarino Tomas Landelius I. Paschalidis 9 6 0 29 Sep 2023
Continual Robot Learning using Self-Supervised Task Inference Muhammad Burhan Hafez Stefan Wermter CLL SSL 16 6 0 10 Sep 2023
A Survey of Imitation Learning: Algorithms, Recent Developments, and Challenges Maryam Zare P. Kebria Abbas Khosravi Saeid Nahavandi 21 81 0 05 Sep 2023
Hundreds Guide Millions: Adaptive Offline Reinforcement Learning with Expert Guidance Qisen Yang Shenzhi Wang Qihang Zhang Gao Huang Shiji Song OffRL OnRL 24 8 0 04 Sep 2023
Learning to Identify Critical States for Reinforcement Learning from Videos Haozhe Liu Mingchen Zhuge Bing Li Yu‐Han Wang Francesco Faccio Guohao Li Jürgen Schmidhuber OffRL 25 6 0 15 Aug 2023
XSkill: Cross Embodiment Skill Discovery Mengda Xu Zhenjia Xu Cheng Chi Manuela Veloso Shuran Song 28 65 0 19 Jul 2023
Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations Moo Jin Kim Jiajun Wu Chelsea Finn 21 7 0 12 Jul 2023
$RObotic MAnipulation Network (ROMAN) $\unicode{x2013}$ Hybrid Hierarchical Learning for Solving Complex Sequential Tasks$ RObotic MAnipulation Network (ROMAN) $\unicode{x2013}$ Hybrid Hierarchical Learning for Solving Complex Sequential Tasks Eleftherios Triantafyllidis Fernando Acero Zhaocheng Liu Zhibin Li 16 0 0 30 Jun 2023