Reinforcement Learning with Videos: Combining Offline Observations with Interaction

12 November 2020

Papers citing "Reinforcement Learning with Videos: Combining Offline Observations with Interaction"

50 / 79 papers shown

Title
MA-ROESL: Motion-aware Rapid Reward Optimization for Efficient Robot Skill Learning from Single Videos X. Wang X. Zhang Yanjun Chen Xiaoyu Shen Wei Zhang 24 0 0 13 May 2025
Video-Enhanced Offline Reinforcement Learning: A Model-Based Approach Minting Pan Yitao Zheng J. Li Yunbo Wang Xiaokang Yang OffRL 48 0 0 10 May 2025
Latent Adaptive Planner for Dynamic Manipulation Donghun Noh Deqian Kong Minglu Zhao Andrew Lizarraga Jianwen Xie Ying Nian Wu Dennis W. Hong 122 0 0 06 May 2025
Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models Chen Wang Fei Xia Wenhao Yu Tingnan Zhang Ruohan Zhang Ce Liu Li Fei-Fei Jie Tan Jacky Liang 33 0 0 17 Apr 2025
Offline Action-Free Learning of Ex-BMDPs by Comparing Diverse Datasets Alexander Levine Peter Stone Amy Zhang OffRL 57 0 0 26 Mar 2025
Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge Hengxu Yan Haoshu Fang Cewu Lu 71 0 0 20 Dec 2024
Reinforcement Learning from Wild Animal Videos Elliot Chane-Sane Constant Roux O. Stasse Nicolas Mansard 167 0 0 05 Dec 2024
Grounding Video Models to Actions through Goal Conditioned Exploration Yunhao Luo Yilun Du LM&Ro VGen 85 1 0 11 Nov 2024
Pre-trained Visual Dynamics Representations for Efficient Policy Learning Hao Luo Bohan Zhou Zongqing Lu 30 1 0 05 Nov 2024
VLMimic: Vision Language Models are Visual Imitation Learner for Fine-grained Actions Guanyan Chen M. Wang Te Cui Yao Mu Haoyang Lu ... Mengxiao Hu Haizhou Li Y. Li Yi Yang Yufeng Yue VLM 26 3 0 28 Oct 2024
On-Robot Reinforcement Learning with Goal-Contrastive Rewards Ondrej Biza Thomas Weng Lingfeng Sun Karl Schmeckpeper Tarik Kelestemur Yecheng Jason Ma Robert C. Platt Jan Willem van de Meent Lawson L. S. Wong OffRL 43 0 0 25 Oct 2024
Incorporating Task Progress Knowledge for Subgoal Generation in Robotic Manipulation through Image Edits Xuhui Kang Yen-Ling Kuo 33 3 0 14 Oct 2024
Imitation Learning with Limited Actions via Diffusion Planners and Deep Koopman Controllers Jianxin Bi Kelvin Lim Kaiqi Chen Yifei Huang Harold Soh 27 0 0 10 Oct 2024
Diffusion Imitation from Observation Bo-Ruei Huang Chun-Kai Yang Chun-Mao Lai Dai-Jie Wu Shao-Hua Sun 39 4 0 07 Oct 2024
Learning Diverse Bimanual Dexterous Manipulation Skills from Human Demonstrations Bohan Zhou Haoqi Yuan Yuhui Fu Zongqing Lu 29 11 0 03 Oct 2024
Embodiment-Agnostic Action Planning via Object-Part Scene Flow Weiliang Tang Jia-Hui Pan Wei Zhan Jianshu Zhou Huaxiu Yao Yun-Hui Liu M. Tomizuka Mingyu Ding Chi-Wing Fu 50 0 0 16 Sep 2024
Pretrained Visual Representations in Reinforcement Learning Emlyn Williams Athanasios Polydoros SSL 20 1 0 24 Jul 2024
Flow as the Cross-Domain Manipulation Interface Mengda Xu Zhenjia Xu Yinghao Xu Cheng Chi Gordon Wetzstein Manuela Veloso Shuran Song AI4CE 37 35 0 21 Jul 2024
Mitigating the Human-Robot Domain Discrepancy in Visual Pre-training for Robotic Manipulation Jiaming Zhou Teli Ma Kun-Yu Lin Ronghe Qiu Zifan Wang Junwei Liang 52 3 0 20 Jun 2024
Hybrid Reinforcement Learning from Offline Observation Alone Yuda Song J. Andrew Bagnell Aarti Singh OffRL 82 2 0 11 Jun 2024
Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics Minttu Alakuijala Reginald McLean Isaac Woungang Nariman Farsad Samuel Kaski Pekka Marttinen Kai Yuan LM&Ro 34 1 0 30 May 2024
Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representations Puhao Li Tengyu Liu Yuyang Li Muzhi Han Haoran Geng Shu Wang Yixin Zhu Song-Chun Zhu Siyuan Huang 39 16 0 26 Apr 2024
ViViDex: Learning Vision-based Dexterous Manipulation from Human Videos Zerui Chen Shizhe Chen Cordelia Schmid Ivan Laptev Cordelia Schmid 33 12 0 24 Apr 2024
Rank2Reward: Learning Shaped Reward Functions from Passive Video Daniel Yang Davin Tjia Jacob Berg Dima Damen Pulkit Agrawal Abhishek Gupta OffRL 32 5 0 23 Apr 2024
QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer Xueyi Liu Kangbo Lyu Jieqiong Zhang Tao Du Li Yi 40 4 0 11 Apr 2024
Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers Vidhi Jain Maria Attarian Nikhil J. Joshi Ayzaan Wahid Danny Driess ... Stefan Welker Christine Chan Igor Gilitschenski Yonatan Bisk Debidatta Dwibedi 68 29 0 19 Mar 2024
Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Painting L. Chen Kush Hari K. Dharmarajan Chenfeng Xu Quan Vuong Ken Goldberg 46 20 0 29 Feb 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 43 19 0 22 Feb 2024
Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots Cheng Chi Zhenjia Xu Chuer Pan Eric A. Cousineau Benjamin Burchfiel Siyuan Feng Russ Tedrake Shuran Song 17 188 0 15 Feb 2024
Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulation Chrisantus Eze Christopher Crick SSL 79 12 0 11 Feb 2024
Learning to Act without Actions Dominik Schmidt Minqi Jiang OffRL 26 30 0 17 Dec 2023
FoMo Rewards: Can we cast foundation models as reward functions? Ekdeep Singh Lubana Johann Brehmer P. D. Haan Taco S. Cohen OffRL LRM 48 2 0 06 Dec 2023
Action Inference by Maximising Evidence: Zero-Shot Imitation from Observation with World Models Xingyuan Zhang Philip Becker-Ehmck Patrick van der Smagt Maximilian Karl 31 5 0 04 Dec 2023
Socially Cognizant Robotics for a Technology Enhanced Society Kristin J. Dana Clinton Andrews Kostas Bekris Jacob Feldman Matthew Stone Pernille Hemmer Aaron Mazzeo Hal Salzman Jingang Yi 18 0 0 27 Oct 2023
Open X-Embodiment: Robotic Learning Datasets and RT-X Models Open X-Embodiment Collaboration Abby OÑeill Abdul Rehman Abhinav Gupta Abhiram Maddukuri ... Zhuo Xu Zichen Jeff Cui Zichen Zhang Zipeng Fu Zipeng Lin LM&Ro 42 460 0 13 Oct 2023
Learning to Act from Actionless Videos through Dense Correspondences Po-Chen Ko Jiayuan Mao Yilun Du Shao-Hua Sun Josh Tenenbaum 22 74 0 12 Oct 2023
Robotic Offline RL from Internet Videos via Value-Function Pre-Training Chethan Bhateja Derek Guo Dibya Ghosh Anika Singh Manan Tomar Q. Vuong Yevgen Chebotar Sergey Levine Aviral Kumar OffRL 36 20 0 22 Sep 2023
HIQL: Offline Goal-Conditioned RL with Latent States as Actions Seohong Park Dibya Ghosh Benjamin Eysenbach Sergey Levine OffRL 30 44 0 22 Jul 2023
XSkill: Cross Embodiment Skill Discovery Mengda Xu Zhenjia Xu Cheng Chi Manuela Veloso Shuran Song 23 65 0 19 Jul 2023
Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations Moo Jin Kim Jiajun Wu Chelsea Finn 21 7 0 12 Jul 2023
Polybot: Training One Policy Across Robots While Embracing Variability Jonathan Yang Dorsa Sadigh Chelsea Finn 21 34 0 07 Jul 2023
LAGOON: Language-Guided Motion Control Shusheng Xu Huaijie Wang Jiaxuan Gao Yutao Ouyang Chao Yu Yi Wu LM&Ro 29 1 0 18 Jun 2023
Look Ma, No Hands! Agent-Environment Factorization of Egocentric Videos Matthew Chang Aditya Prakash Saurabh Gupta DiffM 27 17 0 25 May 2023
Video Prediction Models as Rewards for Reinforcement Learning Alejandro Escontrela Ademi Adeniji Wilson Yan Ajay Jain Xue Bin Peng Ken Goldberg Youngwoon Lee Danijar Hafner Pieter Abbeel 39 52 0 23 May 2023
Learning Video-Conditioned Policies for Unseen Manipulation Tasks Elliot Chane-Sane Cordelia Schmid Ivan Laptev 27 18 0 10 May 2023
Reinforcement Learning from Passive Data via Latent Intentions Dibya Ghosh Chethan Bhateja Sergey Levine OffRL 21 41 0 10 Apr 2023
MAHALO: Unifying Offline Reinforcement Learning and Imitation Learning from Observations Anqi Li Byron Boots Ching-An Cheng OffRL 28 16 0 30 Mar 2023
PLEX: Making the Most of the Available Data for Robotic Manipulation Pretraining G. Thomas Ching-An Cheng Ricky Loynd Felipe Vieira Frujeri Vibhav Vineet Mihai Jalobeanu Andrey Kolobov SSL 21 8 0 15 Mar 2023
Manipulate by Seeing: Creating Manipulation Controllers from Pre-Trained Representations Jianren Wang Sudeep Dasari M. K. Srirama Shubham Tulsiani Abhi Gupta SSL 53 15 0 14 Mar 2023
MimicPlay: Long-Horizon Imitation Learning by Watching Human Play Chen Wang Linxi Fan Jiankai Sun Ruohan Zhang Li Fei-Fei Danfei Xu Yuke Zhu Anima Anandkumar 36 182 0 24 Feb 2023