APS: Active Pretraining with Successor Features

31 August 2021

Pieter Abbeel

Papers citing "APS: Active Pretraining with Successor Features"

50 / 81 papers shown

Title
Uncovering RL Integration in SSL Loss: Objective-Specific Implications for Data-Efficient RL Ömer Veysel Çağatan Barış Akgün OffRL 34 0 0 22 Oct 2024
Constrained Skill Discovery: Quadruped Locomotion with Unsupervised Reinforcement Learning Vassil Atanassov Wanming Yu Alexander L. Mitchell M. N. Finean Ioannis Havoutis SSL 27 1 0 10 Oct 2024
Contrastive Abstraction for Reinforcement Learning Vihang Patil M. Hofmarcher Elisabeth Rumetshofer Sepp Hochreiter OffRL SSL 24 2 0 01 Oct 2024
Semi-Supervised One-Shot Imitation Learning Philipp Wu Kourosh Hakhamaneshi Yuqing Du Igor Mordatch Aravind Rajeswaran Pieter Abbeel SSL 20 1 0 09 Aug 2024
Constrained Intrinsic Motivation for Reinforcement Learning Xiang Zheng Xingjun Ma Chao Shen Cong Wang 29 1 0 12 Jul 2024
Uncertainty-Aware Reward-Free Exploration with General Function Approximation Junkai Zhang Weitong Zhang Dongruo Zhou Q. Gu 49 2 0 24 Jun 2024
The Limits of Pure Exploration in POMDPs: When the Observation Entropy is Enough Riccardo Zamboni Duilio Cirino Marcello Restelli Mirco Mutti 36 4 0 18 Jun 2024
Language Guided Skill Discovery Seungeun Rho Laura Smith Tianyu Li Sergey Levine Xue Bin Peng Sehoon Ha LM&Ro 40 4 0 07 Jun 2024
Open Problem: Active Representation Learning Nikola Milosevic Gesine Müller Jan Huisken Nico Scherf 21 1 0 06 Jun 2024
Do's and Don'ts: Learning Desirable Skills with Instruction Videos Hyunseung Kim ByungKun Lee Hojoon Lee Dongyoon Hwang Donghu Kim Jaegul Choo 37 1 0 01 Jun 2024
Constrained Ensemble Exploration for Unsupervised Skill Discovery Chenjia Bai Rushuai Yang Qiaosheng Zhang Kang Xu Yi Chen Ting Xiao Xuelong Li OffRL 40 3 0 25 May 2024
PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement Learning Chengyang Ying Zhongkai Hao Xinning Zhou Xuezhou Xu Hang Su Xingxing Zhang Jun Zhu 27 4 0 23 May 2024
Learning Future Representation with Synthetic Observations for Sample-efficient Reinforcement Learning Xin Liu Yaran Chen Dong Zhao 35 1 0 20 May 2024
Decoupling Exploration and Exploitation for Unsupervised Pre-training with Successor Features JaeYoon Kim Junyu Xuan Christy Jie Liang F. Hussain 19 0 0 04 May 2024
Acquiring Diverse Skills using Curriculum Reinforcement Learning with Mixture of Experts Onur Celik Aleksandar Taranovic Gerhard Neumann 26 7 0 11 Mar 2024
Q-Star Meets Scalable Posterior Sampling: Bridging Theory and Practice via HyperAgent Yingru Li Jiawei Xu Lei Han Zhi-Quan Luo BDL OffRL 18 6 0 05 Feb 2024
CUDC: A Curiosity-Driven Unsupervised Data Collection Method with Adaptive Temporal Distances for Offline Reinforcement Learning Chenyu Sun Hangwei Qian Chunyan Miao OffRL 17 1 0 19 Dec 2023
LiFT: Unsupervised Reinforcement Learning with Foundation Models as Teachers Taewook Nam Juyong Lee Jesse Zhang Sung Ju Hwang Joseph J. Lim Karl Pertsch OffRL LRM 43 4 0 14 Dec 2023
FoMo Rewards: Can we cast foundation models as reward functions? Ekdeep Singh Lubana Johann Brehmer P. D. Haan Taco S. Cohen OffRL LRM 33 2 0 06 Dec 2023
Augmenting Unsupervised Reinforcement Learning with Self-Reference Andrew Zhao Erle Zhu Rui Lu Matthieu Lin Yong-Jin Liu Gao Huang SSL 19 1 0 16 Nov 2023
A Central Motor System Inspired Pre-training Reinforcement Learning for Robotic Control Pei Zhang Zhaobo Hua Jinliang Ding 30 0 0 14 Nov 2023
Learning to Discover Skills through Guidance Hyunseung Kim ByungKun Lee Hojoon Lee Dongyoon Hwang Sejik Park Kyushik Min Jaegul Choo 37 6 0 31 Oct 2023
Variational Curriculum Reinforcement Learning for Unsupervised Discovery of Skills Seongun Kim Kyowoon Lee Jaesik Choi SSL DRL 23 7 0 30 Oct 2023
Diversify & Conquer: Outcome-directed Curriculum RL via Out-of-Distribution Disagreement Daesol Cho Seungjae Lee H. J. Kim OODD 11 0 0 30 Oct 2023
Keep Various Trajectories: Promoting Exploration of Ensemble Policies in Continuous Control Chao Li Chen Gong Qiang He Xinwen Hou 17 0 0 17 Oct 2023
METRA: Scalable Unsupervised RL with Metric-Aware Abstraction Seohong Park Oleh Rybkin Sergey Levine OffRL 28 34 0 13 Oct 2023
Pre-Training and Fine-Tuning Generative Flow Networks Ling Pan Moksh Jain Kanika Madan Yoshua Bengio 42 13 0 05 Oct 2023
ComSD: Balancing Behavioral Quality and Diversity in Unsupervised Skill Discovery Xin Liu Yaran Chen Dong Zhao 25 0 0 29 Sep 2023
Zero-Shot Reinforcement Learning from Low Quality Data Scott Jeen Tom Bewley Jonathan M. Cullen OffRL OnRL 32 0 0 26 Sep 2023
XSkill: Cross Embodiment Skill Discovery Mengda Xu Zhenjia Xu Cheng Chi Manuela Veloso Shuran Song 18 65 0 19 Jul 2023
Explore to Generalize in Zero-Shot RL E. Zisselman Itai Lavie Daniel Soudry Aviv Tamar 10 15 0 05 Jun 2023
Accelerating Reinforcement Learning with Value-Conditional State Entropy Exploration Dongyoung Kim Jinwoo Shin Pieter Abbeel Younggyo Seo 16 19 0 31 May 2023
Emergent Agentic Transformer from Chain of Hindsight Experience Hao Liu Pieter Abbeel OffRL 17 25 0 26 May 2023
Unsupervised Discovery of Continuous Skills on a Sphere Takahisa Imagawa Takuya Hiraoka Yoshimasa Tsuruoka 14 0 0 21 May 2023
Policy Gradient Methods in the Presence of Symmetries and State Abstractions Prakash Panangaden S. Rezaei-Shoshtari Rosie Zhao D. Meger Doina Precup 25 2 0 09 May 2023
Behavior Contrastive Learning for Unsupervised Skill Discovery Rushuai Yang Chenjia Bai Hongyi Guo Siyuan Li Bin Zhao Zhen Wang Peng Liu Xuelong Li SSL 22 16 0 08 May 2023
Using Offline Data to Speed-up Reinforcement Learning in Procedurally Generated Environments Alain Andres Lukas Schafer Esther Villar-Rodriguez Stefano V. Albrecht Javier Del Ser OffRL OnRL 26 2 0 18 Apr 2023
Controllability-Aware Unsupervised Skill Discovery Seohong Park Kimin Lee Youngwoon Lee Pieter Abbeel 19 43 0 10 Feb 2023
Outcome-directed Reinforcement Learning by Uncertainty & Temporal Distance-Aware Curriculum Goal Generation Daesol Cho Seungjae Lee H. J. Kim 13 14 0 27 Jan 2023
Pre-Trained Image Encoder for Generalizable Visual Reinforcement Learning Zhecheng Yuan Zhengrong Xue Bo Yuan Xueqian Wang Yi Wu Yang Gao Huazhe Xu SSL OffRL 33 70 0 17 Dec 2022
A Unified Algorithm Framework for Unsupervised Discovery of Skills based on Determinantal Point Process Jiayu Chen Vaneet Aggarwal Tian-Shing Lan 8 1 0 01 Dec 2022
CIM: Constrained Intrinsic Motivation for Sparse-Reward Continuous Control Xiang Zheng Xingjun Ma Cong Wang 26 1 0 28 Nov 2022
Choreographer: Learning and Adapting Skills in Imagination Pietro Mazzaglia Tim Verbelen Bart Dhoedt Alexandre Lacoste Sai Rajeswar 21 21 0 23 Nov 2022
Masked Autoencoding for Scalable and Generalizable Decision Making Fangchen Liu Hao Liu Aditya Grover Pieter Abbeel OffRL 37 45 0 23 Nov 2022
Discovering Unsupervised Behaviours from Full-State Trajectories Luca Grillotti Antoine Cully 14 0 0 22 Nov 2022
Curiosity in Hindsight: Intrinsic Exploration in Stochastic Environments Daniel Jarrett Corentin Tallec Florent Altché Thomas Mesnard Rémi Munos Michal Valko 32 5 0 18 Nov 2022
Pretraining in Deep Reinforcement Learning: A Survey Zhihui Xie Zichuan Lin Junyou Li Shuai Li Deheng Ye OffRL OnRL AI4CE 21 23 0 08 Nov 2022
On the importance of data collection for training general goal-reaching policies Alexis Jacq Manu Orsini Gabriel Dulac-Arnold Olivier Pietquin M. Geist Olivier Bachem OffRL 25 1 0 07 Nov 2022
Learning General World Models in a Handful of Reward-Free Deployments Yingchen Xu Jack Parker-Holder Aldo Pacchiano Philip J. Ball Oleh Rybkin Stephen J. Roberts Tim Rocktaschel Edward Grefenstette OffRL 53 8 0 23 Oct 2022
Palm up: Playing in the Latent Manifold for Unsupervised Pretraining Hao Liu Tom Zahavy Volodymyr Mnih Satinder Singh SSL 25 7 0 19 Oct 2022