CoBERL: Contrastive BERT for Reinforcement Learning

CoBERL: Contrastive BERT for Reinforcement Learning

12 July 2021

Adria Puidomenech Badia

Jovana Mitrović

Charles Blundell

Papers citing "CoBERL: Contrastive BERT for Reinforcement Learning"

18 / 18 papers shown

Title
MarineFormer: A Transformer-based Navigation Policy Model for Collision Avoidance in Marine Environment Ehsan Kazemi Iman Soltani 62 0 0 17 Oct 2024
Contrastive Abstraction for Reinforcement Learning Vihang Patil M. Hofmarcher Elisabeth Rumetshofer Sepp Hochreiter OffRL SSL 24 2 0 01 Oct 2024
Learning Goal-Conditioned Representations for Language Reward Models Vaskar Nath Dylan Slack Jeff Da Yuntao Ma Hugh Zhang Spencer Whitehead Sean Hendryx 24 0 0 18 Jul 2024
CORN: Contact-based Object Representation for Nonprehensile Manipulation of General Unseen Objects Yoonyoung Cho Junhyek Han Yoontae Cho Beomjoon Kim 27 8 0 16 Mar 2024
PASTA: Pretrained Action-State Transformer Agents Raphael Boige Yannis Flet-Berliac Arthur Flajolet Guillaume Richard Thomas Pierrot LM&Ro OffRL 22 5 0 20 Jul 2023
Transformers in Reinforcement Learning: A Survey Pranav Agarwal A. Rahman P. St-Charles Simon J. D. Prince Samira Ebrahimi Kahou OffRL 19 18 0 12 Jul 2023
RePreM: Representation Pre-training with Masked Model for Reinforcement Learning Yuanying Cai Chuheng Zhang Wei Shen Xuyun Zhang Wenjie Ruan Longbo Huang OffRL 32 4 0 03 Mar 2023
SMART: Self-supervised Multi-task pretrAining with contRol Transformers Yanchao Sun Shuang Ma Ratnesh Madaan Rogerio Bonatti Furong Huang Ashish Kapoor 17 39 0 24 Jan 2023
A Survey on Transformers in Reinforcement Learning Wenzhe Li Hao Luo Zichuan Lin Chongjie Zhang Zongqing Lu Deheng Ye OffRL MU AI4CE 29 55 0 08 Jan 2023
Transformer in Transformer as Backbone for Deep Reinforcement Learning Hangyu Mao Rui Zhao Hao Chen Jianye Hao Yiqun Chen Dong Li Junge Zhang Zhen Xiao OffRL 31 8 0 30 Dec 2022
On Transforming Reinforcement Learning by Transformer: The Development Trajectory Shengchao Hu Li Shen Ya-Qin Zhang Yixin Chen Dacheng Tao OffRL 23 24 0 29 Dec 2022
Using Forwards-Backwards Models to Approximate MDP Homomorphisms Augustine N. Mavor-Parker Matthew J. Sargent Christian Pehle Andrea Banino Lewis D. Griffin Caswell Barry 13 2 0 14 Sep 2022
Light-weight probing of unsupervised representations for Reinforcement Learning Wancong Zhang Anthony GX-Chen Vlad Sobal Yann LeCun Nicolas Carion SSL OffRL 33 13 0 25 Aug 2022
Retrieval-Augmented Reinforcement Learning Anirudh Goyal A. Friesen Andrea Banino T. Weber Nan Rosemary Ke ... Michal Valko Simon Osindero Timothy Lillicrap N. Heess Charles Blundell OffRL 17 53 0 17 Feb 2022
Abstraction for Deep Reinforcement Learning Murray Shanahan Melanie Mitchell OffRL 22 28 0 10 Feb 2022
Procedural Generalization by Planning with Self-Supervised World Models Ankesh Anand Jacob Walker Yazhe Li Eszter Vértes Julian Schrittwieser Sherjil Ozair T. Weber Jessica B. Hamrick 21 30 0 02 Nov 2021
Towards mental time travel: a hierarchical memory for reinforcement learning agents Andrew Kyle Lampinen Stephanie C. Y. Chan Andrea Banino Felix Hill 11 47 0 28 May 2021
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 188 181 0 03 Sep 2019