Transformers are Meta-Reinforcement Learners

14 June 2022

Papers citing "Transformers are Meta-Reinforcement Learners"

39 / 39 papers shown

Title
Toward Task Generalization via Memory Augmentation in Meta-Reinforcement Learning Kaixi Bao Chenhao Li Yarden As Andreas Krause Marco Hutter OffRL CLL 111 1 0 03 Feb 2025
TIMRL: A Novel Meta-Reinforcement Learning Framework for Non-Stationary and Multi-Task Environments Chenyang Qi Huiping Li Panfeng Huang OffRL 41 0 0 13 Jan 2025
AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers Jake Grigsby Justin Sasek Samyak Parajuli Daniel Adebi Amy Zhang Yuke Zhu OffRL 26 2 0 17 Nov 2024
Enabling Adaptive Agent Training in Open-Ended Simulators by Targeting Diversity Robby Costales Stefanos Nikolaidis AI4CE 29 0 0 07 Nov 2024
MarineFormer: A Transformer-based Navigation Policy Model for Collision Avoidance in Marine Environment Ehsan Kazemi Iman Soltani 91 0 0 17 Oct 2024
ReLIC: A Recipe for 64k Steps of In-Context Reinforcement Learning for Embodied AI Ahmad Elawady Gunjan Chhablani Ram Ramrakhya Karmesh Yadav Dhruv Batra Z. Kira Andrew Szot OffRL 28 0 0 03 Oct 2024
Obstacle-Aware Quadrupedal Locomotion With Resilient Multi-Modal Reinforcement Learning I Made Aswin Nahrendra Byeongho Yu Minho Oh Dongkyu Lee Seunghyun Lee Hyeonwoo Lee Hyungtae Lim Hyun Myung 128 2 0 29 Sep 2024
XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning Alexander Nikulin Ilya Zisman Alexey Zemtsov Viacheslav Sinii 105 4 0 13 Jun 2024
X-Light: Cross-City Traffic Signal Control Using Transformer on Transformer as Meta Multi-Agent Reinforcement Learner Haoyuan Jiang Ziyue Li Hua Wei Xuantang Xiong Jingqing Ruan Jiaming Lu Hangyu Mao Rui Zhao 25 8 0 18 Apr 2024
Inferring Behavior-Specific Context Improves Zero-Shot Generalization in Reinforcement Learning Tidiane Camaret Ndir André Biedenkapp Noor H. Awad OffRL 38 1 0 15 Apr 2024
Enhancing IoT Intelligence: A Transformer-based Reinforcement Learning Methodology Gaith Rjoub Saidul Islam Jamal Bentahar M. Almaiah Rana Alrawashdeh OffRL 21 1 0 05 Apr 2024
Dreaming of Many Worlds: Learning Contextual World Models Aids Zero-Shot Generalization Sai Prasanna Karim Farid Raghu Rajan André Biedenkapp 50 2 0 16 Mar 2024
Hierarchical Transformers are Efficient Meta-Reinforcement Learners Gresa Shala André Biedenkapp Josif Grabocka OffRL 29 4 0 09 Feb 2024
Zero-Shot Reinforcement Learning via Function Encoders Tyler Ingebrand Amy Zhang Ufuk Topcu OffRL 35 2 0 30 Jan 2024
Generalization to New Sequential Decision Making Tasks with In-Context Learning Sharath Chandra Raparthy Eric Hambro Robert Kirk Mikael Henaff Roberta Raileanu OffRL 103 21 0 06 Dec 2023
Hypothesis Network Planned Exploration for Rapid Meta-Reinforcement Learning Adaptation Maxwell J. Jacobson Yexiang Xue 31 0 0 07 Nov 2023
AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents Jake Grigsby Linxi Fan Yuke Zhu OffRL LM&Ro 33 10 0 15 Oct 2023
Transformers in Reinforcement Learning: A Survey Pranav Agarwal A. Rahman P. St-Charles Simon J. D. Prince Samira Ebrahimi Kahou OffRL 24 18 0 12 Jul 2023
PID-Inspired Inductive Biases for Deep Reinforcement Learning in Partially Observable Control Tasks I. Char J. Schneider 26 4 0 12 Jul 2023
When Do Transformers Shine in RL? Decoupling Memory from Credit Assignment Tianwei Ni Michel Ma Benjamin Eysenbach Pierre-Luc Bacon OffRL 20 34 0 07 Jul 2023
RL $^3$ : Boosting Meta Reinforcement Learning via RL inside RL $^2$ Abhinav Bhatia Samer B. Nashed S. Zilberstein OffRL 17 0 0 28 Jun 2023
Large Sequence Models for Sequential Decision-Making: A Survey Muning Wen Runji Lin Hanjing Wang Yaodong Yang Ying Wen Luo Mai J. Wang Haifeng Zhang Weinan Zhang LM&Ro LRM 37 35 0 24 Jun 2023
Recurrent Action Transformer with Memory A. Staroverov A. Bessonov Dmitry A. Yudin A. Kovalev Aleksandr I. Panov OffRL 33 4 0 15 Jun 2023
Unraveling the ARC Puzzle: Mimicking Human Solutions with Object-Centric Decision Transformer Jaehyun Park Jaegyun Im Sanha Hwang Mintaek Lim Sabina Ualibekova Sejin Kim Sundong Kim AI4CE 17 12 0 14 Jun 2023
PACER: A Fully Push-forward-based Distributional Reinforcement Learning Algorithm Wensong Bai Chao Zhang Yichao Fu Lingwei Peng Hui Qian Bin Dai 19 1 0 11 Jun 2023
Emergent Agentic Transformer from Chain of Hindsight Experience Hao Liu Pieter Abbeel OffRL 30 25 0 26 May 2023
On First-Order Meta-Reinforcement Learning with Moreau Envelopes Taha Toghani Sebastian Perez-Salazar César A. Uribe 29 2 0 20 May 2023
A Survey of Meta-Reinforcement Learning Jacob Beck Risto Vuorio E. Liu Zheng Xiong L. Zintgraf Chelsea Finn Shimon Whiteson OOD OffRL 34 121 0 19 Jan 2023
Human-Timescale Adaptation in an Open-Ended Task Space Adaptive Agent Team Jakob Bauer Kate Baumli Satinder Baveja Feryal M. P. Behbahani ... Jakub Sygnowski K. Tuyls Sarah York Alexander Zacherl Lei Zhang LM&Ro OffRL AI4CE LRM 30 108 0 18 Jan 2023
A Survey on Transformers in Reinforcement Learning Wenzhe Li Hao Luo Zichuan Lin Chongjie Zhang Zongqing Lu Deheng Ye OffRL MU AI4CE 35 55 0 08 Jan 2023
Transformer in Transformer as Backbone for Deep Reinforcement Learning Hangyu Mao Rui Zhao Hao Chen Jianye Hao Yiqun Chen Dong Li Junge Zhang Zhen Xiao OffRL 31 8 0 30 Dec 2022
Sim-to-Real Transfer for Quadrupedal Locomotion via Terrain Transformer Hang Lai Weinan Zhang Xialin He Chen Yu Zheng Tian Yong Yu Jun Wang 14 20 0 15 Dec 2022
Memory in humans and deep language models: Linking hypotheses for model augmentation Omri Raccah Pheobe Chen Ted Willke David Poeppel Vy A. Vo RALM 13 1 0 04 Oct 2022
Meta-Reinforcement Learning with Self-Modifying Networks Mathieu Chalvidal Thomas Serre Rufin VanRullen KELM 12 5 0 04 Feb 2022
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 314 5,773 0 29 Apr 2021
Towards Continual Reinforcement Learning: A Review and Perspectives Khimya Khetarpal Matthew D Riemer Irina Rish Doina Precup CLL OffRL 36 307 0 25 Dec 2020
Probabilistic Model-Agnostic Meta-Learning Chelsea Finn Kelvin Xu Sergey Levine BDL 165 666 0 07 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 314 11,681 0 09 Mar 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,326 0 05 Nov 2016