A Composable Specification Language for Reinforcement Learning Tasks

21 August 2020

Papers citing "A Composable Specification Language for Reinforcement Learning Tasks"

50 / 53 papers shown

Title
HypRL: Reinforcement Learning of Control Policies for Hyperproperties Tzu-Han Hsu Arshia Rafieioskouei Borzoo Bonakdarpour 41 0 0 07 Apr 2025
Closing the Intent-to-Behavior Gap via Fulfillment Priority Logic B. Mabsout Abdelrahman AbdelGawad R. Mancuso 48 1 0 04 Mar 2025
Reinforcement Learning of Flexible Policies for Symbolic Instructions with Adjustable Mapping Specifications Wataru Hatanaka R. Yamashina Takamitsu Matsubara 110 0 0 31 Jan 2025
Environment Descriptions for Usability and Generalisation in Reinforcement Learning Dennis J. N. J. Soemers Spyridon Samothrakis Kurt Driessens M. Winands OffRL 90 1 0 22 Dec 2024
C3: Learning Congestion Controllers with Formal Certificates Chenxi Yang Divyanshu Saxena Rohit Dwivedula Kshiteej S. Mahajan Swarat Chaudhuri Aditya Akella 87 1 0 14 Dec 2024
Adaptive Reward Design for Reinforcement Learning Minjae Kwon Ingy Elsayed-Aly Lu Feng 75 2 0 14 Dec 2024
Compositional Automata Embeddings for Goal-Conditioned Reinforcement Learning Beyazit Yalcinkaya Niklas Lauffer Marcell Vazquez-Chanlatte S. Seshia AI4CE 59 5 0 31 Oct 2024
Progressive Safeguards for Safe and Model-Agnostic Reinforcement Learning Nabil Omi Hosein Hasanbeig Hiteshi Sharma Sriram K. Rajamani S. Sen 45 33 0 31 Oct 2024
Generalization of Compositional Tasks with Logical Specification via Implicit Planning Duo Xu Faramarz Fekri OffRL 33 1 0 13 Oct 2024
DeepLTL: Learning to Efficiently Satisfy Complex LTL Specifications for Multi-Task RL Mathias Jackermeier Alessandro Abate OffRL 51 1 0 06 Oct 2024
Inductive Generalization in Reinforcement Learning from Specifications Vignesh Subramanian Rohit Kushwah Subhajit Roy Suguman Bansal OffRL 46 0 0 05 Jun 2024
Reward Machines for Deep RL in Noisy and Uncertain Environments Andrew C. Li Zizhao Chen Toryn Q. Klassen Pashootan Vaezipoor Rodrigo Toro Icarte Sheila A. McIlraith 55 7 0 31 May 2024
Numeric Reward Machines Kristina Levina Nikolaos Pappas Athanasios Karapantelakis Aneta Vulgarakis Feljan Jendrik Seipp 51 1 0 30 Apr 2024
LTL-Constrained Policy Optimization with Cycle Experience Replay Ameesh Shah Cameron Voloshin Chenxi Yang Abhinav Verma Swarat Chaudhuri S. Seshia 31 1 0 17 Apr 2024
Multi-Agent Reinforcement Learning with a Hierarchy of Reward Machines Xuejing Zheng Chao Yu 29 5 0 08 Mar 2024
Reward Design for Justifiable Sequential Decision-Making A. Sukovic Goran Radanović 32 0 0 24 Feb 2024
Informativeness of Reward Functions in Reinforcement Learning R. Devidze Parameswaran Kamalaruban Adish Singla 34 2 0 10 Feb 2024
Logical Specifications-guided Dynamic Task Sampling for Reinforcement Learning Agents Yash Shukla Wenchang Gao Vasanth Sarathy Robert Wright Alvaro Velasquez Jivko Sinapov 26 0 0 06 Feb 2024
Compositional Policy Learning in Stochastic Control Systems with Formal Guarantees Dorde Zikelic Mathias Lechner Abhinav Verma K. Chatterjee T. Henzinger 40 10 0 03 Dec 2023
Reinforcement Learning of Action and Query Policies with LTL Instructions under Uncertain Event Detector Wataru Hatanaka R. Yamashina Takamitsu Matsubara 34 5 0 06 Sep 2023
What Kinds of Contracts Do ML APIs Need? S. K. Samantha Shibbir Ahmed S. Imtiaz Hridesh Rajan G. Leavens 18 3 0 26 Jul 2023
Safety-Aware Task Composition for Discrete and Continuous Reinforcement Learning Kevin J. Leahy Makai Mann Zachary Serlin CoGe OffRL 11 0 0 29 Jun 2023
Counterfactuals Modulo Temporal Logics Bernd Finkbeiner Julian Siber 20 6 0 15 Jun 2023
Policy Synthesis and Reinforcement Learning for Discounted LTL Rajeev Alur Osbert Bastani Kishor Jothimurugan Mateo Perez Fabio Somenzi Ashutosh Trivedi OffRL 25 11 0 26 May 2023
Sample Efficient Model-free Reinforcement Learning from LTL Specifications with Optimality Guarantees Daqian Shao Marta Kwiatkowska OffRL 29 7 0 02 May 2023
Reinforcement Learning with Knowledge Representation and Reasoning: A Brief Survey Chao Yu Xuejing Zheng H. Zhuo OffRL LRM 55 7 0 24 Apr 2023
Co-learning Planning and Control Policies Constrained by Differentiable Logic Specifications Zikang Xiong Daniel Lawson Joe Eappen A. H. Qureshi Suresh Jagannathan 13 0 0 02 Mar 2023
Reinforcement Causal Structure Learning on Order Graph Dezhi Yang Guoxian Yu Jun Wang Zhe Wu Maozu Guo BDL CML 37 16 0 22 Nov 2022
Noisy Symbolic Abstractions for Deep RL: A case study with Reward Machines Andrew C. Li Zizhao Chen Pashootan Vaezipoor Toryn Q. Klassen Rodrigo Toro Icarte Sheila A. McIlraith OffRL 18 9 0 20 Nov 2022
LCRL: Certified Policy Synthesis via Logically-Constrained Reinforcement Learning Mohammadhosein Hasanbeig Daniel Kroening Alessandro Abate 34 15 0 21 Sep 2022
RLang: A Declarative Language for Describing Partial World Knowledge to Reinforcement Learning Agents Rafael Rodríguez-Sánchez Benjamin A. Spiegel Jenny Wang Roma Patel Stefanie Tellex George Konidaris 26 2 0 12 Aug 2022
How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition Jorge Armando Mendez Mendez Eric Eaton KELM CLL 37 27 0 15 Jul 2022
Ablation Study of How Run Time Assurance Impacts the Training and Performance of Reinforcement Learning Agents Nathaniel P. Hamilton Kyle Dunlap Taylor T. Johnson Kerianne L. Hobbs OffRL 29 8 0 08 Jul 2022
DistSPECTRL: Distributing Specifications in Multi-Agent Reinforcement Learning Systems Joe Eappen Suresh Jagannathan 14 3 0 28 Jun 2022
Specification-Guided Learning of Nash Equilibria with High Social Welfare Kishor Jothimurugan Suguman Bansal Osbert Bastani Rajeev Alur 39 9 0 06 Jun 2022
Hierarchies of Reward Machines Daniel Furelos-Blanco Mark Law Anders Jonsson Krysia Broda A. Russo 27 8 0 31 May 2022
GALOIS: Boosting Deep Reinforcement Learning via Generalizable Logic Synthesis Yushi Cao Zhiming Li Tianpei Yang Hao Zhang Yan Zheng Yi Li Jianye Hao Yang Liu NAI 38 16 0 27 May 2022
Skill Machines: Temporal Logic Skill Composition in Reinforcement Learning Geraud Nangue Tasse Devon Jarvis Steven D. James Benjamin Rosman 44 4 0 25 May 2022
A Framework for Following Temporal Logic Instructions with Unknown Causal Dependencies Duo Xu Faramarz Fekri 27 2 0 07 Apr 2022
On the (In)Tractability of Reinforcement Learning for LTL Objectives Cambridge Yang Michael Littman Michael Carbin 16 18 0 24 Nov 2021
Lifelong Reinforcement Learning with Temporal Logic Formulas and Reward Machines Xuejing Zheng Chao Yu Chong Chen Jianye Hao H. Zhuo CLL OffRL 25 9 0 18 Nov 2021
Regular Decision Processes for Grid Worlds Nicky Lenaers M. V. Otterlo 30 1 0 05 Nov 2021
On the Expressivity of Markov Reward David Abel Will Dabney Anna Harutyunyan Mark K. Ho Michael L. Littman Doina Precup Satinder Singh 29 82 0 01 Nov 2021
In a Nutshell, the Human Asked for This: Latent Goals for Following Temporal Specifications Borja G. Leon Murray Shanahan Francesco Belardinelli AI4CE 28 15 0 18 Oct 2021
Reinforcement Learning Agent Training with Goals for Real World Tasks Xuan Zhao Marcos Campos 17 6 0 21 Jul 2021
Compositional Reinforcement Learning from Logical Specifications Kishor Jothimurugan Suguman Bansal Osbert Bastani Rajeev Alur CoGe 30 78 0 25 Jun 2021
The Logical Options Framework Brandon Araki Xiao Li Kiran Vodrahalli Jonathan A. DeCastro Micah J. Fry Daniela Rus OffRL 30 31 0 24 Feb 2021
Program Synthesis Guided Reinforcement Learning for Partially Observed Environments Yichen Yang J. Inala Osbert Bastani Yewen Pu Armando Solar-Lezama Martin Rinard 42 12 0 22 Feb 2021
LTL2Action: Generalizing LTL Instructions for Multi-Task RL Pashootan Vaezipoor Andrew C. Li Rodrigo Toro Icarte Sheila A. McIlraith OffRL AI4CE 47 74 0 13 Feb 2021
Multi-Agent Reinforcement Learning with Temporal Logic Specifications Lewis Hammond Alessandro Abate Julian Gutierrez Michael Wooldridge AI4CE 44 32 0 01 Feb 2021