A Lyapunov-based Approach to Safe Reinforcement Learning

20 May 2018

Yinlam Chow

Ofir Nachum

Edgar A. Duénez-Guzmán

Mohammad Ghavamzadeh

ArXiv PDF HTML

Papers citing "A Lyapunov-based Approach to Safe Reinforcement Learning"

50 / 286 papers shown

Title
A universal policy wrapper with guarantees Anton Bolychev Georgiy Malaniya Grigory Yaremenko Anastasia Krasnaya Pavel Osinenko OffRL 19 0 0 18 May 2025
Certifying Stability of Reinforcement Learning Policies using Generalized Lyapunov Functions Kehan Long Jorge Cortés Nikolay Atanasov 17 0 0 16 May 2025
On the Connection Between Diffusion Models and Molecular Dynamics Liam Harcombe Timothy T. Duignan DiffM 59 0 0 04 Apr 2025
Learning Geometrically-Informed Lyapunov Functions with Deep Diffeomorphic RBF Networks Samuel Tesfazgi Leonhard Sprandl Sandra Hirche AAML 48 0 0 03 Apr 2025
Neural Lyapunov Function Approximation with Self-Supervised Reinforcement Learning Luc McCutcheon Bahman Gharesifard Saber Fallah 55 0 0 19 Mar 2025
Nash Equilibrium Constrained Auto-bidding With Bi-level Reinforcement Learning Zhiyu Mou Miao Xu Rongquan Bai Zhuoran Yang Chuan Yu Jian Xu Bo Zheng 46 0 0 13 Mar 2025
Safe Explicable Policy Search Akkamahadevi Hanni Jonathan Montaño Yu Zhang 53 0 0 10 Mar 2025
Ensemble RL through Classifier Models: Enhancing Risk-Return Trade-offs in Trading Strategies Zheli Xiong 49 0 0 23 Feb 2025
Polynomial-Time Approximability of Constrained Reinforcement Learning Jeremy McMahan 216 0 0 11 Feb 2025
Think Smarter not Harder: Adaptive Reasoning with Inference Aware Optimization Zishun Yu Tengyu Xu Di Jin Karthik Abinav Sankararaman Yun He ... Eryk Helenowski Chen Zhu Sinong Wang Hao Ma Han Fang LRM 56 5 0 29 Jan 2025
Marvel: Accelerating Safe Online Reinforcement Learning with Finetuned Offline Policy Keru Chen Honghao Wei Zhigang Deng Sen Lin OffRL OnRL 96 0 0 31 Dec 2024
Threshold UCT: Cost-Constrained Monte Carlo Tree Search with Pareto Curves Martin Kurečka Václav Nevyhoštěný Petr Novotný Vít Unčovský 85 0 0 18 Dec 2024
Neural Control and Certificate Repair via Runtime Monitoring Emily Yu Đorđe Žikelić T. Henzinger AAML 72 0 0 17 Dec 2024
Robustness and Generalization in Quantum Reinforcement Learning via Lipschitz Regularization Nico Meyer Julian Berberich Christopher Mutschler Daniel D. Scherer 34 0 0 28 Oct 2024
Adversarial Constrained Policy Optimization: Improving Constrained Reinforcement Learning by Adapting Budgets Jianmina Ma Jingtian Ji Yue Gao 30 0 0 28 Oct 2024
Knowledge Transfer from Simple to Complex: A Safe and Efficient Reinforcement Learning Framework for Autonomous Driving Decision-Making Rongliang Zhou Jiakun Huang Mingjun Li Hepeng Li Haotian Cao Xiaolin Song 29 0 0 18 Oct 2024
Probabilistic Satisfaction of Temporal Logic Constraints in Reinforcement Learning via Adaptive Policy-Switching Xiaoshan Lin Sadık Bera Yüksel Yasin Yazıcıoğlu Derya Aksaray 35 0 0 10 Oct 2024
Efficient Policy Evaluation with Safety Constraint for Reinforcement Learning Claire Chen Shuze Liu Shangtong Zhang OffRL 189 1 0 08 Oct 2024
Handling Long-Term Safety and Uncertainty in Safe Reinforcement Learning Jonas Günster Puze Liu Jan Peters Davide Tateo OffRL 36 2 0 18 Sep 2024
Critic as Lyapunov function (CALF): a model-free, stability-ensuring agent Pavel Osinenko Grigory Yaremenko Roman Zashchitin Anton Bolychev Sinan Ibrahim D. Dobriborsci 30 3 0 15 Sep 2024
Revisiting Safe Exploration in Safe Reinforcement learning David Eckel Baohe Zhang Joschka Bödecker 54 0 0 02 Sep 2024
Bridging the gap between Learning-to-plan, Motion Primitives and Safe Reinforcement Learning Piotr Kicki Davide Tateo Puze Liu Jonas Guenster Jan Peters Krzysztof Walas 34 2 0 26 Aug 2024
Meta SAC-Lag: Towards Deployable Safe Reinforcement Learning via MetaGradient-based Hyperparameter Tuning Homayoun Honari Amir M. Soufi Enayati Mehran Ghafarian Tamizi Homayoun Najjaran 55 1 0 15 Aug 2024
q-exponential family for policy optimization Lingwei Zhu Haseeb Shah Han Wang Yukie Nagai Martha White OffRL 78 0 0 14 Aug 2024
Exterior Penalty Policy Optimization with Penalty Metric Network under Constraints Shiqing Gao Jiaxin Ding Luoyi Fu Xinbing Wang Cheng Zhou 29 0 0 22 Jul 2024
Last-Iterate Global Convergence of Policy Gradients for Constrained Reinforcement Learning Alessandro Montenegro Marco Mussi Matteo Papini Alberto Maria Metelli BDL 42 2 0 15 Jul 2024
Safe and Reliable Training of Learning-Based Aerospace Controllers Udayan Mandal Guy Amir Haoze Wu Ieva Daukantas Fletcher Lee Newell ... Kerianne Hobbs Milan Ganai Tobey Shim Guy Katz Clark Barrett 45 2 0 09 Jul 2024
$$\mathrm{E^{2}CFD}$: Towards Effective and Efficient Cost Function Design for Safe Reinforcement Learning via Large Language Model$ $\mathrm{E^{2}CFD}$ : Towards Effective and Efficient Cost Function Design for Safe Reinforcement Learning via Large Language Model Zepeng Wang Chao Ma Linjiang Zhou Libing Wu Lei Yang Xiaochuan Shi Guojun Peng OffRL 48 0 0 08 Jul 2024
Diffusion Models for Offline Multi-agent Reinforcement Learning with Safety Constraints Jianuo Huang OffRL 29 0 0 30 Jun 2024
Constrained Meta Agnostic Reinforcement Learning Karam Daaboul Florian Kuhm Tim Joseph J. Marius Zoellner 37 0 0 20 Jun 2024
GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Model Zhehua Zhou Xuan Xie Jiayang Song Zhan Shu Lei Ma 49 1 0 06 Jun 2024
Enhancing Efficiency of Safe Reinforcement Learning via Sample Manipulation Shangding Gu Laixi Shi Yuhao Ding Alois Knoll C. Spanos Adam Wierman Ming Jin OffRL 45 2 0 31 May 2024
Efficient Exploration in Average-Reward Constrained Reinforcement Learning: Achieving Near-Optimal Regret With Posterior Sampling Danil Provodin M. Kaptein Mykola Pechenizkiy 52 0 0 29 May 2024
A CMDP-within-online framework for Meta-Safe Reinforcement Learning Vanshaj Khattar Yuhao Ding Bilgehan Sel Javad Lavaei Ming Jin OffRL 34 12 0 26 May 2024
Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning Shangding Gu Bilgehan Sel Yuhao Ding Lu Wang Qingwei Lin Alois Knoll Ming Jin 42 1 0 26 May 2024
Safe Deep Model-Based Reinforcement Learning with Lyapunov Functions Harry Zhang 40 0 0 25 May 2024
Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence Minheng Xiao Xian Yu Lei Ying 44 2 0 23 May 2024
Deterministic Policies for Constrained Reinforcement Learning in Polynomial-Time Jeremy McMahan 41 2 0 23 May 2024
Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificates Udayan Mandal Guy Amir Haoze Wu Ieva Daukantas Fletcher Lee Newell ... Michael Durling Milan Ganai Tobey Shim Guy Katz Clark W. Barrett 47 7 0 22 May 2024
Natural Policy Gradient and Actor Critic Methods for Constrained Multi-Task Reinforcement Learning Sihan Zeng Thinh T. Doan Justin Romberg 32 0 0 03 May 2024
Constrained Reinforcement Learning Under Model Mismatch Zhongchang Sun Sihong He Fei Miao Shaofeng Zou 48 4 0 02 May 2024
Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulation Shangding Gu Bilgehan Sel Yuhao Ding Lu Wang Qingwei Lin Ming Jin Alois Knoll 63 9 0 02 May 2024
Myopically Verifiable Probabilistic Certificates for Safe Control and Learning Zhuoyuan Wang Haoming Jing Christian Kurniawan Albert Chern Yorie Nakahira 41 1 0 23 Apr 2024
Simplex Decomposition for Portfolio Allocation Constraints in Reinforcement Learning David Winkel Niklas Strauß Matthias Schubert Thomas Seidl 34 1 0 16 Apr 2024
Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications Puze Liu Haitham Bou-Ammar Jan Peters Davide Tateo 49 8 0 13 Apr 2024
Safe and Robust Reinforcement Learning: Principles and Practice Taku Yamagata Raúl Santos-Rodríguez OffRL 45 2 0 27 Mar 2024
Constrained Reinforcement Learning with Smoothed Log Barrier Function Baohe Zhang Yuan Zhang Lilli Frison Thomas Brox Joschka Bödecker 48 8 0 21 Mar 2024
Decomposing Control Lyapunov Functions for Efficient Reinforcement Learning Antonio Lopez David Fridovich-Keil 38 1 0 18 Mar 2024
Constrained Optimal Fuel Consumption of HEV: A Constrained Reinforcement Learning Approach Shuchang Yan 19 1 0 12 Mar 2024
DeepSafeMPC: Deep Learning-Based Model Predictive Control for Safe Multi-Agent Reinforcement Learning Xuefeng Wang Henglin Pu Hyung Jun Kim Husheng Li 35 2 0 11 Mar 2024