Responsive Safety in Reinforcement Learning by PID Lagrangian Methods

8 July 2020

Pieter Abbeel

Papers citing "Responsive Safety in Reinforcement Learning by PID Lagrangian Methods"

50 / 187 papers shown

Title
Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence Minheng Xiao Xian Yu Lei Ying 34 2 0 23 May 2024
Feasibility Consistent Representation Learning for Safe Reinforcement Learning Zhepeng Cen Yi-Fan Yao Zuxin Liu Ding Zhao OffRL 37 3 0 20 May 2024
Safe Reinforcement Learning with Learned Non-Markovian Safety Constraints Siow Meng Low Akshat Kumar OffRL 30 0 0 05 May 2024
Constrained Reinforcement Learning Under Model Mismatch Zhongchang Sun Sihong He Fei Miao Shaofeng Zou 42 4 0 02 May 2024
A Dual Perspective of Reinforcement Learning for Imposing Policy Constraints Bram De Cooman Johan A. K. Suykens 28 0 0 25 Apr 2024
Beyond the Edge: An Advanced Exploration of Reinforcement Learning for Mobile Edge Computing, its Applications, and Future Research Trajectories Ning Yang Shuo Chen Haijun Zhang Randall Berry OffRL 29 6 0 22 Apr 2024
Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications Puze Liu Haitham Bou-Ammar Jan Peters Davide Tateo 38 7 0 13 Apr 2024
Intervention-Assisted Policy Gradient Methods for Online Stochastic Queuing Network Optimization: Technical Report Jerrod Wigmore B. Shrader E. Modiano OffRL 24 1 0 05 Apr 2024
Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving Xuemin Hu Pan Chen Yijun Wen Bo Tang Long Chen 24 3 0 27 Mar 2024
Constrained Optimal Fuel Consumption of HEV: A Constrained Reinforcement Learning Approach Shuchang Yan 11 1 0 12 Mar 2024
Offline Goal-Conditioned Reinforcement Learning for Safety-Critical Tasks with Recovery Policy Chenyang Cao Zichen Yan Renhao Lu Junbo Tan Xueqian Wang OffRL 34 2 0 04 Mar 2024
Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change Ruichen Xu Xiao Liu Jinming Xu Yuan Lin 23 1 0 01 Mar 2024
Conflict-Averse Gradient Aggregation for Constrained Multi-Objective Reinforcement Learning Dohyeong Kim Mineui Hong Jeongho Park Songhwai Oh 27 0 0 01 Mar 2024
Truly No-Regret Learning in Constrained MDPs Adrian Müller Pragnya Alatur V. Cevher Giorgia Ramponi Niao He 32 7 0 24 Feb 2024
Safety Optimized Reinforcement Learning via Multi-Objective Policy Optimization Homayoun Honari Mehran Ghafarian Tamizi H. Najjaran OffRL 22 1 0 23 Feb 2024
Revisiting Experience Replayable Conditions Taisuke Kobayashi 24 3 0 15 Feb 2024
A Survey of Constraint Formulations in Safe Reinforcement Learning Akifumi Wachi Xun Shen Yanan Sui 31 10 0 03 Feb 2024
Adaptive Primal-Dual Method for Safe Reinforcement Learning Weiqin Chen James Onyejizu Long Vu Lan Hoang D. Subramanian Koushik Kar Sandipan Mishra Santiago Paternain 11 1 0 01 Feb 2024
Off-Policy Primal-Dual Safe Reinforcement Learning Zifan Wu Bo Tang Qian Lin Chao Yu Shangqin Mao Qianlong Xie Xingxing Wang Dong Wang OffRL 21 3 0 26 Jan 2024
Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model Yinan Zheng Jianxiong Li Dongjie Yu Yujie Yang Shengbo Eben Li Xianyuan Zhan Jingjing Liu OffRL 36 24 0 19 Jan 2024
Long-term Safe Reinforcement Learning with Binary Feedback Akifumi Wachi Wataru Hashimoto Kazumune Hashimoto OffRL 25 3 0 08 Jan 2024
DDM-Lag : A Diffusion-based Decision-making Model for Autonomous Vehicles with Lagrangian Safety Enhancement Jiaqi Liu Peng Hang Xiaocong Zhao Jianqiang Wang Jian Sun 54 10 0 08 Jan 2024
HAIM-DRL: Enhanced Human-in-the-loop Reinforcement Learning for Safe and Efficient Autonomous Driving Zilin Huang Zihao Sheng Chengyuan Ma Sikai Chen 22 27 0 06 Jan 2024
Conservative Exploration for Policy Optimization via Off-Policy Policy Evaluation Paul Daoudi Mathias Formoso Othman Gaizi Achraf Azize Evrard Garcelon OffRL 21 0 0 24 Dec 2023
Gradient Shaping for Multi-Constraint Safe Reinforcement Learning Yi-Fan Yao Zuxin Liu Zhepeng Cen Peide Huang Tingnan Zhang Wenhao Yu Ding Zhao OffRL 71 6 0 23 Dec 2023
Constrained Meta-Reinforcement Learning for Adaptable Safety Guarantee with Differentiable Convex Programming Minjae Cho Chuangchuang Sun 27 3 0 15 Dec 2023
Modeling Risk in Reinforcement Learning: A Literature Mapping Leonardo Villalobos-Arias Derek Martin Abhijeet Krishnan Madeleine Gagné Colin M. Potts Arnav Jhala 13 0 0 08 Dec 2023
TRC: Trust Region Conditional Value at Risk for Safe Reinforcement Learning Dohyeong Kim Songhwai Oh 9 19 0 01 Dec 2023
A safe exploration approach to constrained Markov decision processes Tingting Ni Maryam Kamgarpour 25 3 0 01 Dec 2023
A Method to Improve the Performance of Reinforcement Learning Based on the Y Operator for a Class of Stochastic Differential Equation-Based Child-Mother Systems Cheng Yin Yi Chen 15 0 0 07 Nov 2023
State-Wise Safe Reinforcement Learning With Pixel Observations S. Zhan Yixuan Wang Qingyuan Wu Ruochen Jiao Chao Huang Qi Zhu 38 10 0 03 Nov 2023
Balancing Act: Constraining Disparate Impact in Sparse Models Meraj Hashemizadeh Juan Ramirez Rohan Sukumaran G. Farnadi Simon Lacoste-Julien Jose Gallego-Posada 33 5 0 31 Oct 2023
Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark Jiaming Ji Borong Zhang Jiayi Zhou Xuehai Pan Weidong Huang Ruiyang Sun Yiran Geng Yifan Zhong Juntao Dai Yaodong Yang OffRL 28 62 0 19 Oct 2023
Reduced Policy Optimization for Continuous Control with Hard Constraints Shutong Ding Jingya Wang Yali Du Ye-ling Shi 17 5 0 14 Oct 2023
Robust Safe Reinforcement Learning under Adversarial Disturbances Zeyang Li Chuxiong Hu Shengbo Eben Li Jia Cheng Yunan Wang AAML 29 3 0 11 Oct 2023
Confronting Reward Model Overoptimization with Constrained RLHF Ted Moskovitz Aaditya K. Singh DJ Strouse T. Sandholm Ruslan Salakhutdinov Anca D. Dragan Stephen Marcus McAleer 34 47 0 06 Oct 2023
Safe Exploration in Reinforcement Learning: A Generalized Formulation and Algorithms Akifumi Wachi Wataru Hashimoto Xun Shen Kazumune Hashimoto 14 9 0 05 Oct 2023
Distributionally Safe Reinforcement Learning under Model Uncertainty: A Single-Level Approach by Differentiable Convex Programming A. Chriat Chuangchuang Sun 19 1 0 03 Oct 2023
Learning Diverse Skills for Local Navigation under Multi-constraint Optimality Jin Cheng Marin Vlastelica Pavel Kolev Chenhao Li Georg Martius 35 6 0 03 Oct 2023
Learning Adaptive Safety for Multi-Agent Systems Luigi Berducci Shuo Yang Rahul Mangharam Radu Grosu 38 4 0 19 Sep 2023
Marketing Budget Allocation with Offline Constrained Deep Reinforcement Learning Tianchi Cai Jiyan Jiang Wenpeng Zhang Shiji Zhou Xierui Song Li Yu Lihong Gu Xiaodong Zeng Jinjie Gu Guannan Zhang OffRL 23 2 0 06 Sep 2023
Learning Shared Safety Constraints from Multi-task Demonstrations Konwoo Kim Gokul Swamy Zuxin Liu Ding Zhao Sanjiban Choudhury Zhiwei Steven Wu 28 15 0 01 Sep 2023
Offline Diversity Maximization Under Imitation Constraints Marin Vlastelica Jin Cheng Georg Martius Pavel Kolev OffRL 36 0 0 21 Jul 2023
SafeDreamer: Safe Reinforcement Learning with World Models Weidong Huang Jiaming Ji Borong Zhang Chunhe Xia Yao-Chun Yang OffRL 28 19 0 14 Jul 2023
Probabilistic Counterexample Guidance for Safer Reinforcement Learning (Extended Version) Xiaotong Ji Antonio Filieri OffRL 17 1 0 10 Jul 2023
Last-Iterate Convergent Policy Gradient Primal-Dual Methods for Constrained MDPs Dongsheng Ding Chen-Yu Wei K. Zhang Alejandro Ribeiro 38 19 0 20 Jun 2023
Datasets and Benchmarks for Offline Safe Reinforcement Learning Zuxin Liu Zijian Guo Haohong Lin Yi-Fan Yao Jiacheng Zhu ... Hanjiang Hu Wenhao Yu Tingnan Zhang Jie Tan Ding Zhao OffRL 22 36 0 15 Jun 2023
Cancellation-Free Regret Bounds for Lagrangian Approaches in Constrained Markov Decision Processes A. Müller Pragnya Alatur Giorgia Ramponi Niao He 23 5 0 12 Jun 2023
A Single-Loop Deep Actor-Critic Algorithm for Constrained Reinforcement Learning with Provable Convergence Kexuan Wang An Liu Baishuo Liu 18 1 0 10 Jun 2023
Value Functions are Control Barrier Functions: Verification of Safe Policies using Control Theory Daniel C.H. Tan Fernando Acero Robert McCarthy Dimitrios Kanoulas Zhibin Li OffRL 30 2 0 06 Jun 2023