v1v2v3 (latest)

Towards Theoretical Understandings of Robust Markov Decision Processes: Sample Complexity and Asymptotics

9 May 2021

Wenhao Yang

Liangyu Zhang

Zhihua Zhang

ArXiv (abs)PDF HTML

Papers citing "Towards Theoretical Understandings of Robust Markov Decision Processes: Sample Complexity and Asymptotics"

24 / 24 papers shown

Title
Pessimism Principle Can Be Effective: Towards a Framework for Zero-Shot Transfer Reinforcement Learning Chi Zhang Ziying Jia George Atia Sihong He Yue Wang 214 1 0 24 May 2025
Distributionally Robust Constrained Reinforcement Learning under Strong Duality Zhengfei Zhang Kishan Panaganti Laixi Shi Yanan Sui Adam Wierman Yisong Yue OOD 143 8 0 22 Jun 2024
Statistical Learning of Distributionally Robust Stochastic Control in Continuous State Spaces Shengbo Wang Nian Si Jose H. Blanchet Zhengyuan Zhou 106 2 0 17 Jun 2024
Bootstrapping Expectiles in Reinforcement Learning Pierre Clavier Emmanuel Rachelson E. L. Pennec Matthieu Geist OffRL 163 0 0 06 Jun 2024
Constrained Reinforcement Learning Under Model MismatchInternational Conference on Machine Learning (ICML), 2024 Zhongchang Sun Sihong He Fei Miao Shaofeng Zou 178 9 0 02 May 2024
On the Foundation of Distributionally Robust Reinforcement Learning Shengbo Wang Nian Si Jose H. Blanchet Zhengyuan Zhou OffRL 144 23 0 15 Nov 2023
Distributionally Robust Model-based Reinforcement Learning with Large State SpacesInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 Shyam Sundhar Ramesh Pier Giuseppe Sessa Yifan Hu Andreas Krause Ilija Bogunovic OOD 148 18 0 05 Sep 2023
Provably Efficient Offline Reinforcement Learning with Perturbed Data SourcesInternational Conference on Machine Learning (ICML), 2023 Chengshuai Shi Wei Xiong Cong Shen Jing Yang OffRL 136 4 0 14 Jun 2023
Sample Complexity of Variance-reduced Distributionally Robust Q-learning Shengbo Wang Nian Si Jose H. Blanchet Zhengyuan Zhou OOD 120 21 0 28 May 2023
Model-Free Robust Average-Reward Reinforcement LearningInternational Conference on Machine Learning (ICML), 2023 Yue Wang Alvaro Velasquez George Atia Ashley Prater-Bennette Shaofeng Zou 114 20 0 17 May 2023
Double Pessimism is Provably Efficient for Distributionally Robust Offline Reinforcement Learning: Generic Algorithm and Robust Partial CoverageNeural Information Processing Systems (NeurIPS), 2023 Jose H. Blanchet Miao Lu Tong Zhang Han Zhong OffRL 156 44 0 16 May 2023
Improved Sample Complexity Bounds for Distributionally Robust Reinforcement LearningInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 Zaiyan Xu Kishan Panaganti D. Kalathil OOD OffRL 159 45 0 05 Mar 2023
A Finite Sample Complexity Bound for Distributionally Robust Q-learningInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 Shengbo Wang Nian Si Jose H. Blanchet Zhengyuan Zhou OOD OffRL 177 33 0 26 Feb 2023
Towards Minimax Optimality of Model-based Robust Reinforcement LearningConference on Uncertainty in Artificial Intelligence (UAI), 2023 Pierre Clavier E. L. Pennec Matthieu Geist 196 17 0 10 Feb 2023
Single-Trajectory Distributionally Robust Reinforcement LearningInternational Conference on Machine Learning (ICML), 2023 Zhipeng Liang Xiaoteng Ma Jose H. Blanchet Jiheng Zhang Zhengyuan Zhou OOD OffRL 118 14 0 27 Jan 2023
Robust Average-Reward Markov Decision ProcessesAAAI Conference on Artificial Intelligence (AAAI), 2023 Yue Wang Alvaro Velasquez George Atia Ashley Prater-Bennette Shaofeng Zou 164 17 0 02 Jan 2023
Online Policy Optimization for Robust MDP Jing Dong Jingwei Li Baoxiang Wang J.N. Zhang OffRL 135 18 0 28 Sep 2022
Distributionally Robust Offline Reinforcement Learning with Linear Function Approximation Xiaoteng Ma Zhipeng Liang Jose H. Blanchet MingWen Liu Li Xia Jiheng Zhang Qianchuan Zhao Zhengyuan Zhou OOD OffRL 209 31 0 14 Sep 2022
Distributionally Robust Model-Based Offline Reinforcement Learning with Near-Optimal Sample ComplexityJournal of machine learning research (JMLR), 2022 Laixi Shi Yuejie Chi OOD OffRL 222 80 0 11 Aug 2022
Robust Reinforcement Learning using Offline DataNeural Information Processing Systems (NeurIPS), 2022 Kishan Panaganti Zaiyan Xu D. Kalathil Mohammad Ghavamzadeh OffRL 152 96 0 10 Aug 2022
RORL: Robust Offline Reinforcement Learning via Conservative SmoothingNeural Information Processing Systems (NeurIPS), 2022 Rui Yang Chenjia Bai Xiaoteng Ma Zhaoran Wang Chongjie Zhang Lei Han OffRL 235 96 0 06 Jun 2022
A Statistical Analysis of Polyak-Ruppert Averaged Q-learningInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2021 Xiang Li Wenhao Yang Jiadong Liang Zhihua Zhang Michael I. Jordan 230 22 0 29 Dec 2021
Sample Complexity of Robust Reinforcement Learning with a Generative Model Kishan Panaganti D. Kalathil 259 90 0 02 Dec 2021
Distributionally Robust Batch Contextual BanditsManagement Sciences (MS), 2020 Nian Si Fan Zhang Zhengyuan Zhou Jose H. Blanchet OffRL 355 31 0 10 Jun 2020