Off-Policy Evaluation in Partially Observed Markov Decision Processes under Sequential Ignorability

24 October 2021

Papers citing "Off-Policy Evaluation in Partially Observed Markov Decision Processes under Sequential Ignorability"

19 / 19 papers shown

Title
Statistical Tractability of Off-policy Evaluation of History-dependent Policies in POMDPs Yuheng Zhang Nan Jiang OffRL 61 0 0 03 Mar 2025
Statistical Inference in Reinforcement Learning: A Selective Survey Chengchun Shi OffRL 60 0 0 22 Feb 2025
A Graphical Approach to State Variable Selection in Off-policy Learning Joakim Blach Andersen Qingyuan Zhao CML OffRL 26 0 0 03 Jan 2025
Combining Experimental and Historical Data for Policy Evaluation Ting Li Chengchun Shi Qianglin Wen Yang Sui Yongli Qin Chunbo Lai Hongtu Zhu OffRL 44 0 0 01 Jun 2024
On the Curses of Future and History in Future-dependent Value Functions for Off-policy Evaluation Yuheng Zhang Nan Jiang OffRL 22 4 0 22 Feb 2024
Off-Policy Evaluation in Markov Decision Processes under Weak Distributional Overlap Mohammad Mehrabi Stefan Wager OffRL 16 14 0 13 Feb 2024
Randomization Inference When N Equals One Tengyuan Liang Benjamin Recht CML 14 5 0 25 Oct 2023
A Survey on Causal Reinforcement Learning Yan Zeng Ruichu Cai Fuchun Sun Libo Huang Z. Hao CML 26 25 0 10 Feb 2023
An Instrumental Variable Approach to Confounded Off-Policy Evaluation Yang Xu Jin Zhu C. Shi S. Luo R. Song OffRL 16 12 0 29 Dec 2022
A Review of Off-Policy Evaluation in Reinforcement Learning Masatoshi Uehara C. Shi Nathan Kallus OffRL 17 47 0 13 Dec 2022
Strategic Decision-Making in the Presence of Information Asymmetry: Provably Efficient RL with Algorithmic Instruments Mengxin Yu Zhuoran Yang Jianqing Fan OffRL 13 8 0 23 Aug 2022
Future-Dependent Value-Based Off-Policy Evaluation in POMDPs Masatoshi Uehara Haruka Kiyohara Andrew Bennett Victor Chernozhukov Nan Jiang Nathan Kallus C. Shi Wen Sun OffRL 18 16 0 26 Jul 2022
Testing Stationarity and Change Point Detection in Reinforcement Learning Mengbing Li C. Shi Zhanghua Wu Piotr Fryzlewicz OffRL 32 9 0 03 Mar 2022
Policy Evaluation for Temporal and/or Spatial Dependent Experiments S. Luo Ying Yang Chengchun Shi Fang Yao Jieping Ye Hongtu Zhu 41 5 0 22 Feb 2022
Ambiguous Dynamic Treatment Regimes: A Reinforcement Learning Approach S. Saghafian CML 11 14 0 08 Dec 2021
A Minimax Learning Approach to Off-Policy Evaluation in Confounded Partially Observable Markov Decision Processes C. Shi Masatoshi Uehara Jiawei Huang Nan Jiang OffRL 9 22 0 12 Nov 2021
Proximal Reinforcement Learning: Efficient Off-Policy Evaluation in Partially Observed Markov Decision Processes Andrew Bennett Nathan Kallus OffRL 19 40 0 28 Oct 2021
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems Sergey Levine Aviral Kumar George Tucker Justin Fu OffRL GP 329 1,944 0 04 May 2020
Double Reinforcement Learning for Efficient Off-Policy Evaluation in Markov Decision Processes Nathan Kallus Masatoshi Uehara OffRL 31 180 0 22 Aug 2019