v1v2v3v4 (latest)

Towards Optimal Off-Policy Evaluation for Reinforcement Learning with Marginalized Importance Sampling

8 June 2019

Papers citing "Towards Optimal Off-Policy Evaluation for Reinforcement Learning with Marginalized Importance Sampling"

50 / 128 papers shown

Title
Nested-ReFT: Efficient Reinforcement Learning for Large Language Model Fine-Tuning via Off-Policy Rollouts M. Heuillet Yufei Cui Boxing Chen Audrey Durand Prasanna Parthasarathi OffRL ReLM LRM 38 0 1 13 Aug 2025
Demystifying the Paradox of Importance Sampling with an Estimated History-Dependent Behavior Policy in Off-Policy Evaluation Hongyi Zhou Josiah P. Hanna Jin Zhu Ying Yang Chengchun Shi OffRL 110 3 0 28 May 2025
STITCH-OPE: Trajectory Stitching with Guided Diffusion for Off-Policy Evaluation Hossein Goli Michael Gimelfarb Nathan Samuel de Lara Haruki Nishimura Masha Itkina Florian Shkurti OffRL 98 0 0 27 May 2025
DOLCE: Decomposing Off-Policy Evaluation/Learning into Lagged and Current Effects Shu Tamano Masanori Nojima OffRL 269 0 0 02 May 2025
Reinforcement Learning with Continuous Actions Under Unmeasured Confounding Yuhan Li Eugene Han Yifan Hu Wenzhuo Zhou Zhengling Qi Yifan Cui Ruoqing Zhu OffRL 549 0 0 01 May 2025
When Machine Learning Meets Importance Sampling: A More Efficient Rare Event Estimation Approach Ruoning Zhao Xinyun Chen 67 0 0 18 Apr 2025
Statistical Tractability of Off-policy Evaluation of History-dependent Policies in POMDPs Yuheng Zhang Nan Jiang OffRL 107 0 0 03 Mar 2025
Reweighting Improves Conditional Risk Bounds Yikai Zhang Jiahe Lin Fengpei Li Songzhu Zheng Anant Raj Anderson Schneider Yuriy Nevmyvaka 94 1 0 04 Jan 2025
Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Shuguang Yu Shuxing Fang Ruixin Peng Zhengling Qi Fan Zhou C. Shi CML OffRL 147 5 0 08 Dec 2024
Concept-driven Off Policy Evaluation Ritam Majumdar Jack Teversham Sonali Parbhoo OffRL 164 0 0 28 Nov 2024
Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering Xinyan Guan Yanjiang Liu Xinyu Lu Boxi Cao Xianpei Han ... Le Sun Jie Lou Bowen Yu Yaojie Lu Hongyu Lin ALM 283 6 0 18 Nov 2024
Scalable Offline Reinforcement Learning for Mean Field Games Axel Brunnbauer Julian Lemmel Z. Babaiee Sophie A. Neubauer Radu Grosu OffRL 91 0 0 23 Oct 2024
Primal-Dual Spectral Representation for Off-policy Evaluation Yang Hu Tianyi Chen Na Li Kai Wang Bo Dai OffRL 119 0 0 23 Oct 2024
The Role of Inherent Bellman Error in Offline Reinforcement Learning with Linear Function Approximation Noah Golowich Ankur Moitra OffRL 141 3 0 17 Jun 2024
A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models Jiayi Wang Zhengling Qi Raymond K. W. Wong 93 0 0 14 Jun 2024
RL in Latent MDPs is Tractable: Online Guarantees via Off-Policy Evaluation Jeongyeol Kwon Shie Mannor Constantine Caramanis Yonathan Efroni OffRL 160 3 0 03 Jun 2024
Kernel Metric Learning for In-Sample Off-Policy Evaluation of Deterministic RL Policies Haanvid Lee Tri Wahyu Guntara Jongmin Lee Yung-Kyun Noh Kee-Eung Kim OffRL 94 1 0 29 May 2024
Multiple-policy Evaluation via Density Estimation Yilei Chen Aldo Pacchiano I. Paschalidis OffRL 91 1 0 29 Mar 2024
On the Curses of Future and History in Future-dependent Value Functions for Off-policy Evaluation Yuheng Zhang Nan Jiang OffRL 97 4 0 22 Feb 2024
Offline Multi-task Transfer RL with Representational Penalization Avinandan Bose S. S. Du Maryam Fazel OffRL 141 12 0 19 Feb 2024
Off-Policy Evaluation in Markov Decision Processes under Weak Distributional Overlap Mohammad Mehrabi Stefan Wager OffRL 99 15 0 13 Feb 2024
POTEC: Off-Policy Learning for Large Action Spaces via Two-Stage Policy Decomposition Yuta Saito Jihan Yao Thorsten Joachims OffRL 129 9 0 09 Feb 2024
Probabilistic Offline Policy Ranking with Approximate Bayesian Computation Longchao Da Porter Jenkins Trevor Schwantes Jeffrey Dotson Hua Wei OffRL 77 3 0 17 Dec 2023
Marginal Density Ratio for Off-Policy Evaluation in Contextual Bandits Muhammad Faaiz Taufiq Arnaud Doucet Rob Cornish Jean-François Ton OffRL 118 9 0 03 Dec 2023
Robust Offline Reinforcement learning with Heavy-Tailed Rewards Jin Zhu Runzhe Wan Zhengling Qi Shuang Luo C. Shi OffRL 117 2 0 28 Oct 2023
Counterfactual-Augmented Importance Sampling for Semi-Offline Policy Evaluation Shengpu Tang Jenna Wiens OffRL CML 118 5 0 26 Oct 2023
Sample Complexity of Preference-Based Nonparametric Off-Policy Evaluation with Deep Networks Zihao Li Xiang Ji Minshuo Chen Mengdi Wang OffRL 138 0 0 16 Oct 2023
When is Agnostic Reinforcement Learning Statistically Tractable? Zeyu Jia Gene Li Alexander Rakhlin Ayush Sekhari Nathan Srebro OffRL 144 6 0 09 Oct 2023
Stackelberg Batch Policy Learning Wenzhuo Zhou Annie Qu OffRL 105 1 0 28 Sep 2023
Distributional Shift-Aware Off-Policy Interval Estimation: A Unified Error Quantification Framework Wenzhuo Zhou Yuhan Li Ruoqing Zhu Annie Qu OffRL 135 6 0 23 Sep 2023
A new Gradient TD Algorithm with only One Step-size: Convergence Rate Analysis using $L$ - $λ$ Smoothness Hengshuai Yao 140 2 0 29 Jul 2023
Offline Policy Evaluation for Reinforcement Learning with Adaptively Collected Data Sunil Madhow Dan Xiao Ming Yin Yu-Xiang Wang OffRL 113 0 0 24 Jun 2023
High-probability sample complexities for policy evaluation with linear function approximation Gen Li Weichen Wu Yuejie Chi Cong Ma Alessandro Rinaldo Yuting Wei OffRL 133 7 0 30 May 2023
Off-Policy Evaluation for Large Action Spaces via Conjunct Effect Modeling Yuta Saito Qingyang Ren Thorsten Joachims CML OffRL 122 28 0 14 May 2023
On the Sample Complexity of Vanilla Model-Based Offline Reinforcement Learning with Dependent Samples Mustafa O. Karabag Ufuk Topcu OffRL 107 5 0 07 Mar 2023
HOPE: Human-Centric Off-Policy Evaluation for E-Learning and Healthcare Ge Gao Song Ju Markel Sanz Ausin Min Chi OffRL 95 8 0 18 Feb 2023
Revisiting Bellman Errors for Offline Model Selection Joshua P. Zitovsky Daniel de Marchi Rishabh Agarwal Michael R. Kosorok University of North Carolina at Chapel Hill OffRL 104 5 0 31 Jan 2023
Efficient Policy Evaluation with Offline Data Informed Behavior Policy Design Shuze Liu Shangtong Zhang OffRL 188 5 0 31 Jan 2023
A Reinforcement Learning Framework for Dynamic Mediation Analysis Linjuan Ge Jitao Wang C. Shi Zhanghua Wu Rui Song 100 6 0 31 Jan 2023
Importance Weighted Actor-Critic for Optimal Conservative Offline Reinforcement Learning Hanlin Zhu Paria Rashidinejad Jiantao Jiao OffRL 156 18 0 30 Jan 2023
Model-based Offline Reinforcement Learning with Local Misspecification Kefan Dong Yannis Flet-Berliac Allen Nie Emma Brunskill OffRL 104 4 0 26 Jan 2023
Off-Policy Evaluation for Action-Dependent Non-Stationary Environments Yash Chandak Shiv Shankar Nathaniel D. Bastian Bruno Castro da Silva Emma Brunskil Philip S. Thomas OffRL 107 6 0 24 Jan 2023
Minimax Weight Learning for Absorbing MDPs Fengyin Li Yuqiang Li Xianyi Wu OffRL 60 1 0 09 Jan 2023
An Instrumental Variable Approach to Confounded Off-Policy Evaluation Yang Xu Jin Zhu C. Shi Shuang Luo R. Song OffRL 163 21 0 29 Dec 2022
Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequality Ying Jin Zhimei Ren Zhuoran Yang Zhaoran Wang OffRL 194 28 0 19 Dec 2022
Scaling Marginalized Importance Sampling to High-Dimensional State-Spaces via State Abstraction Brahma S. Pavse Josiah P. Hanna OffRL 100 8 0 14 Dec 2022
A Review of Off-Policy Evaluation in Reinforcement Learning Masatoshi Uehara C. Shi Nathan Kallus OffRL 138 83 0 13 Dec 2022
Low Variance Off-policy Evaluation with State-based Importance Sampling David M. Bossens Philip S. Thomas OffRL 140 3 0 07 Dec 2022
When is Realizability Sufficient for Off-Policy Reinforcement Learning? Andrea Zanette OffRL 107 16 0 10 Nov 2022
Oracle Inequalities for Model Selection in Offline Reinforcement Learning Jonathan Lee George Tucker Ofir Nachum Bo Dai Emma Brunskill OffRL 121 13 0 03 Nov 2022