v1v2v3 (latest)

State Aggregation Learning from Markov Transition Data

6 November 2018

Papers citing "State Aggregation Learning from Markov Transition Data"

33 / 33 papers shown

Title
Estimating the number of clusters of a Block Markov Chain T. Vuren Thomas Cronk Jaron Sanders 101 0 0 25 Jul 2024
Diffusion Spectral Representation for Reinforcement Learning Dmitry Shribak Chen-Xiao Gao Yitong Li Chenjun Xiao Bo Dai DiffM 99 5 0 23 Jun 2024
Provable Representation with Efficient Planning for Partial Observable Reinforcement Learning Hongming Zhang Zhaolin Ren Chenjun Xiao Dale Schuurmans Bo Dai 92 4 0 20 Nov 2023
Context-lumpable stochastic bandits Chung-Wei Lee Qinghua Liu Yasin Abbasi-Yadkori Chi Jin Tor Lattimore Csaba Szepesvári OffRL 152 2 0 22 Jun 2023
Provably Feedback-Efficient Reinforcement Learning via Active Reward Learning Dingwen Kong Lin F. Yang 99 12 0 18 Apr 2023
Latent Variable Representation for Reinforcement Learning Zhaolin Ren Chenjun Xiao Tianjun Zhang Na Li Zhaoran Wang Sujay Sanghavi Dale Schuurmans Bo Dai OffRL 102 10 0 17 Dec 2022
The Normalized Cross Density Functional: A Framework to Quantify Statistical Dependence for Random Processes Bo Hu José C. Príncipe 32 3 0 09 Dec 2022
Detection and Evaluation of Clusters within Sequential Data Alexander Van Werde Albert Senen-Cerda Gianluca Kosmella J. Sanders 37 1 0 04 Oct 2022
Distributionally Robust Offline Reinforcement Learning with Linear Function Approximation Xiaoteng Ma Zhipeng Liang Jose H. Blanchet MingWen Liu Li Xia Jiheng Zhang Qianchuan Zhao Zhengyuan Zhou OOD OffRL 96 26 0 14 Sep 2022
Spectral Decomposition Representation for Reinforcement Learning Zhaolin Ren Tianjun Zhang Lisa Lee Joseph E. Gonzalez Dale Schuurmans Bo Dai OffRL 98 29 0 19 Aug 2022
Making Linear MDPs Practical via Contrastive Representation Learning Tianjun Zhang Zhaolin Ren Mengjiao Yang Joseph E. Gonzalez Dale Schuurmans Bo Dai 74 44 0 14 Jul 2022
Overcoming the Long Horizon Barrier for Sample-Efficient Reinforcement Learning with Latent Low-Rank Structure Tyler Sam Yudong Chen Chao Yu OffRL 123 7 0 07 Jun 2022
Singular value distribution of dense random matrices with block Markovian dependence J. Sanders Alexander Van Werde 108 4 0 28 Apr 2022
Approximate Policy Iteration with Bisimulation Metrics Mete Kemertas Allan D. Jepson 84 8 0 06 Feb 2022
Efficient Reinforcement Learning in Block MDPs: A Model-free Representation Learning Approach Xuezhou Zhang Yuda Song Masatoshi Uehara Mengdi Wang Alekh Agarwal Wen Sun OffRL 123 58 0 31 Jan 2022
A Free Lunch from the Noise: Provable and Practical Exploration for Representation Learning Zhaolin Ren Tianjun Zhang Csaba Szepesvári Bo Dai 106 20 0 22 Nov 2021
Learning Topic Models: Identifiability and Finite-Sample Analysis Yinyin Chen Shishuang He Yun Yang Feng Liang 73 6 0 08 Oct 2021
An Adaptive State Aggregation Algorithm for Markov Decision Processes Guanting Chen Johann D. Gaebler M. Peng Chunlin Sun Yinyu Ye 64 6 0 23 Jul 2021
On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control Amrit Singh Bedi Anjaly Parayil Junyu Zhang Mengdi Wang Alec Koppel 88 15 0 15 Jun 2021
Sample-Efficient Reinforcement Learning for Linearly-Parameterized MDPs with a Generative Model Bingyan Wang Yuling Yan Jianqing Fan 104 20 0 28 May 2021
Spectral Methods for Data Science: A Statistical Perspective Yuxin Chen Yuejie Chi Jianqing Fan Cong Ma 153 173 0 15 Dec 2020
Is Plug-in Solver Sample-Efficient for Feature-based Reinforcement Learning? Qiwen Cui Lin F. Yang OffRL 70 14 0 12 Oct 2020
Randomized Value Functions via Posterior State-Abstraction Sampling Dilip Arumugam Benjamin Van Roy OffRL 85 7 0 05 Oct 2020
Approximation Benefits of Policy Gradient Methods with Aggregated States Daniel Russo 123 7 0 22 Jul 2020
Sample Efficient Reinforcement Learning via Low-Rank Matrix Estimation Devavrat Shah Dogyoon Song Zhi Xu Yuzhe Yang 168 31 0 11 Jun 2020
Option Discovery in the Absence of Rewards with Manifold Analysis Amitay Bar Ronen Talmon Ron Meir 69 5 0 12 Mar 2020
Adaptive Temporal Difference Learning with Linear Function Approximation Tao Sun Han Shen Tianyi Chen Dongsheng Li 69 23 0 20 Feb 2020
Identifying Sparse Low-Dimensional Structures in Markov Chains: A Nonnegative Matrix Factorization Approach Mahsa Ghasemi Abolfazl Hashemi H. Vikalo Ufuk Topcu 182 5 0 27 Sep 2019
Learning low-dimensional state embeddings and metastable clusters from time series data Yifan Sun Yaqi Duan Hao Gong Mengdi Wang AI4TS 76 19 0 01 Jun 2019
RL4health: Crowdsourcing Reinforcement Learning for Knee Replacement Pathway Optimization Hao Lu Mengdi Wang OffRL 27 4 0 24 May 2019
Sample-Optimal Parametric Q-Learning Using Linearly Additive Features Lin F. Yang Mengdi Wang VLM 64 14 0 13 Feb 2019
Improvements on SCORE, Especially for Weak Signals Jiashun Jin Z. Ke Shengming Luo 47 23 0 14 Nov 2018
Spectral State Compression of Markov Processes Anru R. Zhang Mengdi Wang 92 49 0 08 Feb 2018