v1v2v3v4 (latest)

Estimating the Mixing Time of Ergodic Markov Chains

1 February 2019

Papers citing "Estimating the Mixing Time of Ergodic Markov Chains"

28 / 28 papers shown

Title
Near-Optimal Clustering in Mixture of Markov Chains Junghyun Lee Yassir Jedra Alexandre Proutière Se-Young Yun 75 0 0 02 Jun 2025
Non-asymptotic Estimates for Markov Transition Matrices with Rigorous Error Bounds De Huang Xiangyuan Li 96 1 0 12 Aug 2024
Conformal Predictions under Markovian Data Frédéric Zheng Alexandre Proutiere 83 1 0 21 Jul 2024
A Simple Finite-Time Analysis of TD Learning with Linear Function Approximation Aritra Mitra 88 5 0 04 Mar 2024
Estimating the Mixing Coefficients of Geometrically Ergodic Markov Processes Steffen Grunewalder A. Khaleghi 36 2 0 11 Feb 2024
Spectral Entry-wise Matrix Estimation for Low-Rank Reinforcement Learning Stefan Stojanovic Yassir Jedra Alexandre Proutière 70 5 0 10 Oct 2023
First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities Aleksandr Beznosikov S. Samsonov Marina Sheshukova Alexander Gasnikov A. Naumov Eric Moulines 100 15 0 25 May 2023
Streaming PCA for Markovian Data Syamantak Kumar Purnamrita Sarkar 103 7 0 03 May 2023
Generalization for slowly mixing processes Andreas Maurer 87 1 0 28 Apr 2023
Variable-Complexity Weighted-Tempered Gibbs Samplers for Bayesian Variable Selection Lan V. Truong 61 0 0 06 Apr 2023
Hardness in Markov Decision Processes: Theory and Practice Michelangelo Conserva Paulo E. Rauber 73 3 0 24 Oct 2022
Estimation of the Order of Non-Parametric Hidden Markov Models using the Singular Values of an Integral Operator Marie du Roy de Chaumaray Salima El Kolei Marie-Pierre Etienne M. Marbac 107 1 0 07 Oct 2022
Improved Estimation of Relaxation Time in Non-reversible Markov Chains Geoffrey Wolfer A. Kontorovich 140 8 0 01 Sep 2022
On Rademacher Complexity-based Generalization Bounds for Deep Learning Lan V. Truong MLT 137 13 0 08 Aug 2022
Finite-Time Analysis of Asynchronous Q-learning under Diminishing Step-Size from Control-Theoretic View Han-Dong Lim Dong-hwan Lee 58 1 0 25 Jul 2022
Generalization Bounds on Multi-Kernel Learning with Mixed Datasets Lan V. Truong 80 2 0 15 May 2022
Stochastic first-order methods for average-reward Markov decision processes Tianjiao Li Feiyang Wu Guanghui Lan 115 14 0 11 May 2022
Hold-out estimates of prediction models for Markov processes Rémy Garnier Raphael Langhendries Joseph Rynkiewicz 67 4 0 12 Apr 2022
Adapting to Mixing Time in Stochastic Optimization with Markovian Data Ron Dorfman Kfir Y. Levy 122 29 0 09 Feb 2022
Accelerated and instance-optimal policy evaluation with linear function approximation Tianjiao Li Guanghui Lan A. Pananjady OffRL 91 13 0 24 Dec 2021
Generalization Error Bounds on Deep Learning with Markov Datasets Lan V. Truong 93 8 0 23 Dec 2021
On the $α$ -lazy version of Markov chains in estimation and testing problems S. Fried Geoffrey Wolfer 42 2 0 20 May 2021
Simple and optimal methods for stochastic variational inequalities, II: Markovian noise and policy evaluation in reinforcement learning Georgios Kotsalis Guanghui Lan Tianjiao Li OffRL 92 32 0 15 Nov 2020
A Matrix Chernoff Bound for Markov Chains and Its Application to Co-occurrence Matrices J. Qiu Chi Wang Ben Liao Richard Peng Jie Tang 28 3 0 06 Aug 2020
Provably Efficient Third-Person Imitation from Offline Observation Aaron Zweig Joan Bruna OffRL 29 2 0 27 Feb 2020
Empirical and Instance-Dependent Estimation of Markov Chain and Mixing Time Geoffrey Wolfer 94 4 0 14 Dec 2019
Unknown mixing times in apprenticeship and reinforcement learning Tom Zahavy Alon Cohen Haim Kaplan Yishay Mansour OffRL 73 11 0 23 May 2019
Statistical Estimation of Ergodic Markov Chain Kernel over Discrete State Space Geoffrey Wolfer A. Kontorovich 146 30 0 13 Sep 2018