FLAMBE: Structural Complexity and Representation Learning of Low Rank MDPs

18 June 2020

Papers citing "FLAMBE: Structural Complexity and Representation Learning of Low Rank MDPs"

50 / 188 papers shown

Title
Oracle Inequalities for Model Selection in Offline Reinforcement Learning Jonathan Lee George Tucker Ofir Nachum Bo Dai Emma Brunskill OffRL 14 12 0 03 Nov 2022
Planning to the Information Horizon of BAMDPs via Epistemic State Abstraction Dilip Arumugam Satinder Singh 11 3 0 30 Oct 2022
Scalable Representation Learning in Linear Contextual Bandits with Constant Regret Guarantees Andrea Tirinzoni Matteo Papini Ahmed Touati A. Lazaric Matteo Pirotta 21 4 0 24 Oct 2022
Learning General World Models in a Handful of Reward-Free Deployments Yingchen Xu Jack Parker-Holder Aldo Pacchiano Philip J. Ball Oleh Rybkin Stephen J. Roberts Tim Rocktaschel Edward Grefenstette OffRL 53 8 0 23 Oct 2022
On the Power of Pre-training for Generalization in RL: Provable Benefits and Hardness Haotian Ye Xiaoyu Chen Liwei Wang S. Du OffRL 16 6 0 19 Oct 2022
Hybrid RL: Using Both Offline and Online Data Can Make RL Efficient Yuda Song Yi Zhou Ayush Sekhari J. Andrew Bagnell A. Krishnamurthy Wen Sun OffRL OnRL 30 90 0 13 Oct 2022
Exploration via Elliptical Episodic Bonuses Mikael Henaff Roberta Raileanu Minqi Jiang Tim Rocktaschel OffRL 27 39 0 11 Oct 2022
Near-Optimal Deployment Efficiency in Reward-Free Reinforcement Learning with Linear Function Approximation Dan Qiao Yu-Xiang Wang OffRL 61 13 0 03 Oct 2022
A General Framework for Sample-Efficient Function Approximation in Reinforcement Learning Zixiang Chen C. J. Li An Yuan Quanquan Gu Michael I. Jordan OffRL 108 26 0 30 Sep 2022
Linear Convergence for Natural Policy Gradient with Log-linear Policy Parametrization Carlo Alfano Patrick Rebeschini 49 13 0 30 Sep 2022
Enforcing Hard Constraints with Soft Barriers: Safe Reinforcement Learning in Unknown Stochastic Environments Yixuan Wang S. Zhan Ruochen Jiao Zhilu Wang Wanxin Jin Zhuoran Yang Zhaoran Wang Chao Huang Qi Zhu 19 48 0 29 Sep 2022
Partially Observable RL with B-Stability: Unified Structural Condition and Sharp Sample-Efficient Algorithms Fan Chen Yu Bai Song Mei 53 22 0 29 Sep 2022
Proximal Point Imitation Learning Luca Viano Angeliki Kamoutsi Gergely Neu Igor Krawczuk V. Cevher 28 14 0 22 Sep 2022
Relational Reasoning via Set Transformers: Provable Efficiency and Applications to MARL Fengzhuo Zhang Boyi Liu Kaixin Wang Vincent Y. F. Tan Zhuoran Yang Zhaoran Wang OffRL LRM 49 10 0 20 Sep 2022
Spectral Decomposition Representation for Reinforcement Learning Tongzheng Ren Tianjun Zhang Lisa Lee Joseph E. Gonzalez Dale Schuurmans Bo Dai OffRL 35 27 0 19 Aug 2022
Contrastive UCB: Provably Efficient Contrastive Self-Supervised Learning in Online Reinforcement Learning Shuang Qiu Lingxiao Wang Chenjia Bai Zhuoran Yang Zhaoran Wang SSL OffRL 18 32 0 29 Jul 2022
Making Linear MDPs Practical via Contrastive Representation Learning Tianjun Zhang Tongzheng Ren Mengjiao Yang Joseph E. Gonzalez Dale Schuurmans Bo Dai 20 44 0 14 Jul 2022
Learning Bellman Complete Representations for Offline Policy Evaluation Jonathan D. Chang Kaiwen Wang Nathan Kallus Wen Sun OffRL 27 14 0 12 Jul 2022
PAC Reinforcement Learning for Predictive State Representations Wenhao Zhan Masatoshi Uehara Wen Sun Jason D. Lee 31 38 0 12 Jul 2022
On the Principles of Parsimony and Self-Consistency for the Emergence of Intelligence Y. Ma Doris Y. Tsao H. Shum 59 75 0 11 Jul 2022
Safe Exploration Incurs Nearly No Additional Sample Complexity for Reward-free RL Ruiquan Huang J. Yang Yingbin Liang OffRL 53 9 0 28 Jun 2022
Provably Efficient Reinforcement Learning in Partially Observable Dynamical Systems Masatoshi Uehara Ayush Sekhari Jason D. Lee Nathan Kallus Wen Sun OffRL 49 31 0 24 Jun 2022
Provably Efficient Model-Free Constrained RL with Linear Function Approximation A. Ghosh Xingyu Zhou Ness B. Shroff 64 23 0 23 Jun 2022
On the Statistical Efficiency of Reward-Free Exploration in Non-Linear RL Jinglin Chen Aditya Modi A. Krishnamurthy Nan Jiang Alekh Agarwal 30 25 0 21 Jun 2022
Model-based RL with Optimistic Posterior Sampling: Structural Conditions and Sample Complexity Alekh Agarwal Tong Zhang 34 22 0 15 Jun 2022
Model-based Offline Imitation Learning with Non-expert Data Jeongwon Park Lin F. Yang OffRL 17 1 0 11 Jun 2022
Sample-Efficient Reinforcement Learning in the Presence of Exogenous Information Yonathan Efroni Dylan J. Foster Dipendra Kumar Misra A. Krishnamurthy John Langford OffRL 24 25 0 09 Jun 2022
Overcoming the Long Horizon Barrier for Sample-Efficient Reinforcement Learning with Latent Low-Rank Structure Tyler Sam Yudong Chen C. Yu OffRL 29 6 0 07 Jun 2022
Deciding What to Model: Value-Equivalent Sampling for Reinforcement Learning Dilip Arumugam Benjamin Van Roy OffRL 15 14 0 04 Jun 2022
Stabilizing Q-learning with Linear Architectures for Provably Efficient Learning Andrea Zanette Martin J. Wainwright OOD 28 5 0 01 Jun 2022
One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learning Pedro Cisneros-Velarde Boxiang Lyu Oluwasanmi Koyejo Mladen Kolar OffRL 18 3 0 31 May 2022
Provable Benefits of Representational Transfer in Reinforcement Learning Alekh Agarwal Yuda Song Wen Sun Kaiwen Wang Mengdi Wang Xuezhou Zhang OffRL 21 33 0 29 May 2022
Provably Sample-Efficient RL with Side Information about Latent Dynamics Yao Liu Dipendra Kumar Misra Miroslav Dudík Robert Schapire 24 2 0 27 May 2022
Embed to Control Partially Observed Systems: Representation Learning with Provable Sample Efficiency Lingxiao Wang Qi Cai Zhuoran Yang Zhaoran Wang 43 17 0 26 May 2022
When Is Partially Observable Reinforcement Learning Not Scary? Qinghua Liu Alan Chung Csaba Szepesvári Chi Jin 9 92 0 19 Apr 2022
Non-Linear Reinforcement Learning in Large Action Spaces: Structural Conditions and Sample-efficiency of Posterior Sampling Alekh Agarwal Tong Zhang 19 8 0 15 Mar 2022
Provably Efficient Causal Model-Based Reinforcement Learning for Systematic Generalization Mirco Mutti Ric De Santi Emanuele Rossi J. Calderón Michael M. Bronstein Marcello Restelli 20 14 0 14 Feb 2022
Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality Jiawei Huang Jinglin Chen Li Zhao Tao Qin Nan Jiang Tie-Yan Liu OffRL 22 23 0 14 Feb 2022
Computational-Statistical Gaps in Reinforcement Learning D. Kane Sihan Liu Shachar Lovett G. Mahajan 6 5 0 11 Feb 2022
Offline Reinforcement Learning with Realizability and Single-policy Concentrability Wenhao Zhan Baihe Huang Audrey Huang Nan Jiang Jason D. Lee OffRL 26 104 0 09 Feb 2022
Provable Reinforcement Learning with a Short-Term Memory Yonathan Efroni Chi Jin A. Krishnamurthy Sobhan Miryoosefi OffRL 8 37 0 08 Feb 2022
Efficient Reinforcement Learning in Block MDPs: A Model-free Representation Learning Approach Xuezhou Zhang Yuda Song Masatoshi Uehara Mengdi Wang Alekh Agarwal Wen Sun OffRL 21 57 0 31 Jan 2022
Robust Imitation Learning from Corrupted Demonstrations Liu Liu Ziyang Tang Lanqing Li Dijun Luo 10 12 0 29 Jan 2022
Reward-Free RL is No Harder Than Reward-Aware RL in Linear Markov Decision Processes Andrew Wagenmaker Yifang Chen Max Simchowitz S. Du Kevin G. Jamieson 11 48 0 26 Jan 2022
Tensor and Matrix Low-Rank Value-Function Approximation in Reinforcement Learning Sergio Rozada Santiago Paternain A. Marques 50 13 0 21 Jan 2022
Model Selection in Batch Policy Optimization Jonathan Lee George Tucker Ofir Nachum Bo Dai OffRL 13 12 0 23 Dec 2021
A Free Lunch from the Noise: Provable and Practical Exploration for Representation Learning Tongzheng Ren Tianjun Zhang Csaba Szepesvári Bo Dai 22 19 0 22 Nov 2021
Reinforcement Learning in Linear MDPs: Constant Regret and Representation Selection Matteo Papini Andrea Tirinzoni Aldo Pacchiano Marcello Restelli A. Lazaric Matteo Pirotta 8 18 0 27 Oct 2021
Provable RL with Exogenous Distractors via Multistep Inverse Dynamics Yonathan Efroni Dipendra Kumar Misra A. Krishnamurthy Alekh Agarwal John Langford OffRL 16 22 0 17 Oct 2021
Sparsity in Partially Controllable Linear Systems Yonathan Efroni Sham Kakade A. Krishnamurthy Cyril Zhang 20 13 0 12 Oct 2021