67
v1v2 (latest)

Optimal and Practical Batched Linear Bandit Algorithm

Main:8 Pages
2 Figures
Bibliography:2 Pages
2 Tables
Appendix:14 Pages
Abstract

We study the linear bandit problem under limited adaptivity, known as the batched linear bandit. While existing approaches can achieve near-optimal regret in theory, they are often computationally prohibitive or underperform in practice. We propose BLAE, a novel batched algorithm that integrates arm elimination with regularized G-optimal design, achieving the minimax optimal regret (up to logarithmic factors in TT) in both large-KK and small-KK regimes for the first time, while using only O(loglogT)O(\log\log T) batches. Our analysis introduces new techniques for batch-wise optimal design and refined concentration bounds. Crucially, BLAE demonstrates low computational overhead and strong empirical performance, outperforming state-of-the-art methods in extensive numerical evaluations. Thus, BLAE is the first algorithm to combine provable minimax-optimality in all regimes and practical superiority in batched linear bandits.

View on arXiv
Comments on this paper