Stochastic continuum armed bandit problem of few linear parameters in high dimensions

Abstract
We consider a stochastic continuum armed bandit problem where the arms are indexed by the ball of radius in . The reward functions are considered to intrinsically depend on unknown linear parameters so that where is a full rank matrix. Assuming the mean reward function to be smooth we make use of results from low-rank matrix recovery literature and derive an efficient randomized algorithm which achieves a regret bound of with high probability. Here is at most polynomial in and and is the number of rounds or the sampling budget which is assumed to be known beforehand.
View on arXivComments on this paper