ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2305.19691
26
1

Constant or logarithmic regret in asynchronous multiplayer bandits

31 May 2023
Hugo Richard
Etienne Boursier
Vianney Perchet
ArXivPDFHTML
Abstract

Multiplayer bandits have recently been extensively studied because of their application to cognitive radio networks. While the literature mostly considers synchronous players, radio networks (e.g. for IoT) tend to have asynchronous devices. This motivates the harder, asynchronous multiplayer bandits problem, which was first tackled with an explore-then-commit (ETC) algorithm (see Dakdouk, 2022), with a regret upper-bound in O(T23)\mathcal{O}(T^{\frac{2}{3}})O(T32​). Before even considering decentralization, understanding the centralized case was still a challenge as it was unknown whether getting a regret smaller than Ω(T23)\Omega(T^{\frac{2}{3}})Ω(T32​) was possible. We answer positively this question, as a natural extension of UCB exhibits a O(Tlog⁡(T))\mathcal{O}(\sqrt{T\log(T)})O(Tlog(T)​) minimax regret. More importantly, we introduce Cautious Greedy, a centralized algorithm that yields constant instance-dependent regret if the optimal policy assigns at least one player on each arm (a situation that is proved to occur when arm means are close enough). Otherwise, its regret increases as the sum of log⁡(T)\log(T)log(T) over some sub-optimality gaps. We provide lower bounds showing that Cautious Greedy is optimal in the data-dependent terms. Therefore, we set up a strong baseline for asynchronous multiplayer bandits and suggest that learning the optimal policy in this problem might be easier than thought, at least with centralization.

View on arXiv
Comments on this paper