ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2308.08055
137
4
v1v2 (latest)

Simple online learning with consistent oracle

Annual Conference Computational Learning Theory (COLT), 2023
15 August 2023
Chris Köcher
Tomasz Steifer
    CLL
ArXiv (abs)PDFHTML
Abstract

We consider online learning in the model where a learning algorithm can access the class only via the \emph{consistent oracle} -- an oracle, that, at any moment, can give a function from the class that agrees with all examples seen so far. This model was recently considered by Assos et al.~(COLT'23). It is motivated by the fact that standard methods of online learning rely on computing the Littlestone dimension of subclasses, a computationally intractable problem. Assos et al.~gave an online learning algorithm in this model that makes at most CdC^dCd mistakes on classes of Littlestone dimension ddd, for some absolute unspecified constant C>0C > 0C>0. We give a novel algorithm that makes at most O(256d)O(256^d)O(256d) mistakes. Our proof is significantly simpler and uses only very basic properties of the Littlestone dimension. We also show that there exists no algorithm in this model that makes less than 3d3^d3d mistakes.

View on arXiv
Comments on this paper