ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2005.14425
42
1
v1v2 (latest)

Query complexity of heavy hitter estimation

29 May 2020
Sahasrajit Sarmasarkar
Kota Srinivas Reddy
Nikhil Karamchandani
ArXiv (abs)PDFHTML
Abstract

We consider the problem of identifying the subset SPγ\mathcal{S}^{\gamma}_{\mathcal{P}}SPγ​ of elements in the support of an underlying distribution P\mathcal{P}P whose probability value is larger than a given threshold γ\gammaγ, by actively querying an oracle to gain information about a sequence X1,X2,…X_1, X_2, \ldotsX1​,X2​,… of i.i.d.i.i.d.i.i.d. samples drawn from P\mathcal{P}P. We consider two query models: (a)(a)(a) each query is an index iii and the oracle return the value XiX_iXi​ and (b)(b)(b) each query is a pair (i,j)(i,j)(i,j) and the oracle gives a binary answer confirming if Xi=XjX_i = X_jXi​=Xj​ or not. For each of these query models, we design sequential estimation algorithms which at each round, either decide what query to send to the oracle depending on the entire history of responses or decide to stop and output an estimate of SPγ\mathcal{S}^{\gamma}_{\mathcal{P}}SPγ​, which is required to be correct with some pre-specified large probability. We provide upper bounds on the query complexity of the algorithms for any distribution P\mathcal{P}P and also derive lower bounds on the optimal query complexity under the two query models. We also consider noisy versions of the two query models and propose robust estimators which can effectively counter the noise in the oracle responses.

View on arXiv
Comments on this paper