When Fourth Moments Are Enough
This note concerns a somewhat innocent question motivated by an observation concerning the use of Chebyshev bounds on sample estimates of in the binomial distribution with parameters . Namely, what moment order produces the best Chebyshev estimate of ? If has a binomial distribution with parameters , there it is readily observed that and . Rabi Bhattacharya observed that while the second moment Chebyshev sample size for a confidence estimate within percentage points is , the fourth moment yields the substantially reduced polling requirement of . Why stop at fourth moment? Is the argmax achieved at for higher order moments and, if so, does it help, and compute ? As captured by the title of this note, answers to these questions lead to a simple rule of thumb for best choice of moments in terms of an effective sample size for Chebyshev concentration inequalities.
View on arXiv