57
17

Bayesian Posteriors for Small Multinomial Probabilities

Abstract

Each period, either a blue die or a red die is tossed. The two dice land on side kˉ\bar{k} with unknown probabilities pkˉp_{\bar{k}} and qkˉq_{\bar{k}}, which can be arbitrarily low. Given a data-generating process where pkˉcqkˉp_{\bar{k}}\ge c q_{\bar{k}}, we are interested in how much data is required to guarantee that with high probability the observer's Bayesian posterior mean for pkˉp_{\bar{k}} exceeds (1δ)c(1-\delta)c times that for qkˉq_{\bar{k}}. If the prior densities for the two dice are positive on the interior of the probability simplex and behave like power functions at the boundary, then for every ϵ>0,\epsilon>0, there exists NNN\in\mathbb{N} so that the observer obtains such an inference after nn periods with probability at least 1ϵ1-\epsilon whenever npkˉNnp_{\bar{k}}\ge N. The condition on nn and pkˉp_{\bar k} is the best possible. The result can fail if one of the prior densities converges to zero exponentially fast at the boundary.

View on arXiv
Comments on this paper