Optimality of Maximum Likelihood for Log-Concave Density Estimation and Bounded Convex Regression

In this paper, we study two fundamentals problems: estimation of a -dimensional log-concave distribution and bounded multivariate convex regression with random design. First, we show that for all the maximum likelihood estimators of both problems achieve an optimal risk (up to a logarithmic factor) of in terms of squared Hellinger distance and squared distance, respectively. Previously, the optimality of both these estimators was known only for . We also prove that the -entropy numbers of the two aforementioned families are equal up to logarithmic factors. We complement these results by proving a sharp bound on the minimax rate (up to logarithmic factors) with respect to the total variation distance. Finally, we prove that estimating a log-concave density---even a uniform distribution on a convex set---up to a fixed accuracy requires \emph{at least} a number of samples which is exponential in the dimension. We do that by improving the dimensional constant in the best known lower bound for the minimax rate from to .
View on arXiv