Rethinking Mean Square Error: Why Information is a Superior Assessment
of Estimators
- FAtt
Main:15 Pages
2 Figures
Bibliography:2 Pages
5 Tables
Abstract
James-Stein (JS) estimators have been described as showing the inadequacy of maximum likelihood estimation when assessed using mean square error (MSE). We claim the problem is not with maximum likelihood (ML) but with MSE. When MSE is replaced with a measure of the information utilized by a statistic, likelihood based methods are superior. The information measure describes not just point estimators but extends to Fisher's view of estimation so that we not only reconsider how estimators are assessed but also how we define an estimator. Fisher information and his views on the role of parameters, interpretation of probability, and logic of statistical inference fit well with as measure of information.
View on arXivComments on this paper
