Moderate-Dimensional Inferences on Quadratic Functionals in Ordinary Least Squares

Statistical inferences on quadratic functionals of linear regression parameter have found wide applications including signal detection, one/two-sample global testing, inference of fraction of variance explained and genetic co-heritability. Conventional theory based on ordinary least squares estimator works perfectly in the fixed-dimensional regime, but fails when the parameter dimension grows proportionally to the sample size . In some cases, its performance is not satisfactory even when . The main contribution of this paper is to illustrate that signal-to-noise ratio (SNR) plays a crucial role in the moderate-dimensional inferences where . In the case of weak SNR, as often occurred in the moderate-dimensional regime, both bias and variance need to be corrected in the traditional inference procedures. The amount of correction mainly depends on SNR and , and could be fairly large as . However, the classical fixed-dimensional results continue to hold if and only if SNR is large enough, say when diverges but slower than . Our general theory holds, in particular, without Gaussian design/error or structural parameter assumption, and apply to a broad class of quadratical functionals, covering all aforementioned applications. The mathematical arguments are based on random matrix theory and leave-one-out method. Extensive numerical results demonstrate the satisfactory performances of the proposed methodology even when in some extreme case.
View on arXiv