74
166

Sparse recovery under matrix uncertainty

Abstract

We consider the model {eqnarray*}y=X\theta^*+\xi, Z=X+\Xi,{eqnarray*} where the random vector yRny\in\mathbb{R}^n and the random n×pn\times p matrix ZZ are observed, the n×pn\times p matrix XX is unknown, Ξ\Xi is an n×pn\times p random noise matrix, ξRn\xi\in\mathbb{R}^n is a noise independent of Ξ\Xi, and θ\theta^* is a vector of unknown parameters to be estimated. The matrix uncertainty is in the fact that XX is observed with additive error. For dimensions pp that can be much larger than the sample size nn, we consider the estimation of sparse vectors θ\theta^*. Under matrix uncertainty, the Lasso and Dantzig selector turn out to be extremely unstable in recovering the sparsity pattern (i.e., of the set of nonzero components of θ\theta^*), even if the noise level is very small. We suggest new estimators called matrix uncertainty selectors (or, shortly, the MU-selectors) which are close to θ\theta^* in different norms and in the prediction risk if the restricted eigenvalue assumption on XX is satisfied. We also show that under somewhat stronger assumptions, these estimators recover correctly the sparsity pattern.

View on arXiv
Comments on this paper