412

List-Decodable Subspace Recovery: Dimension Independent Error in Polynomial Time

Abstract

In list-decodable subspace recovery, the input is a collection of nn points αn\alpha n (for some α1/2\alpha \ll 1/2) of which are drawn i.i.d. from a distribution D\mathcal{D} with a isotropic rank rr covariance Π\Pi_* (the \emph{inliers}) and the rest are arbitrary, potential adversarial outliers. The goal is to recover a O(1/α)O(1/\alpha) size list of candidate covariances that contains a Π^\hat{\Pi} close to Π\Pi_*. Two recent independent works (Raghavendra-Yau, Bakshi-Kothari (2020)) gave algorithms for this problem that work whenever D\mathcal{D} satisfies certifiable anti-concentration. The running time of both these algorithms, however, is dΩ(1/α4)d^{\Omega(1/\alpha^4)} and the error bounds on ΠΠF\|\Pi-\Pi_*\|_F grow with rr (which can be Ω(d)\Omega(d)). In this work, we improve on these results on all three fronts: \emph{dimension-independent} error via a faster fixed-polynomial running time under less restrictive distributional assumptions. Specifically, we give a poly(1/α)dO(1)poly(1/\alpha) d^{O(1)} time algorithm that outputs a list containing a Π^\hat{\Pi} satisfying Π^ΠFO(1/α)\|\hat{\Pi} -\Pi_*\|_F \leq O(1/\alpha). Our result only needs D\mathcal{D} to have \emph{certifiably hypercontractive} degree 2 polynomials - a condition satisfied by a much broader family of distributions in contrast to certifiable anticoncentration. As a result, in addition to Gaussians, our algorithm applies to uniform distribution on the hypercube and qq-ary cubes and arbitrary product distributions with subgaussian marginals. Prior work (Raghavendra and Yau, 2020) had identified such distributions as potential hard examples as such distributions do not exhibit strong enough anti-concentration. When D\mathcal{D} satisfies certifiable anti-concentration, we obtain a stronger error guarantee of Π^ΠFη\|\hat{\Pi}-\Pi_*\|_F \leq \eta for any arbitrary η>0\eta > 0 in dO(poly(1/α)+log(1/η))d^{O(poly(1/\alpha) + \log (1/\eta))} time.

View on arXiv
Comments on this paper