322
v1v2v3v4 (latest)

The Algorithmic Phase Transition in Correlated Spiked Models

Main:67 Pages
5 Figures
Bibliography:5 Pages
Abstract

We study the computational task of detecting and estimating correlated signals in a pair of spiked matrices X=λnxu+W,Y=μnyv+Z X=\tfrac{\lambda}{\sqrt{n}} xu^{\top}+W, \quad Y=\tfrac{\mu}{\sqrt{n}} yv^{\top}+Z where the spikes x,yx,y have correlation ρ\rho. Specifically, we consider two fundamental models: (1) Correlated spiked Wigner model with signal-to-noise ratio λ,μ\lambda,\mu; (2) Correlated spiked nNn*N Wishart (covariance) model with signal-to-noise ratio λ,μ\sqrt\lambda,\sqrt\mu.We propose an efficient detection and estimation algorithm based on counting a specific family of edge-decorated cycles. The algorithm's performance is governed by the function F(λ,μ,ρ,γ)=max{λ2γ,μ2γ,λ2ρ2γλ2+λ2ρ2+μ2ρ2γμ2+μ2ρ2}. F(\lambda,\mu,\rho,\gamma)=\max\Big\{ \frac{ \lambda^2 }{ \gamma }, \frac{ \mu^2 }{ \gamma }, \frac{ \lambda^2 \rho^2 }{ \gamma-\lambda^2+\lambda^2 \rho^2 } + \frac{ \mu^2 \rho^2 }{ \gamma-\mu^2+\mu^2 \rho^2 } \Big\} \,. We prove our algorithm succeeds for the correlated spiked Wigner model whenever F(λ,μ,ρ,1)>1F(\lambda,\mu,\rho,1)>1, and succeeds for the correlated spiked Wishart model whenever F(λ,μ,ρ,nN)>1F(\lambda,\mu,\rho,\tfrac{n}{N})>1. Our result shows that an algorithm can leverage the correlation between the spikes to detect and estimate the signals even in regimes where efficiently recovering either xx from X{X} alone or yy from Y{Y} alone is believed to be computationally infeasible.We complement our algorithmic results with evidence for a matching computational lower bound. In particular, we prove that when F(λ,μ,ρ,1)<1F(\lambda,\mu,\rho,1)<1 for the correlated spiked Wigner model and when F(λ,μ,ρ,nN)<1F(\lambda,\mu,\rho,\tfrac{n}{N})<1 for the spiked Wishart model, all algorithms based on low-degree polynomials fails to distinguish (X,Y)({X},{Y}) with two independent noise matrices. This strongly suggests that F=1F=1 is the precise computation threshold for our models.

View on arXiv
Comments on this paper