119
269
v1v2v3v4 (latest)

Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Suffices

Abstract

We study the Unadjusted Langevin Algorithm (ULA) for sampling from a probability distribution ν=ef\nu = e^{-f} on Rn\mathbb{R}^n. We prove a convergence guarantee in Kullback-Leibler (KL) divergence assuming ν\nu satisfies a log-Sobolev inequality and the Hessian of ff is bounded. Notably, we do not assume convexity or bounds on higher derivatives. We also prove convergence guarantees in R\ényi divergence of order q>1q > 1 assuming the limit of ULA satisfies either the log-Sobolev or Poincar\é inequality. We also prove a bound on the bias of the limiting distribution of ULA assuming third-order smoothness of ff, without requiring isoperimetry.

View on arXiv
Comments on this paper