261

Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integration

The Annals of Applied Probability (Ann. Appl. Probab.), 2022
Abstract

A novel unadjusted Hamiltonian Monte Carlo (uHMC) algorithm is suggested that uses a stratified Monte Carlo (SMC) time integrator for the underlying Hamiltonian dynamics in place of the usual Verlet time integrator. For target distributions of the form μ(dx)eU(x)dx\mu(dx) \propto e^{-U(x)} dx where U:RdR0U: \mathbb{R}^d \to \mathbb{R}_{\ge 0} is both KK-strongly convex and LL-gradient Lipschitz, and initial distributions ν\nu with finite second moment, coupling proofs reveal that an ε\varepsilon-accurate approximation of the target distribution μ\mu in L2L^2-Wasserstein distance W2\boldsymbol{\mathcal{W}}^2 can be achieved by the uHMC algorithm with SMC time integration using O((d/K)1/3(L/K)5/3ε2/3log(W2(μ,ν)/ε)+)O\left((d/K)^{1/3} (L/K)^{5/3} \varepsilon^{-2/3} \log( \boldsymbol{\mathcal{W}}^2(\mu, \nu) / \varepsilon)^+\right) gradient evaluations; whereas without any additional assumptions the corresponding complexity of the uHMC algorithm with Verlet time integration is in general O((d/K)1/2(L/K)2ε1log(W2(μ,ν)/ε)+)O\left((d/K)^{1/2} (L/K)^2 \varepsilon^{-1} \log( \boldsymbol{\mathcal{W}}^2(\mu, \nu) / \varepsilon)^+ \right). The SMC time integrator involves a minor modification to Verlet, and hence, is easy to implement.

View on arXiv
Comments on this paper