294
v1v2v3v4 (latest)

Improved sampling algorithms and functional inequalities for non-log-concave distributions

Main:26 Pages
1 Figures
Bibliography:3 Pages
Appendix:13 Pages
Abstract

We study the problem of sampling from a distribution μ\mu with density eV\propto e^{-V} for some potential function V:RdRV:\mathbb R^d\to \mathbb R with query access to VV and V\nabla V. We start with the following standard assumptions:(1) VV is LL-smooth.(2) The second moment EXμ[X2]M\mathbf{E}_{X\sim \mu}[\|X\|^2]\leq M.Recently, He and Zhang (COLT'25) showed that the query complexity of this problem is at least (LMdϵ)Ω(d)\left(\frac{LM}{d\epsilon}\right)^{\Omega(d)} where ϵ\epsilon is the desired accuracy in total variation distance, and the Poincaré constant can be unbounded.Meanwhile, another common assumption in the study of diffusion based samplers (see e.g., the work of Chen, Chewi, Li, Li, Salim and Zhang (ICLR'23)) strengthens (1) to the following:(1*) The potential function of *every* distribution along the Ornstein-Uhlenbeck process starting from μ\mu is LL-smooth.We show that under the assumptions (1*) and (2), the query complexity of sampling from μ\mu can be poly(L,d)(Ld+Mϵ2)O(L+1)\mathrm{poly}(L,d)\cdot \left(\frac{Ld+M}{\epsilon^2}\right)^{\mathcal{O}(L+1)}, which is polynomial in dd and 1ϵ\frac{1}{\epsilon} when L=O(1)L=\mathcal{O}(1) and M=poly(d)M=\mathrm{poly}(d). This improves the algorithm with quasi-polynomial query complexity developed by Huang et al. (COLT'24). Our results imply that the seemingly moderate strengthening from (1) to (1*) yields an exponential gap in the query complexity.Furthermore, we show that together with the assumption (1*) and the stronger moment assumption that X\|X\| is λ\lambda-sub-Gaussian for XμX\sim\mu, the Poincaré constant of μ\mu is at most O(λ)2(L+1)\mathcal{O}(\lambda)^{2(L+1)}. We also establish a modified log-Sobolev inequality for μ\mu under these conditions. As an application of our technique, we obtain a new estimate of the modified log-Sobolev constant for a specific class of mixtures of strongly log-concave distributions.

View on arXiv
Comments on this paper