251
v1v2 (latest)

Approximation algorithms for the normalizing constant of Gibbs distributions

Abstract

Consider a family of distributions {πβ}\{\pi_{\beta}\} where XπβX\sim\pi_{\beta} means that P(X=x)=exp(βH(x))/Z(β)\mathbb{P}(X=x)=\exp(-\beta H(x))/Z(\beta). Here Z(β)Z(\beta) is the proper normalizing constant, equal to xexp(βH(x))\sum_x\exp(-\beta H(x)). Then {πβ}\{\pi_{\beta}\} is known as a Gibbs distribution, and Z(β)Z(\beta) is the partition function. This work presents a new method for approximating the partition function to a specified level of relative accuracy using only a number of samples, that is, O(ln(Z(β))ln(ln(Z(β))))O(\ln(Z(\beta))\ln(\ln(Z(\beta)))) when Z(0)1Z(0)\geq1. This is a sharp improvement over previous, similar approaches that used a much more complicated algorithm, requiring O(ln(Z(β))ln(ln(Z(β)))5)O(\ln(Z(\beta))\ln(\ln(Z(\beta)))^5) samples.

View on arXiv
Comments on this paper