24
2

Theoretical guarantees in KL for Diffusion Flow Matching

Abstract

Flow Matching (FM) (also referred to as stochastic interpolants or rectified flows) stands out as a class of generative models that aims to bridge in finite time the target distribution ν\nu^\star with an auxiliary distribution μ\mu, leveraging a fixed coupling π\pi and a bridge which can either be deterministic or stochastic. These two ingredients define a path measure which can then be approximated by learning the drift of its Markovian projection. The main contribution of this paper is to provide relatively mild assumptions on ν\nu^\star, μ\mu and π\pi to obtain non-asymptotics guarantees for Diffusion Flow Matching (DFM) models using as bridge the conditional distribution associated with the Brownian motion. More precisely, we establish bounds on the Kullback-Leibler divergence between the target distribution and the one generated by such DFM models under moment conditions on the score of ν\nu^\star, μ\mu and π\pi, and a standard L2L^2-drift-approximation error assumption.

View on arXiv
Comments on this paper