ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2506.07856
13
0

Stability of Mean-Field Variational Inference

9 June 2025
Shunan Sheng
Bohan Wu
Alberto González-Sanz
Marcel Nutz
ArXiv (abs)PDFHTML
Main:19 Pages
Appendix:24 Pages
Abstract

Mean-field variational inference (MFVI) is a widely used method for approximating high-dimensional probability distributions by product measures. This paper studies the stability properties of the mean-field approximation when the target distribution varies within the class of strongly log-concave measures. We establish dimension-free Lipschitz continuity of the MFVI optimizer with respect to the target distribution, measured in the 2-Wasserstein distance, with Lipschitz constant inversely proportional to the log-concavity parameter. Under additional regularity conditions, we further show that the MFVI optimizer depends differentiably on the target potential and characterize the derivative by a partial differential equation. Methodologically, we follow a novel approach to MFVI via linearized optimal transport: the non-convex MFVI problem is lifted to a convex optimization over transport maps with a fixed base measure, enabling the use of calculus of variations and functional analysis. We discuss several applications of our results to robust Bayesian inference and empirical Bayes, including a quantitative Bernstein--von Mises theorem for MFVI, as well as to distributed stochastic control.

View on arXiv
@article{sheng2025_2506.07856,
  title={ Stability of Mean-Field Variational Inference },
  author={ Shunan Sheng and Bohan Wu and Alberto González-Sanz and Marcel Nutz },
  journal={arXiv preprint arXiv:2506.07856},
  year={ 2025 }
}
Comments on this paper