ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2505.17804
56
0

Hyperparameter Optimization via Interacting with Probabilistic Circuits

23 May 2025
Jonas Seng
Fabrizio G. Ventola
Zhongjie Yu
Kristian Kersting
    TPM
ArXiv (abs)PDFHTML
Abstract

Despite the growing interest in designing truly interactive hyperparameter optimization (HPO) methods, to date, only a few allow to include human feedback. Existing interactive Bayesian optimization (BO) methods incorporate human beliefs by weighting the acquisition function with a user-defined prior distribution. However, in light of the non-trivial inner optimization of the acquisition function prevalent in BO, such weighting schemes do not always accurately reflect given user beliefs. We introduce a novel BO approach leveraging tractable probabilistic models named probabilistic circuits (PCs) as a surrogate model. PCs encode a tractable joint distribution over the hybrid hyperparameter space and evaluation scores. They enable exact conditional inference and sampling. Based on conditional sampling, we construct a novel selection policy that enables an acquisition function-free generation of candidate points (thereby eliminating the need for an additional inner-loop optimization) and ensures that user beliefs are reflected accurately in the selection policy. We provide a theoretical analysis and an extensive empirical evaluation, demonstrating that our method achieves state-of-the-art performance in standard HPO and outperforms interactive BO baselines in interactive HPO.

View on arXiv
@article{seng2025_2505.17804,
  title={ Hyperparameter Optimization via Interacting with Probabilistic Circuits },
  author={ Jonas Seng and Fabrizio Ventola and Zhongjie Yu and Kristian Kersting },
  journal={arXiv preprint arXiv:2505.17804},
  year={ 2025 }
}
Main:9 Pages
17 Figures
Bibliography:4 Pages
4 Tables
Appendix:26 Pages
Comments on this paper