20
0

Flat-topped Probability Density Functions for Mixture Models

Abstract

This paper investigates probability density functions (PDFs) that are continuous everywhere, nearly uniform around the mode of distribution, and adaptable to a variety of distribution shapes ranging from bell-shaped to rectangular. From the viewpoint of computational tractability, the PDF based on the Fermi-Dirac or logistic function is advantageous in estimating its shape parameters. The most appropriate PDF for nn-variate distribution is of the form: p(x)[cosh([(xm)TΣ1(xm)]n/2)+cosh(rn)]1p\left(\mathbf{x}\right)\propto\left[\cosh\left(\left[\left(\mathbf{x}-\mathbf{m}\right)^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\left(\mathbf{x}-\mathbf{m}\right)\right]^{n/2}\right)+\cosh\left(r^{n}\right)\right]^{-1} where x,mRn\mathbf{x},\mathbf{m}\in\mathbb{R}^{n}, Σ\boldsymbol{\Sigma} is an n×nn\times n positive definite matrix, and r>0r>0 is a shape parameter. The flat-topped PDFs can be used as a component of mixture models in machine learning to improve goodness of fit and make a model as simple as possible.

View on arXiv
Comments on this paper