Finite mixture models are a useful statistical model class for clustering and density approximation. In the Bayesian framework finite mixture models require the specification of suitable priors in addition to the data model. These priors allow to avoid spurious results and provide a principled way to define cluster shapes and a preference for specific cluster solutions. A generic model estimation scheme for finite mixtures with a fixed number of components is available using Markov chain Monte Carlo (MCMC) sampling with data augmentation. The posterior allows to assess uncertainty in a comprehensive way, but component-specific posterior inference requires resolving the label switching issue. In this paper we focus on the application of Bayesian finite mixture models for clustering. We start with discussing suitable specification, estimation and inference of the model if the number of components is assumed to be known. We then continue to explain suitable strategies for fitting Bayesian finite mixture models when the number of components is not known. In addition, all steps required to perform Bayesian finite mixture modeling are illustrated on a data example where a finite mixture model of multivariate Gaussian distributions is fitted. Suitable prior specification, estimation using MCMC and posterior inference are discussed for this example assuming the number of components to be known as well as unknown.
翻译:有限混合模型是用于聚类和密度逼近的一类实用统计模型。在贝叶斯框架下,有限混合模型除了数据模型外还需要设定合适的先验分布。这些先验能够避免伪结果,并为定义聚类形状及特定聚类解的偏好提供原则性方法。对于具有固定分量数的有限混合模型,可通过数据增广的马尔可夫链蒙特卡洛(MCMC)抽样实现通用模型估计方案。后验分布允许以综合方式评估不确定性,但分量特定的后验推断需要解决标签切换问题。本文聚焦于贝叶斯有限混合模型在聚类任务中的应用。我们首先讨论当分量数量已知时模型的设定、估计与推断方法,继而阐述分量数量未知时拟合贝叶斯有限混合模型的适用策略。此外,通过多元高斯分布有限混合模型的数据实例,完整演示了执行贝叶斯有限混合建模的所有步骤。针对该实例,分别在分量数量已知与未知的假设下,详细讨论了先验设定、MCMC估计及后验推断方法。