Inferring parameters of a latent variable model can be a daunting task when the conditional distribution of the latent variables given the observed ones is intractable. Variational approaches prove to be computationally efficient but, possibly, lack theoretical guarantees on the estimates, while sampling based solutions are quite the opposite. Starting from already available variational approximations, we define a first Monte Carlo EM algorithm to obtain maximum likelihood estimators, focusing on the Poisson log-normal model which provides a generic framework for the analysis of multivariate count data. We then extend this algorithm to the case of a composite likelihood in order to be able to handle higher dimensional count data.
翻译:在隐变量模型中,当给定观测变量条件下隐变量的条件分布难以处理时,推断隐变量模型的参数可能是一项艰巨的任务。变分方法被证明计算效率高,但其估计值可能缺乏理论保证,而基于采样的方法则恰恰相反。基于已有的变分近似,我们首先提出了一种蒙特卡罗EM算法来获得极大似然估计,重点关注泊松对数正态模型——该模型为多元计数数据分析提供了通用框架。随后,我们将该算法扩展至复合似然情形,以处理更高维度的计数数据。