Gaussian Process Networks (GPNs) are a class of directed graphical models which employ Gaussian processes as priors for the conditional expectation of each variable given its parents in the network. The model allows the description of continuous joint distributions in a compact but flexible manner with minimal parametric assumptions on the dependencies between variables. Bayesian structure learning of GPNs requires computing the posterior over graphs of the network and is computationally infeasible even in low dimensions. This work implements Monte Carlo and Markov Chain Monte Carlo methods to sample from the posterior distribution of network structures. As such, the approach follows the Bayesian paradigm, comparing models via their marginal likelihood and computing the posterior probability of the GPN features. Simulation studies show that our method outperforms state-of-the-art algorithms in recovering the graphical structure of the network and provides an accurate approximation of its posterior distribution.
翻译:高斯过程网络是一类有向图模型,其利用高斯过程作为网络中各变量在给定父节点条件下条件期望的先验。该模型能够以简洁灵活的方式描述连续联合分布,且对变量间依赖关系仅需极少的参数假设。对高斯过程网络进行贝叶斯结构学习需要计算网络图的后验分布,即使在低维情况下也面临计算不可行性。本文采用蒙特卡洛方法和马尔可夫链蒙特卡洛方法对网络结构的后验分布进行采样。该方法遵循贝叶斯范式,通过边际似然比较模型,并计算高斯过程网络特征的后验概率。仿真研究表明,本方法在网络图结构恢复方面优于现有最优算法,并能精确逼近其后验分布。