Leave-one-out cross-validation (LOO-CV) is a popular method for estimating out-of-sample predictive accuracy. However, computing LOO-CV criteria can be computationally expensive due to the need to fit the model multiple times. In the Bayesian context, importance sampling provides a possible solution but classical approaches can easily produce estimators whose asymptotic variance is infinite, making them potentially unreliable. Here we propose and analyze a novel mixture estimator to compute Bayesian LOO-CV criteria. Our method retains the simplicity and computational convenience of classical approaches, while guaranteeing finite asymptotic variance of the resulting estimators. Both theoretical and numerical results are provided to illustrate the improved robustness and efficiency. The computational benefits are particularly significant in high-dimensional problems, allowing to perform Bayesian LOO-CV for a broader range of models, and datasets with highly influential observations. The proposed methodology is easily implementable in standard probabilistic programming software and has a computational cost roughly equivalent to fitting the original model once.
翻译:留一交叉验证是一种流行的评估样本外预测精度的方法。然而,由于需要多次拟合模型,计算留一交叉验证准则的计算成本可能很高。在贝叶斯框架下,重要性抽样提供了一种可能的解决方案,但经典方法容易产生渐近方差无穷大的估计量,这可能导致结果不可靠。本文提出并分析了一种新型混合估计量,用于计算贝叶斯留一交叉验证准则。我们的方法保留了经典方法的简单性和计算便利性,同时保证了所得估计量的有限渐近方差。通过理论分析和数值结果,展示了该方法在稳健性和效率方面的改进。其计算优势在高维问题中尤为显著,使得贝叶斯留一交叉验证可应用于更广泛的模型和含有强影响观测值的数据集。所提出的方法易于在标准概率编程软件中实现,其计算成本大致等同于对原始模型进行一次拟合。