Simulation-based inference (SBI) provides a powerful framework for inferring posterior distributions of stochastic simulators in a wide range of domains. In many settings, however, the posterior distribution is not the end goal itself -- rather, the derived parameter values and their uncertainties are used as a basis for deciding what actions to take. Unfortunately, because posterior distributions provided by SBI are (potentially crude) approximations of the true posterior, the resulting decisions can be suboptimal. Here, we address the question of how to perform Bayesian decision making on stochastic simulators, and how one can circumvent the need to compute an explicit approximation to the posterior. Our method trains a neural network on simulated data and can predict the expected cost given any data and action, and can, thus, be directly used to infer the action with lowest cost. We apply our method to several benchmark problems and demonstrate that it induces similar cost as the true posterior distribution. We then apply the method to infer optimal actions in a real-world simulator in the medical neurosciences, the Bayesian Virtual Epileptic Patient, and demonstrate that it allows to infer actions associated with low cost after few simulations.
翻译:仿真推断(SBI)为跨领域随机模拟器的后验分布推断提供了强大框架。然而在许多场景中,后验分布本身并非最终目标——相反,推导出的参数值及其不确定性被用作决策依据。由于SIB提供的后验分布是真实后验的(可能粗糙的)近似,由此产生的决策可能非最优。本文探讨如何在随机模拟器上执行贝叶斯决策,以及如何规避显式计算后验近似的问题。我们的方法在模拟数据上训练神经网络,能预测任意数据和行动下的期望成本,因此可直接用于推断最低成本行动。我们将该方法应用于多个基准问题,证明其产生的成本与真实后验分布相近。进一步地,我们将该方法应用于医学神经科学领域的现实模拟器——贝叶斯虚拟癫痫患者模型,证明其能在少量仿真后推断出低关联成本的行动。