We propose a new uncertainty estimator for gradient-free optimisation of black-box simulators using deep generative surrogate models. Optimisation of these simulators is especially challenging for stochastic simulators and higher dimensions. To address these issues, we utilise a deep generative surrogate approach to model the black box response for the entire parameter space. We then leverage this knowledge to estimate the proposed uncertainty based on the Wasserstein distance - the Wasserstein uncertainty. This approach is employed in a posterior agnostic gradient-free optimisation algorithm that minimises regret over the entire parameter space. A series of tests were conducted to demonstrate that our method is more robust to the shape of both the black box function and the stochastic response of the black box than state-of-the-art methods, such as efficient global optimisation with a deep Gaussian process surrogate.
翻译:本文提出一种新的不确定性估计器,用于通过深度生成代理模型实现无梯度黑盒模拟器优化。随机模拟器和高维场景下的此类优化尤为困难。为解决这些问题,我们采用深度生成代理方法对整个参数空间的黑盒响应进行建模,并基于Wasserstein距离——即Wasserstein不确定性——构建不确定性估计框架。该方法被应用于后验无关的无梯度优化算法中,实现在整个参数空间上的遗憾最小化。通过系列实验证明,相较于深度高斯过程代理的高效全局优化等先进方法,本方法对黑盒函数形态及随机响应具有更强的鲁棒性。