In this paper, we introduce a new flow-based method for global optimization of Lipschitz functions, called Stein Boltzmann Sampling (SBS). Our method samples from the Boltzmann distribution that becomes asymptotically uniform over the set of the minimizers of the function to be optimized. Candidate solutions are sampled via the \emph{Stein Variational Gradient Descent} algorithm. We prove the asymptotic convergence of our method, introduce two SBS variants, and provide a detailed comparison with several state-of-the-art global optimization algorithms on various benchmark functions. The design of our method, the theoretical results, and our experiments, suggest that SBS is particularly well-suited to be used as a continuation of efficient global optimization methods as it can produce better solutions while making a good use of the budget.
翻译:本文提出了一种新的基于流的Lipschitz函数全局优化方法,称为Stein玻尔兹曼采样(SBS)。该方法从玻尔兹曼分布中采样,该分布随着优化目标函数极小点集的趋向而渐近均匀。候选解通过\emph{Stein变分梯度下降}算法进行采样。我们证明了该方法的渐近收敛性,提出了两种SBS变体,并在多个基准函数上与若干最先进的全局优化算法进行了详细比较。我们的方法设计、理论结果及实验表明,SBS特别适合作为高效全局优化方法的延续,因为它能够在充分利用预算的同时产生更优解。