Bayesian optimization provides a powerful framework for global optimization of black-box, expensive-to-evaluate functions. However, it has a limited capacity in handling data-intensive problems, especially in multi-objective settings, due to the poor scalability of default Gaussian Process surrogates. We present a novel Bayesian optimization framework specifically tailored to address these limitations. Our method leverages a Bayesian neural networks approach for surrogate modeling. This enables efficient handling of large batches of data, modeling complex problems, and generating the uncertainty of the predictions. In addition, our method incorporates a scalable, uncertainty-aware acquisition strategy based on the well-known, easy-to-deploy NSGA-II. This fully parallelizable strategy promotes efficient exploration of uncharted regions. Our framework allows for effective optimization in data-intensive environments with a minimum number of iterations. We demonstrate the superiority of our method by comparing it with state-of-the-art multi-objective optimizations. We perform our evaluation on two real-world problems - airfoil design and color printing - showcasing the applicability and efficiency of our approach. Code is available at: https://github.com/an-on-ym-ous/lbn\_mobo
翻译:贝叶斯优化为黑箱、高代价评估函数的全局优化提供了强大框架。然而,由于默认高斯过程代理的可扩展性较差,其在处理数据密集型问题(尤其是在多目标场景下)的能力有限。我们提出了一种专门针对这些局限性的新颖贝叶斯优化框架。我们的方法采用贝叶斯神经网络方法进行代理建模,从而能够高效处理大批量数据、建模复杂问题并生成预测的不确定性。此外,我们的方法融入了一种基于广为人知且易于部署的NSGA-II的可扩展、不确定性感知的采集策略。这种完全可并行的策略促进了未知区域的高效探索。我们的框架能够在数据密集型环境下以最少的迭代次数实现有效优化。通过将我们的方法与最先进的多目标优化方法进行比较,我们证明了其优越性。我们在两个实际问题——翼型设计和彩色印刷——上进行了评估,展示了我们方法的适用性和高效性。代码获取地址:https://github.com/an-on-ym-ous/lbn\_mobo