Benchmark sets are extremely important for evaluating and developing global optimization algorithms and related solvers. A new test set named PCC benchmark is proposed especially for optimization problems of nonlinear curve fitting for the first time, with the aspiration of helping developers to investigate and compare the performance of different global optimization solvers, as well as more effective optimization algorithms could be developed. Compared with the well-known classical nonlinear curve fitting benchmark set given by the National Institute of Standards and Technology (NIST) of USA, the most distinguishable features of the PCC benchmark are small problem dimensions, unconstrained with free search domain and high level of difficulty for obtaining global optimization solutions, which make the PCC benchmark be not only suitable for validating the effectiveness of different global optimization algorithms, but also more ideal for verifying and comparing various related solvers. Seven of the world's leading global optimization solvers, including Baron, Antigone, Couenne, Lingo, Scip, Matlab-GA and 1stOpt, are employed to test NIST and PCC benchmark thoroughly in terms of both effectiveness and efficiency. The results showed that the NIST benchmark is relatively simple and not suitable for global optimization testing, meanwhile the PCC benchmark is a unique, challenging and effective test dataset for global optimization.
翻译:基准测试集对于评估和发展全局优化算法及相关求解器极为重要。本文首次提出了一种专门针对非线性曲线拟合优化问题的新测试集——PCC基准,旨在帮助研究者考察和比较不同全局优化求解器的性能,并促进开发更有效的优化算法。与美国国家标准与技术研究院(NIST)提供的经典非线性曲线拟合基准集相比,PCC基准最显著的特征是问题维度小、无约束自由搜索域以及获得全局优化解的难度高,这使得PCC基准不仅适用于验证不同全局优化算法的有效性,而且更理想地用于检验和比较各类相关求解器。采用包括Baron、Antigone、Couenne、Lingo、Scip、Matlab-GA和1stOpt在内的七款世界领先的全局优化求解器,从有效性和效率两方面对NIST和PCC基准进行了全面测试。结果表明,NIST基准相对简单,不适合进行全局优化测试;而PCC基准则是一个独特、具有挑战性且有效的全局优化测试数据集。