The widely used multiobjective optimizer NSGA-II was recently proven to have considerable difficulties in many-objective optimization. In contrast, experimental results in the literature show a good performance of the SMS-EMOA, which can be seen as a steady-state NSGA-II that uses the hypervolume contribution instead of the crowding distance as the second selection criterion. This paper conducts the first rigorous runtime analysis of the SMS-EMOA for many-objective optimization. To this aim, we first propose a many-objective counterpart, the m-objective mOJZJ problem, of the bi-objective OJZJ benchmark, which is the first many-objective multimodal benchmark used in a mathematical runtime analysis. We prove that SMS-EMOA computes the full Pareto front of this benchmark in an expected number of $O(M^2 n^k)$ iterations, where $n$ denotes the problem size (length of the bit-string representation), $k$ the gap size (a difficulty parameter of the problem), and $M=(2n/m-2k+3)^{m/2}$ the size of the Pareto front. This result together with the existing negative result on the original NSGA-II shows that in principle, the general approach of the NSGA-II is suitable for many-objective optimization, but the crowding distance as tie-breaker has deficiencies. We obtain three additional insights on the SMS-EMOA. Different from a recent result for the bi-objective OJZJ benchmark, the stochastic population update often does not help for mOJZJ. It results in a $1/\Theta(\min\{Mk^{1/2}/2^{k/2},1\})$ speed-up, which is $\Theta(1)$ for large $m$ such as $m>k$. On the positive side, we prove that heavy-tailed mutation still results in a speed-up of order $k^{0.5+k-\beta}$. Finally, we conduct the first runtime analyses of the SMS-EMOA on the bi-objective OneMinMax and LOTZ benchmarks and show that it has a performance comparable to the GSEMO and the NSGA-II.
翻译:摘要:近年来,研究表明广泛应用的多目标优化器NSGA-II在处理大规模多目标优化问题时存在显著困难。相比之下,文献中的实验结果显示SMS-EMOA表现优异——该算法可视为一种稳态NSGA-II变体,其将超体积贡献替代拥挤距离作为第二选择准则。本文首次对SMS-EMOA在多目标优化中的运行时进行严格理论分析。为此,我们首先提出双目标OJZJ基准测试的多目标对应版本:m目标mOJZJ问题,这是首个用于数学运行时分析的多目标多模态基准。我们证明,SMS-EMOA以期望迭代次数$O(M^2 n^k)$计算出该基准的完整帕累托前沿,其中$n$表示问题规模(比特串表示长度),$k$表示间隙大小(问题难度参数),$M=(2n/m-2k+3)^{m/2}$为帕累托前沿规模。该结果结合现有关于原始NSGA-II的负面结论表明:NSGA-II的基本框架原则上适用于多目标优化,但以拥挤距离作为平局决胜指标存在缺陷。针对SMS-EMOA,我们获得三项新发现:与近期双目标OJZJ基准研究结果不同,随机种群更新对mOJZJ问题通常无益,仅带来$1/\Theta(\min\{Mk^{1/2}/2^{k/2},1\})$的加速比——当$m>k$等大m情形下该值为$\Theta(1)$;积极方面,我们证明重尾变异仍可产生$k^{0.5+k-\beta}$量级的加速效果;最后,我们首次对SMS-EMOA在双目标OneMinMax和LOTZ基准上进行运行时分析,表明其性能与GSEMO及NSGA-II相当。