We present a first proof-of-concept use-case that demonstrates the efficiency of interfacing the algorithm framework ParadisEO with the automated algorithm configuration tool irace and the experimental platform IOHprofiler. By combing these three tools, we obtain a powerful benchmarking environment that allows us to systematically analyze large classes of algorithm spaces on complex benchmark problems. Key advantages of our pipeline are fast evaluation times, the possibility to generate rich data sets to support the analysis of the algorithms, and a standardized interface that can be used to benchmark very broad classes of sampling-based optimization heuristics. In addition to enabling systematic algorithm configuration studies, our approach paves a way for assessing the contribution of new ideas in interplay with already existing operators -- a promising avenue for our research domain, which at present may have a too strong focus on comparing entire algorithm instances.

翻译：我们提出了第一个概念使用证明,展示了将算法框架ParadisEO与自动算法配置工具Irace和实验平台IOHproforld接口的效率。通过对这三个工具进行梳理,我们获得了一个强大的基准环境,使我们能够系统地分析关于复杂基准问题的大量算法空间。我们输油管的主要优势是快速评估时间、产生丰富的数据集以支持算法分析的可能性以及一个标准化的界面,可用来衡量非常广泛的基于抽样的优化超常性。除了能够进行系统的算法配置研究外,我们的方法为评估新想法在与现有操作者互动中的贡献铺平了道路,这是我们研究领域的一个有希望的渠道,目前,这个渠道可能过于侧重于比较整个算法实例。