The DEVStone benchmark allows us to evaluate the performance of discrete-event simulators based on the DEVS formalism. It provides model sets with different characteristics, enabling the analysis of specific issues of simulation engines. However, this heterogeneity hinders the comparison of the results among studies, as the results obtained on each research work depend on the chosen subset of DEVStone models. We define the DEVStone metric based on the DEVStone synthetic benchmark and provide a mechanism for specifying objective ratings for DEVS-based simulators. This metric corresponds to the average number of times that a simulator can execute a selection of 12 DEVStone models in one minute. The variety of the chosen models ensures we measure different particularities provided by DEVStone. The proposed metric allows us to compare various simulators and to assess the impact of new features on their performance. We use the DEVStone metric to compare some popular DEVS-based simulators.

翻译：DEVStone基准测试使我们能够评估基于DEVS形式化模型的离散事件仿真器的性能。它提供了具有不同特性的模型集，从而能够分析仿真引擎的特定问题。然而，这种异质性阻碍了不同研究之间结果的比较，因为每项研究获得的结果取决于所选DEVStone模型的子集。我们基于DEVStone综合基准测试定义了DEVStone指标，并为基于DEVS的仿真器提供了客观评级指定机制。该指标对应仿真器在一分钟内执行12个选定DEVStone模型的平均次数。所选模型的多样性确保我们能够衡量DEVStone提供的不同特性。所提出的指标使我们能够比较多种仿真器，并评估新功能对其性能的影响。我们利用DEVStone指标对几种流行的基于DEVS的仿真器进行了比较。