The adoption of heterogeneous computing systems based on diverse architectures to achieve exascale computing power has worsened the performance portability problem of scientific applications that were designed to run on these platforms. To cope with the challenges posed by supercomputing, new performance portability frameworks have been developed alongside advanced methods and metrics to evaluate the performance portability of heterogeneous applications. However, many studies have shown that the new methods and metrics do not produce coherent results which yield clear conclusions that are required for designing the hardware and software architectures of tomorrow's supercomputing systems. We outline a proposal to establish an open repository of performance portability of applications, benchmarks and models which will be standardized, objective, and based on strict operating and reporting guidelines. Such guidelines will ensure a fair, comparable and meaningful measure of the performance portability while the requirement for a detailed disclosure of the obtained results and the configuration settings will ensure the reproducibility of the reported results.

翻译：基于多样化架构的异构计算系统为达到百亿亿次计算能力而广泛采用，加剧了设计用于这些平台的科学应用的性能可移植性问题。为应对超大规模计算带来的挑战，新的性能可移植性框架与评估异构应用性能可移植性的先进方法和指标同步发展。然而，大量研究表明，这些新方法和指标并未产生连贯一致的结果，无法为未来超算系统的软硬件架构设计提供所需的明确结论。本文提出建立一套标准化、客观化且基于严格操作与报告准则的应用、基准测试与模型性能可移植性开放存储库方案。此类准则将确保性能可移植性的公平、可比且有意义的度量，同时要求详细披露所获结果与配置设置，从而保障报告结果的可复现性。