In this document, we describe LDBC Graphalytics, an industrial-grade benchmark for graph analysis platforms. The main goal of Graphalytics is to enable the fair and objective comparison of graph analysis platforms. Due to the diversity of bottlenecks and performance issues such platforms need to address, Graphalytics consists of a set of selected deterministic algorithms for full-graph analysis, standard graph datasets, synthetic dataset generators, and reference output for validation purposes. Its test harness produces deep metrics that quantify multiple kinds of systems scalability, weak and strong, and robustness, such as failures and performance variability. The benchmark also balances comprehensiveness with runtime necessary to obtain the deep metrics. The benchmark comes with open-source software for generating performance data, for validating algorithm results, for monitoring and sharing performance data, and for obtaining the final benchmark result as a standard performance report.
翻译:本文档描述了LDBC Graphalytics——一个面向图分析平台的工业级基准测试。Graphalytics的主要目标是实现图分析平台的公平客观比较。由于此类平台需要应对的性能瓶颈与问题具有多样性,Graphalytics包含一组精选的确定性全图分析算法、标准图数据集、合成数据生成器以及用于验证的参考输出结果。其测试框架可生成深度度量指标,量化系统的多种可扩展性(弱扩展性与强扩展性)及鲁棒性(如故障与性能波动)。该基准测试还实现了全面性与获取深度度量所需运行时间之间的平衡。该基准测试提供开源软件,用于生成性能数据、验证算法结果、监控与共享性能数据,以及以标准性能报告形式获取最终基准测试结果。