In this document, we describe LDBC Graphalytics, an industrial-grade benchmark for graph analysis platforms. The main goal of Graphalytics is to enable the fair and objective comparison of graph analysis platforms. Due to the diversity of bottlenecks and performance issues such platforms need to address, Graphalytics consists of a set of selected deterministic algorithms for full-graph analysis, standard graph datasets, synthetic dataset generators, and reference output for validation purposes. Its test harness produces deep metrics that quantify multiple kinds of systems scalability, weak and strong, and robustness, such as failures and performance variability. The benchmark also balances comprehensiveness with runtime necessary to obtain the deep metrics. The benchmark comes with open-source software for generating performance data, for validating algorithm results, for monitoring and sharing performance data, and for obtaining the final benchmark result as a standard performance report.
翻译:本文描述了LDBC Graphalytics——一个面向图分析平台的工业级基准测试。Graphalytics的主要目标是实现图分析平台的公平客观比较。由于该类平台需要应对多样化的性能瓶颈与问题,Graphalytics包含一组针对全图分析的确定性算法、标准图数据集、合成数据集生成器以及用于验证的参考输出。其测试工具可生成深度度量指标,用以量化系统的多种可扩展性(弱扩展性与强扩展性)及鲁棒性(如故障与性能波动)。该基准测试在全面性与获取深度度量所需运行时间之间取得平衡。基准测试配套提供了开源软件,用于生成性能数据、验证算法结果、监控与共享性能数据,以及通过标准性能报告获取最终基准测试结果。