Coordination services and protocols are critical components of distributed systems and are essential for providing consistency, fault tolerance, and scalability. However, due to the lack of a standard benchmarking tool for distributed coordination services, coordination service developers/researchers either use a NoSQL standard benchmark and omit evaluating consistency, distribution, and fault tolerance; or create their own ad-hoc microbenchmarks and skip comparability with other services. In this study, we analyze and compare known and widely used distributed coordination services, their evaluations, and the tools used to benchmark those systems. We identify important requirements of distributed coordination service benchmarking, like the metrics and parameters that need to be evaluated and their evaluation setups and tools.

翻译：协调服务与协议是分布式系统的关键组成部分，对于提供一致性、容错性与可扩展性至关重要。然而，由于缺乏针对分布式协调服务的标准化基准测试工具，协调服务的开发者/研究者要么使用NoSQL标准基准测试而忽略对一致性、分布性与容错性的评估，要么自行构建临时性的微基准测试而放弃与其他服务的可比性。在本研究中，我们分析并比较了已知且广泛使用的分布式协调服务、其评估方法以及用于对这些系统进行基准测试的工具。我们明确了分布式协调服务基准测试的重要需求，例如需要评估的指标与参数、其评估设置及相应工具。