Coordination services and protocols are critical components of distributed systems and are essential for providing consistency, fault tolerance, and scalability. However, due to lack of a standard benchmarking tool for distributed coordination services, coordination service developers/researchers either use a NoSQL standard benchmark and omit evaluating consistency, distribution, and fault-tolerance; or create their own ad-hoc microbenchmarks and skip comparability with other services. In this paper, we analyze and compare known and widely used distributed coordination services, their evaluations, and the tools used to benchmark those systems. We identify important requirements of distributed coordination service benchmarking, like the metrics and parameters that need to be evaluated and their evaluation setups and tools.

翻译：协调服务与协议是分布式系统的关键组件，对于实现一致性、容错性和可扩展性至关重要。然而，由于缺乏针对分布式协调服务的标准化基准测试工具，协调服务开发者/研究人员要么使用NoSQL标准基准测试而忽略了对一致性、分布式特性及容错性的评估，要么自行创建临时微基准测试并放弃与其他服务的可比性。本文对已知且广泛使用的分布式协调服务、其评估方法以及用于对这些系统进行基准测试的工具进行了分析与比较。我们明确了分布式协调服务基准测试的重要需求，包括需要评估的指标与参数及其评估环境与工具。