The recent developments and research in distributed ledger technologies and blockchain have contributed to the increasing adoption of distributed systems. To collect relevant insights into systems' behavior, we observe many evaluation frameworks focusing mainly on the system under test throughput. However, these frameworks often need more comprehensiveness and generality, particularly in adopting a distributed applications' cross-layer approach. This work analyses in detail the requirements for distributed systems assessment. We summarize these findings into a structured methodology and experimentation framework called TURBO. Our approach emphasizes setting up and assessing a broader spectrum of distributed systems and addresses a notable research gap. We showcase the effectiveness of the framework by evaluating four distinct systems and their interaction, leveraging a diverse set of eight carefully selected metrics and 12 essential parameters. Through experimentation and analysis we demonstrate the framework's capabilities to provide valuable insights across various use cases. For instance, we identify that a combination of Trusted Execution Environments with threshold signature scheme FROST introduces minimal overhead on the performance with average latency around \SI{40}{\ms}. We showcase an emulation of realistic systems behavior, e.g., Maximal Extractable Value is possible and could be used to further model such dynamics. The TURBO framework enables a deeper understanding of distributed systems and is a powerful tool for researchers and practitioners navigating the complex landscape of modern computing infrastructures.
翻译:近年来,分布式账本技术与区块链的研究进展促进了分布式系统的广泛采用。为深入洞察系统行为,现有评估框架主要关注待测系统的吞吐量。然而,这些框架往往缺乏全面性与通用性,尤其在采用分布式应用的跨层方法方面存在不足。本研究详细分析了分布式系统评估的需求,并将这些发现归纳为一套结构化方法与实验框架——TURBO。我们的方法侧重于搭建与评估更广泛的分布式系统,填补了显著的研究空白。通过利用八项精心选取的度量指标和十二个关键参数对四个不同系统及其交互进行评价,我们展示了该框架的有效性。实验与分析表明,该框架能在多种应用场景中提供有价值的见解。例如,我们发现在可信执行环境中结合FROST门限签名方案仅会引入极小的性能开销,平均延迟约为\SI{40}{\ms}。我们展示了真实系统行为(如最大可提取价值)的模拟可行性,并可用于进一步模拟此类动力学。TURBO框架能够加深对分布式系统的理解,是研究人员和实践者在现代计算基础设施复杂领域探索的有力工具。