Microservice architectures are a popular choice for deploying large-scale data-intensive applications. This architectural style allows microservice practitioners to achieve requirements related to loose coupling, fault contention, workload isolation, higher data availability, scalability, and independent schema evolution. Although the industry has been employing microservices for over a decade, existing microservice benchmarks lack essential data management challenges observed in practice, including distributed transaction processing, consistent data querying and replication, event processing, and data integrity constraint enforcement. This gap jeopardizes the development of novel data systems that embrace the complex nature of data-intensive microservices. In this talk, we share our experience in designing Online Marketplace, a novel benchmark that embraces core data management requirements intrinsic to real-world microservices. By implementing the benchmark in state-of-the-art data platforms, we experience the pain practitioners face in assembling several heterogeneous components to realize their requirements. Our evaluation demonstrates Online Marketplace allows experimenting key properties sought by microservice practitioners, thus fomenting the design of novel data management systems.
翻译:微服务架构是部署大规模数据密集型应用的常见选择。该架构风格使微服务实践者能够实现松耦合、故障隔离、工作负载隔离、更高数据可用性、可扩展性以及独立模式演进等需求。尽管业界采用微服务已超过十年,现有微服务基准测试仍缺乏实际应用中遇到的关键数据管理挑战,包括分布式事务处理、一致性数据查询与复制、事件处理以及数据完整性约束实施。这一缺失危及了能够应对数据密集型微服务复杂性的新型数据系统的开发。在本报告中,我们分享设计Online Marketplace(一个面向真实世界微服务固有核心数据管理需求的新型基准测试)的经验。通过在以尖端数据平台实现该基准测试的过程中,我们切身感受到实践者组装多个异构组件以实现其需求所面临的困难。我们的评估表明,Online Marketplace能够对微服务实践者所追求的关键特性开展实验,从而推动新型数据管理系统的设计。