Benchmarking Data Management Systems for Microservices

TL;DR

This paper introduces Online Marketplace, a comprehensive benchmark for data management in microservices, addressing real-world challenges like distributed transactions, data consistency, and event processing to aid system development.

Contribution

It presents a novel benchmark tailored for microservice data management challenges, enabling realistic evaluation and fostering new system designs.

Findings

Online Marketplace effectively models real-world microservice data challenges.

Implementing the benchmark reveals integration difficulties in heterogeneous data platforms.

The benchmark facilitates experimentation with key microservice data properties.

Abstract

Microservice architectures are a popular choice for deploying large-scale data-intensive applications. This architectural style allows microservice practitioners to achieve requirements related to loose coupling, fault contention, workload isolation, higher data availability, scalability, and independent schema evolution. Although the industry has been employing microservices for over a decade, existing microservice benchmarks lack essential data management challenges observed in practice, including distributed transaction processing, consistent data querying and replication, event processing, and data integrity constraint enforcement. This gap jeopardizes the development of novel data systems that embrace the complex nature of data-intensive microservices. In this talk, we share our experience in designing Online Marketplace, a novel benchmark that embraces core data management requirements intrinsic to real-world microservices. By implementing the benchmark in state-of-the-art data platforms, we experience the pain practitioners face in assembling several heterogeneous components to realize their requirements. Our evaluation demonstrates Online Marketplace allows experimenting key properties sought by microservice practitioners, thus fomenting the design of novel data management systems.