Rethinking State Management in Actor Systems for Cloud-Native Applications

TL;DR

This paper introduces SmSa, a new data management layer for actor systems that simplifies complex state management, enforces data dependencies, and improves performance in distributed applications.

Contribution

We propose SmSa, a novel layer that enables declarative data dependencies and transactional maintenance, addressing limitations in current actor systems.

Findings

SmSa reduces logging overhead significantly.

SmSa doubles concurrency levels compared to existing approaches.

Supports core data management tasks with high dependency frequency.

Abstract

The actor model has gained increasing popularity. However, it lacks support for complex state management tasks, such as enforcing foreign key constraints and ensuring data replication consistency across actors. These are crucial properties in partitioned application designs, such as microservices. To fill this gap, we start by analyzing the key impediments in state-of-the-art actor systems. We find it difficult for developers to express complex data relationships across actors and reason about the impact of state updates on performance due to opaque state management abstractions. To solve this conundrum, we develop SmSa, a novel data management layer for actor systems, allowing developers to declare data dependencies that cut across actors, including foreign keys, data replications, and other dependencies. SmSa can transparently enforce the declared dependencies, reducing the burden on developers. Furthermore, SmSa employs novel logging and concurrency control algorithms to support transactional maintenance of data dependencies. We demonstrate SmSa can support core data management tasks where dependencies across components appear frequently without jeopardizing application logic expressiveness and performance. Our experiments show SmSa significantly reduces the logging overhead and leads to increased concurrency level, improving by up to 2X the performance of state-of-the-art deterministic scheduling approaches. As a result, SmSa will make it easier to design and implement highly partitioned and distributed applications.