Concurrency Control as a Service

TL;DR

This paper introduces CCaaS, a decoupled concurrency control service for disaggregated databases, which improves scalability and performance by reducing coordination overhead and latency through novel algorithms and architecture.

Contribution

It proposes a new layered architecture for disaggregated databases with a decoupled CC layer, and introduces the SM-OCC algorithm with asynchronous log push-down to enhance scalability and reduce latency.

Findings

CCaaS achieves 1.02-3.11X higher throughput.

CCaaS reduces latency by 1.11-2.75X.

The proposed algorithms improve scalability in disaggregated databases.

Abstract

Existing disaggregated databases separate execution and storage layers, enabling independent and elastic scaling of resources. In most cases, this design makes transaction concurrency control (CC) a critical bottleneck, which demands significant computing resources for concurrent conflict management and struggles to scale due to the coordination overhead for concurrent conflict resolution. Coupling CC with execution or storage limits performance and elasticity, as CC's resource needs do not align with the free scaling of the transaction execution layer or the storage-bound data layer. This paper proposes Concurrency Control as a Service (CCaaS), which decouples CC from databases, building an execution-CC-storage three-layer decoupled database, allowing independent scaling and upgrades for improved elasticity, resource utilization, and development agility. However, adding a new layer increases latency due to the shift in communication from hardware to network. To address this, we propose a Sharded Multi-Write OCC (SM-OCC) algorithm with an asynchronous log push-down mechanism to minimize network communications overhead and transaction latency. Additionally, we implement a multi-write architecture with a deterministic conflict resolution method to reduce coordination overhead in the CC layer, thereby improving scalability. CCaaS is designed to be connected by a variety of execution and storage engines. Existing disaggregated databases can be revolutionized with CCaaS to achieve high elasticity, scalability, and high performance. Results show that CCaaS achieves 1.02-3.11X higher throughput and 1.11-2.75X lower latency than SoTA disaggregated databases.