Milliscale: Fast Commit on Low-Latency Object Storage

TL;DR

Milliscale is a memory-optimized OLTP engine designed for low-latency object storage, significantly reducing commit latency and request overhead while maintaining high throughput and strong consistency.

Contribution

It introduces novel techniques to lower commit delays and minimize object access requests in low-latency object storage environments.

Findings

Milliscale achieves much lower commit latency compared to baselines.

It sustains high throughput under low-latency object storage conditions.

The system effectively supports OLTP workloads with strong consistency.

Abstract

With millisecond-level latency and support for mutable objects, recent low-latency object storage services as represented by Amazon S3 Express One Zone have become an attractive option for OLTP engines to directly commit transactions and persist operational data with transparent strong consistency, high durability and high availability. But a na\"ive adoption can still lead to high commit latency due to idiosyncrasies of S3 Express One Zone and modern decentralized logging. This paper presents Milliscale, a memory-optimized OLTP engine for low-latency object storage. Milliscale optimizes commit latency with new techniques that lower commit delays and reduce the number of object access requests. Our evaluation using representative benchmarks shows that Milliscale delivers much lower commit latency than baselines while sustaining high throughput.