ScalienDB: Designing and Implementing a Distributed Database using Paxos

TL;DR

This paper presents the design and implementation of ScalienDB, a distributed, replicated database built on Paxos, highlighting its architecture, codebase, and lessons learned from deployment, despite its discontinuation.

Contribution

It introduces a practical implementation of a Paxos-based distributed database and shares insights from real-world deployment and development challenges.

Findings

Successfully deployed at multiple clients

Provided insights into Paxos implementation challenges

Demonstrated scalability and replication capabilities

Abstract

ScalienDB is a scalable, replicated database built on top of the Paxos algorithm. It was developed from 2010 to 2012, when the startup backing it failed. This paper discusses the design decisions of the distributed database, describes interesting parts of the C++ codebase and enumerates lessons learned putting ScalienDB into production at a handful of clients. The source code is available on Github under the AGPL license, but it is no longer developed or maintained.