A Micro-Service based Approach for Constructing Distributed Storage System

TL;DR

This paper proposes a micro-service architecture for distributed storage systems, demonstrating flexible capabilities and comparable performance through case studies on erasure coding and compression.

Contribution

It introduces a novel micro-service based framework for distributed storage, enabling flexible feature addition while maintaining performance.

Findings

Micro-service architecture enhances flexibility in distributed storage.

Performance remains reasonable with micro-services compared to monolithic systems.

Case studies on erasure coding and compression validate the approach.

Abstract

This paper presents an approach for constructing distributed storage system based on micro-service architecture. By building storage functionalities using micro services, we can provide new capabilities to a distributed storage system in a flexible way. We take erasure coding and compression as two case studies to show how to build a micro-service based distributed storage system. We also show that by building erasure coding and compression as micro-services, the distributed storage system still achieves reasonable performance compared to the monolithic one.