The Lustre Storage Architecture

TL;DR

This paper provides a comprehensive overview of the Lustre file system architecture, detailing its design, development history, and implementation status up to 2019, reflecting on its evolution over time.

Contribution

It offers an in-depth architectural description of Lustre, documenting its features, development timeline, and the adaptations made since its initial creation between 2001 and 2005.

Findings

Most features have been implemented by 2019

Some features were added recently or through alternative approaches

The architecture has evolved significantly over time

Abstract

This lengthy document often referred to as the "Lustre Book", contains a detailed outline of Lustre file system architecture, as it was created between 2001 and 2005, in accordance with the requirements from various users. Now, in 2019, most features have been implemented, but some only recently, and some along different lines of thought.