Understanding (Un)Written Contracts of NVMe ZNS Devices with zns-tools

TL;DR

This paper introduces zns.tools, an open-source framework for analyzing and visualizing the operational contracts of ZNS SSDs, enabling better understanding of storage behavior and interactions with file systems.

Contribution

We present zns.tools, a novel end-to-end data collection and analysis framework for ZNS SSDs, facilitating the study of storage contracts and host-device interactions.

Findings

zns.tools enables detailed analysis of ZNS SSD behavior

It helps understand interactions between storage and file systems

The framework is openly available for research use

Abstract

Operational and performance characteristics of flash SSDs have long been associated with a set of Unwritten Contracts due to their hidden, complex internals and lack of control from the host software stack. These unwritten contracts govern how data should be stored, accessed, and garbage collected. The emergence of Zoned Namespace (ZNS) flash devices with their open and standardized interface allows us to write these unwritten contracts for the storage stack. However, even with a standardized storage-host interface, due to the lack of appropriate end-to-end operational data collection tools, the quantification and reasoning of such contracts remain a challenge. In this paper, we propose zns.tools, an open-source framework for end-to-end event and metadata collection, analysis, and visualization for the ZNS SSDs contract analysis. We showcase how zns.tools can be used to understand how the combination of RocksDB with the F2FS file system interacts with the underlying storage. Our tools are available openly at \url{https://github.com/stonet-research/zns-tools}.