Lessons learned from the early performance evaluation of Intel Optane DC Persistent Memory in DBMS

TL;DR

This paper evaluates the performance of Intel Optane DC Persistent Memory in various DBMS configurations, providing insights and recommendations for integrating NVM into database systems effectively.

Contribution

It offers a comprehensive performance analysis of Intel Optane DC Persistent Memory in DBMS workloads, guiding future design choices for NVM integration.

Findings

NVM performance varies significantly with configuration and workload.

Using NVM as a persistent storage or buffer pool impacts DBMS performance differently.

Simple hardware or software changes are insufficient for optimal NVM utilization.

Abstract

Non-volatile memory (NVM) is an emerging technology, which has the persistence characteristics of large capacity storage devices(e.g., HDDs and SSDs), while providing the low access latency and byte-addressablity of traditional DRAM memory. This unique combination of features open up several new design considerations when building database management systems (DBMSs), such as replacing DRAM (as the main working space memory) or block devices (as the persistent storage), or complementing both at the same time for several DBMS components (such as access methods,storage engine, buffer management, logging/recovery, etc). However, interacting with NVM requires changes to application software to best use the device (e.g. mmap and clflush of small cache lines instead of write and fsync of large page buffers). Before introducing (potentially major) code changes to the DBMS for NVM, developers need a clear understanding of NVM performance in various conditions to help make better design choices. In this paper, we provide extensive performance evaluations conducted with a recently released NVM device, Intel Optane DC Persistent Memory (PMem), under different configurations with several micro-benchmark tools. Further, we evaluate OLTP and OLAP database workloads (i.e., TPC-C and TPC-H) with Microsoft SQL Server 2019 when using the NVM device as an in-memory buffer pool or persistent storage. From the lessons learned we share some recommendations for future DBMS design with PMem, e.g.simple hardware or software changes are not enough for the best use of PMem in DBMSs.