PUSHtap: PIM-based In-Memory HTAP with Unified Data Storage Format

TL;DR

PUSHtap introduces a PIM-based in-memory HTAP system with a unified data format, enabling concurrent OLTP and OLAP processing while overcoming data-format conflicts and achieving significant throughput improvements.

Contribution

It proposes a novel unified data storage format and architecture that combines CPU and PIM access for efficient HTAP processing, extending PIM architecture for OLAP support.

Findings

Achieves 3.4x OLAP throughput improvement

Achieves 4.4x OLTP throughput improvement

Effectively balances performance, data freshness, and workload optimization

Abstract

Hybrid transaction/analytical processing (HTAP) is an emerging database paradigm that supports both online transaction processing (OLTP) and online analytical processing (OLAP) workloads. Computing-intensive OLTP operations, involving row-wise data manipulation, are suitable for row-store format. In contrast, memory-intensive OLAP operations, which are column-centric, benefit from column-store format. This \emph{data-format dilemma} prevents HTAP systems from concurrently achieving three design goals: performance isolation, data freshness, and workload-specific optimization. Another background technology is Processing-in-Memory (PIM), which integrates computing units (PIM units) inside DRAM memory devices to accelerate memory-intensive workloads, including OLAP. Our key insight is to combine the interleaved CPU access and localized PIM unit access to provide two-dimensional access to address the data format contradictions inherent in HTAP. First, we propose a unified data storage format with novel data alignment and placement techniques to optimize the effective bandwidth of CPUs and PIM units and exploit the PIM's parallelism. Second, we implement the multi-version concurrency control (MVCC) essential for single-instance HTAP. Third, we extend the commercial PIM architecture to support the OLAP operations and concurrent access from PIM and CPU. Experiments show that PUSHtap can achieve 3.4\texttimes{}/4.4\texttimes{} OLAP/OLTP throughput improvement compared to multi-instance PIM-based design.