M2: An Analytic System with Specialized Storage Engines for Multi-Model Workloads

TL;DR

M2 is a multi-model analytic system with integrated storage engines and a novel multi-stage hash join algorithm, significantly improving performance in multi-model workloads compared to existing methods.

Contribution

M2 introduces a unified system with specialized storage engines and a new inter-model join algorithm for efficient multi-model data analytics.

Findings

Up to 188x speedup over existing approaches

Effective handling of multiple data models within a single system

Introduction of multi-stage hash join for cross-model data integration

Abstract

Modern data analytic workloads increasingly require handling multiple data models simultaneously. Two primary approaches meet this need: polyglot persistence and multi-model database systems. Polyglot persistence employs a coordinator program to manage several independent database systems but suffers from high communication costs due to its physically disaggregated architecture. Meanwhile, existing multi-model database systems rely on a single storage engine optimized for a specific data model, resulting in inefficient processing across diverse data models. To address these limitations, we present M2, a multi-model analytic system with integrated storage engines. M2 treats all data models as first-class entities, composing query plans that incorporate operations across models. To effectively combine data from different models, the system introduces a specialized inter-model join algorithm called multi-stage hash join. Our evaluation demonstrates that M2 outperforms existing approaches by up to 188x speedup on multi-model analytics, confirming the effectiveness of our proposed techniques.