Julia Implementation of the Dynamic Distributed Dimensional Data Model

TL;DR

This paper introduces a Julia implementation of the Dynamic Distributed Dimensional Data Model (D4M), demonstrating scalable performance improvements over the original Matlab version for data analysis tasks.

Contribution

It provides the first Julia implementation of D4M, enabling high-performance, scalable data analysis with a unified associative array data model.

Findings

Julia implementation achieves better scalability than Matlab version

Experimental results confirm high performance in data analysis tasks

D4M in Julia facilitates easier and more efficient data analysis workflows

Abstract

Julia is a new language for writing data analysis programs that are easy to implement and run at high performance. Similarly, the Dynamic Distributed Dimensional Data Model (D4M) aims to clarify data analysis operations while retaining strong performance. D4M accomplishes these goals through a composable, unified data model on associative arrays. In this work, we present an implementation of D4M in Julia and describe how it enables and facilitates data analysis. Several experiments showcase scalable performance in our new Julia version as compared to the original Matlab implementation.