SAGE: Percipient Storage for Exascale Data Centric Computing

TL;DR

SAGE is a proposed storage infrastructure designed for Exascale data-centric computing, aiming to handle massive data volumes and integrate Big Data analysis with HPC for scientific insights.

Contribution

The paper introduces the SAGE system architecture, addressing Exascale I/O challenges and integrating Big Data with HPC in a novel, scalable storage solution.

Findings

Early results demonstrate promising performance of key methodologies.

SAGE architecture effectively addresses Exascale I/O bottlenecks.

The system supports large-scale scientific data processing.

Abstract

We aim to implement a Big Data/Extreme Computing (BDEC) capable system infrastructure as we head towards the era of Exascale computing - termed SAGE (Percipient StorAGe for Exascale Data Centric Computing). The SAGE system will be capable of storing and processing immense volumes of data at the Exascale regime, and provide the capability for Exascale class applications to use such a storage infrastructure. SAGE addresses the increasing overlaps between Big Data Analysis and HPC in an era of next-generation data centric computing that has developed due to the proliferation of massive data sources, such as large, dispersed scientific instruments and sensors, whose data needs to be processed, analyzed and integrated into simulations to derive scientific and innovative insights. Indeed, Exascale I/O, as a problem that has not been sufficiently dealt with for simulation codes, is appropriately addressed by the SAGE platform. The objective of this paper is to discuss the software architecture of the SAGE system and look at early results we have obtained employing some of its key methodologies, as the system continues to evolve.