Interactive data exploration for high-performance fluid flow computations through porous media

TL;DR

This paper presents an interactive data exploration service for high-performance fluid flow simulations, enabling researchers to efficiently access and visualize large distributed datasets during runtime without bandwidth issues.

Contribution

It introduces a novel HPC data exploration approach based on a sliding window concept, facilitating real-time remote data access during simulations.

Findings

Enables real-time visualization of large HPC datasets

Reduces bandwidth limitations during data exploration

Improves interactivity in fluid flow simulation analysis

Abstract

Huge data advent in high-performance computing (HPC) applications such as fluid flow simulations usually hinders the interactive processing and exploration of simulation results. Such an interactive data exploration not only allows scientiest to 'play' with their data but also to visualise huge (distributed) data sets in both an efficient and easy way. Therefore, we propose an HPC data exploration service based on a sliding window concept, that enables researches to access remote data (available on a supercomputer or cluster) during simulation runtime without exceeding any bandwidth limitations between the HPC back-end and the user front-end.