Towards an IO intensive Grid application instrumentation in MedioGRID

TL;DR

This paper presents an architecture for IO intensive applications in MedioGRID, utilizing continuous monitoring with MonALISA to enhance data transfer reliability and system insight in a Grid environment.

Contribution

It introduces a middleware-based architecture integrating Globus, Condor, and PBS with MonALISA for real-time monitoring of IO intensive satellite image processing applications.

Findings

Monitoring provides a clear view of system evolution.

System supports reliable fast data transfer and replication.

Architecture improves data access uniformity.

Abstract

Obtaining high performance in IO intensive applications requires systems that support reliable fast transfer, data replication, and caching. In this paper we present an architecture designed for supporting IO intensive applications in MedioGRID, a system for real-time processing of satellite images, operating in a Grid environment. The solution ensures that applications which are processing geographical data have uniform access to data and is based on continuous monitoring of the data transfers using MonALISA and its extensions. The MedioGRID architecture is also built on Globus, Condor and PBS and based on this middleware we aim to extract information about the running systems. The results obtained in testing MedioGRID system for large data transfers show that monitoring system provides a very good view of system evolution.