Requirements analysis for HPC\&HTC infrastructures integration in ESCAPE Science Analysis Platform

TL;DR

This paper analyzes the requirements for integrating HPC and HTC infrastructures into the ESCAPE Science Analysis Platform to support large-scale data analysis for astronomy and particle physics within the EOSC environment.

Contribution

It identifies key requirements for interface implementation, focusing on authentication, data management, and workflow deployment for HPC and HTC integration.

Findings

Defined authentication and authorization needs

Outlined data management requirements

Specified workflow deployment considerations

Abstract

ESCAPE (European Science Cluster of Astronomy and Particle physics ESFRI research infrastructures) is a project to set up a cluster of ESFRI (European Strategy Forum on Research Infrastructures) facilities for astronomy, astroparticle and particle physics to face the challenges emerging through the modern multi-disciplinary data driven science. One of the main goal of ESCAPE is the building of ESAP (ESFRI Science Analysis Platform), a science platform for the analysis of open access data available through the EOSC (European Open Science Cloud) environment. ESAP will allow EOSC researchers to identify and stage existing data collections for analysis, share data, share and run scientific workflows. For many of the concerned ESFRIs and RIs, the data scales involved require significant computational resources (storage and compute) to support processing and analysis. The EOSC-ESFRI science platform therefore must implement appropriate interfaces to an underlying HPC (High Performance Computing) or HTC (High Throughput Computing) infrastructure to take advantage of it. This poster describes the analysis done to identify the main requirements for the implementation of the interfaces enabling the ESAP data access and computation resources integration in HPC and HTC computation infrastructures in terms of authentication and authorization policies, data management, workflow deployment and run.