A data Grid testbed environment in Gigabit WAN with HPSS

TL;DR

This paper describes the development and testing of a high-speed data grid environment over Gigabit WAN, integrating large-scale storage and middleware to support high energy physics experiments.

Contribution

It introduces a novel test bed setup with HPSS and NorduGrid middleware over SuperSINET, enabling large-scale data transfer and analysis for physics research.

Findings

Successful data transfer of Atlas simulation data over SuperSINET

Performance evaluation of HPSS over high-speed WAN

Comparison of computing and storage resource performance

Abstract

For data analysis of large-scale experiments such as LHC Atlas and other Japanese high energy and nuclear physics projects, we have constructed a Grid test bed at ICEPP and KEK. These institutes are connected to national scientific gigabit network backbone called SuperSINET. In our test bed, we have installed NorduGrid middleware based on Globus, and connected 120TB HPSS at KEK as a large scale data store. Atlas simulation data at ICEPP has been transferred and accessed using SuperSINET. We have tested various performances and characteristics of HPSS through this high speed WAN. The measurement includes comparison between computing and storage resources are tightly coupled with low latency LAN and long distant WAN.