Building the International Lattice Data Grid
G. Beckett, B. Joo, C.M. Maynard, D. Pleiter, O. Tatebe, T. Yoshie
TL;DR
The paper introduces the International Lattice Data Grid (ILDG), a federated system designed to facilitate sharing and access to Lattice QCD simulation data across multiple regional data grids using standardized metadata and web services.
Contribution
It presents the design, standards, and initial implementation of the ILDG, enabling seamless data sharing among diverse regional grids for Lattice QCD research.
Findings
Successful implementation of metadata and web-service standards
Seamless access to distributed Lattice QCD data catalogs
Critical evaluation of ILDG's design and performance after one year
Abstract
We present the International Lattice Data Grid (ILDG), a loosely federated grid of grids for sharing data from Lattice Quantum Chromodynamics (LQCD) simulations. The ILDG comprises of metadata, file format and web-service standards, which can be used to wrap regional data-grid interfaces, allowing seamless access to catalogues and data in a diverse set of collaborating regional grids. We discuss the technological underpinnings of the ILDG, primarily the metadata and the middleware, and offer a critique of its various aspects with the hindsight of the design work and the first full year of production.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.