The format for GRAND data storage and related Python interfaces
Lech Wiktor Piotrowski
TL;DR
This paper introduces a specialized data format and Python interfaces designed for efficient storage, quick access, and analysis of large-scale data from the GRAND neutrino detection array and its prototype.
Contribution
It presents a new data format, processing chain, and Python interfaces optimized for GRAND's large data volumes and analysis needs.
Findings
Efficient data storage format developed for GRAND
Python interfaces enable easy data access and analysis
Supports both bulk processing and event-by-event analysis
Abstract
The vast amounts of data to be collected by the Giant Radio Array for Neutrino Detection (GRAND) and its prototype - GRANDProto300 - require the use of a data format very efficient in terms of i/o speed and compression. At the same time, the data should be easily accessible, without the knowledge of the intricacies of the format, both for bulk processing and for detailed event-by-event analysis and reconstruction. We present the format and the structure prepared for GRAND data, the concept of the data-processing chain, and data-oriented and analysis-oriented interfaces written in Python.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAstrophysics and Cosmic Phenomena · Computational Physics and Python Applications · Radio Astronomy Observations and Technology