Standardised formats and open-source analysis tools for the MAGIC telescopes data

TL;DR

This paper introduces the first standardized gamma-ray data format for MAGIC telescopes, demonstrating its compatibility with open-source analysis tools and enabling public data sharing for gamma-ray astronomy.

Contribution

It presents the conversion of MAGIC telescope data into a standardized format, validated analysis with open-source software, and the implementation of an automated pipeline for data reduction.

Findings

Standardized data is compatible with MAGIC proprietary software.

Open-source analysis yields results consistent with proprietary software.

First large public release of MAGIC gamma-ray data.

Abstract

Instruments for gamma-ray astronomy at Very High Energies ($E>100\,{\rm GeV}$) have traditionally derived their scientific results through proprietary data and software. Data standardisation has become a prominent issue in this field both as a requirement for the dissemination of data from the next generation of gamma-ray observatories and as an effective solution to realise public data legacies of current-generation instruments. Specifications for a standardised gamma-ray data format have been proposed as a community effort and have already been successfully adopted by several instruments. We present the first production of standardised data from the Major Atmospheric Gamma-ray Imaging Cherenkov (MAGIC) telescopes. We converted $166\,{\rm h}$ of observations from different sources and validated their analysis with the open-source software Gammapy. We consider six data sets representing different scientific and technical analysis cases and compare the results obtained analysing the standardised data with open-source software against those produced with the MAGIC proprietary data and software. Aiming at a systematic production of MAGIC data in this standardised format, we also present the implementation of a database-driven pipeline automatically performing the MAGIC data reduction from the calibrated down to the standardised data level. In all the cases selected for the validation, we obtain results compatible with the MAGIC proprietary software, both for the manual and for the automatic data productions. Part of the validation data set is also made publicly available, thus representing the first large public release of MAGIC data. This effort and this first data release represent a technical milestone toward the realisation of a public MAGIC data legacy.