Development of an Astrophysical Specific Language for Big Data Computation

TL;DR

The paper introduces a specialized programming language and middleware system tailored for astrophysical big data computation, aiming to optimize resources, manage heterogeneous software, and facilitate data transfer in astronomy projects.

Contribution

It presents a novel modular middleware and a domain-specific language designed specifically for astrophysical data analysis, improving efficiency and usability.

Findings

Developed a middleware system for astrophysical data analysis

Created a domain-specific language for astrophysics computations

Implemented a cross-matching service for astronomical data

Abstract

Astronomy is entering in a new era of Extreme Intensive Data Computation and we have identified three major issues the new generation of projects have to face: Resource optimization, Heterogeneous Software Ecosystem and Data Transfer. We propose in this article a middleware solution offering a very modular and maintainable system for data analysis. As computations must be designed and described by specialists in astronomy, we aim at defining a friendly specific programming language to enable coding of astrophysical problems abstracted from any computer science specific issues. This way we expect substantial benefits in computing capabilities in data analysis. As a first development using our solution, we propose a cross-matching service for the Taiwan Extragalactic Astronomical Data Center.