Challenging the challenge: handling data in the Gigabit/s range

TL;DR

This paper discusses the ALICE Data Challenge at CERN, focusing on handling high data rates exceeding 300 MB/s for event building and data recording in the context of the ALICE experiment's demanding requirements.

Contribution

It reviews the evolution and current status of ALICE Data Challenges, highlighting achievements in sustained high-rate data recording and the development of new data handling technologies.

Findings

Recorded streams exceeding 300 MB/s in 2002

Successful simulation of detector data transfer to media

Progress in high-rate data acquisition technologies

Abstract

The ALICE experiment at CERN will propose unprecedented requirements for event building and data recording. New technologies will be adopted as well as ad-hoc frameworks, from the acquisition of experimental data up to the transfer onto permanent media and its later access. These issues justify a careful, in-depth planning and preparation. The ALICE Data Challenge is a very important step of this development process where simulated detector data is moved from dummy data sources up to the recording media using processing elements and data-paths as realistic as possible. We will review herein the current status of past, present and future ALICE Data Challenges, with particular reference to the sessions held in 2002 when - for the first time - streams worth one week of ALICE data were recorded onto tape media at sustained rates exceeding 300 MB/s.