Study on the Real-time Lossless Data Compression Method Used in the Readout System for Micro-pattern Gas Detector

TL;DR

This paper presents a real-time lossless data compression method implemented on FPGA for MPGD readout systems, significantly reducing data bandwidth while preserving all information, with compression rates up to 43%.

Contribution

It introduces a novel real-time lossless compression approach tailored for MPGD systems, combining data pre-processing and standard algorithms in FPGA hardware.

Findings

Achieved compression rates up to 43% and 30%.

Implemented in FPGA for real-time operation.

Effectively reduces data transmission bandwidth.

Abstract

The data compression technology now is fully developed and widely used in many fields such as communication, multi-media, image information processing and so on. The large physical experiments, especially the ones with Micro-pattern Gas Detectors (MPGD), which always have many readout channels and have a lot of data to be transferred and saved, are however relatively seldom use this technology. In this paper, the real-time lossless data compression method is proposed for a general-purposed MPGD readout system. The lossless data compression can reduce the data transmission bandwidth of the system as well as keep all information of the data. The compression method discussed in the paper mainly consists of two steps. The first step is to pre-process the data according to different characteristics of different signals and the second step is to compress the pre-processed data using common lossless compression algorithm. Besides, the whole compression method is implemented in the Field-Programmable Gate Array (FPGA) and able to run real-timely. The system is then used to readout two different kinds of signals and the compression rate can reach as high as 43% and 30% respectively.