Comparative study of machine learning and statistical methods for automatic identification and quantification in {\gamma}-ray spectrometry

TL;DR

This study compares machine learning and statistical methods for automatic radionuclide identification and quantification in gamma-ray spectrometry using a new open-source benchmark with simulated datasets.

Contribution

It introduces a comprehensive benchmark dataset and evaluation framework for comparing analysis methods in gamma-ray spectrometry, highlighting the strengths and limitations of each approach.

Findings

Statistical approach outperforms machine learning in identification accuracy.

Statistical method is more accurate for quantification tasks.

Performance of statistical methods declines if spectral signatures are not well-modeled.

Abstract

During the last decade, a large number of different numerical methods have been proposed to tackle the automatic identification and quantification in {\gamma}-ray spectrometry. However, the lack of common benchmarks, including datasets, code and comparison metrics, makes their evaluation and comparison hard. In that context, we propose an open-source benchmark that comprises simulated datasets of various {\gamma}-spectrometry settings, codes of different analysis approaches and evaluation metrics. This allows us to compare the state-of-the-art end-to-end machine learning with a statistical unmixing approach using the full spectrum. Three scenarios have been investigated: (1) spectral signatures are assumed to be known; (2) spectral signatures are deformed due to physical phenomena such as Compton scattering and attenuation; and (3) spectral signatures are shifted (e.g., due to temperature variation). A large dataset of 200000 simulated spectra containing nine radionuclides with an experimental natural background is used for each scenario with multiple radionuclides present in the spectrum. Regarding identification performance, the statistical approach consistently outperforms the machine learning approaches across all three scenarios for all comparison metrics. However, the performance of the statistical approach can be significantly impacted when spectral signatures are not modeled correctly. Consequently, the full-spectrum statistical approach is most effective with known or well-modeled spectral signatures, while end-to-end machine learning is a good alternative when measurement conditions are uncertain for radionuclide identification. Concerning the quantification task, the statistical approach provides accurate estimates of radionuclide counting, while the machine learning methods deliver less satisfactory results.