Transformer models as an efficient replacement for statistical test suites to evaluate the quality of random numbers

TL;DR

This paper introduces a Transformer-based deep learning model that efficiently performs multiple statistical tests simultaneously to validate random number generators, offering a faster alternative to traditional methods.

Contribution

The work presents the first Transformer model capable of multi-test validation of random numbers, outperforming LSTM models in speed while maintaining high accuracy.

Findings

Achieved Macro F1-score above 0.96 in test accuracy.

Model runs significantly faster than traditional statistical test suites.

Comparable performance to LSTM models with improved efficiency.

Abstract

Random numbers are incredibly important in a variety of fields, and the need for their validation remains important for safety. A Quantum Random Number Generator (QRNG) can theoretically generate truly random numbers, however their quality still needs to be thoroughly validated. Generally, the task of validating random numbers has been delegated to different statistical tests such as the tests from the NIST Statistical Test Suite (STS), which are often slow and only perform one test at a time. Our work presents a deep learning model utilizing the Transformer architecture that 1) performs multiple NIST STS tests at once, and 2) runs much faster. This model outputs multi-label classification results on passing these statistical tests. We performed a thorough hyper-parameter optimization to converge on the best possible model and as a result, achieved a high degree of accuracy with a Macro F1-score of above 0.96. We also compared this model to a conventional deep learning method (Long Short Term Memory Recurrent Neural Networks) to quantify randomness and showed our model achieved similar performances while being much more efficient and scalable. The high performance and efficiency of this Transformer-based deep learning model showed that it can be a viable replacement for the NIST STS for validating random numbers.