Discriminating chaotic and stochastic time series using permutation entropy and artificial neural networks

TL;DR

This paper introduces a novel method combining permutation entropy and neural networks to distinguish chaotic signals from stochastic ones, effectively quantifying temporal correlations in complex systems.

Contribution

The authors develop a new technique that uses symbolic ordinal analysis and neural networks to differentiate chaos from stochasticity in time series data.

Findings

The method accurately classifies synthetic and real signals.

It is robust to noise and varying time series lengths.

The approach effectively quantifies nonlinear correlations.

Abstract

Extracting relevant properties of empirical signals generated by nonlinear, stochastic, and high-dimensional systems is a challenge of complex systems research. Open questions are how to differentiate chaotic signals from stochastic ones, and how to quantify nonlinear and/or high-order temporal correlations. Here we propose a new technique to reliably address both problems. Our approach follows two steps: first, we train an artificial neural network (ANN) with flicker (colored) noise to predict the value of the parameter, $\alpha$, that determines the strength of the correlation of the noise. To predict $\alpha$ the ANN input features are a set of probabilities that are extracted from the time series by using symbolic ordinal analysis. Then, we input to the trained ANN the probabilities extracted from the time series of interest, and analyze the ANN output. We find that the $\alpha$ value returned by the ANN is informative of the temporal correlations present in the time series. To distinguish between stochastic and chaotic signals, we exploit the fact that the difference between the permutation entropy (PE) of a given time series and the PE of flicker noise with the same $\alpha$ parameter is small when the time series is stochastic, but it is large when the time series is chaotic. We validate our technique by analysing synthetic and empirical time series whose nature is well established. We also demonstrate the robustness of our approach with respect to the length of the time series and to the level of noise. We expect that our algorithm, which is freely available, will be very useful to the community.