A simple noise reduction method based on nonlinear forecasting

TL;DR

This paper introduces a straightforward nonlinear forecasting-based noise reduction method for multivariate time series, addressing limitations of traditional subjective detrending techniques and demonstrating its effectiveness on various simulated and real data.

Contribution

The paper proposes a novel multivariate noise reduction method based on nonlinear forecasting, improving upon existing state space reconstruction techniques with a simple extension for multivariate data.

Findings

Effective noise reduction demonstrated on simulated data from Van der Pol oscillator, Lorenz system, and neuronal models.

Objective optimization of detrending heuristics using in-sample forecasting errors.

Method applicable to real-world data, exemplified by measles case study.

Abstract

Non-parametric detrending or noise reduction methods are often employed to separate trends from noisy time series when no satisfactory models exist to fit the data. However, conventional detrending methods depend on subjective choices of detrending parameters. Here, we present a simple multivariate detrending method based on available nonlinear forecasting techniques. These are in turn based on state space reconstruction for which a strong theoretical justification exists for their use in non-parametric forecasting. The detrending method presented here is conceptually similar to Schreiber's noise reduction method using state space reconstruction. However, we show that Schreiber's method contains a minor flaw that can be overcome with forecasting. Furthermore, our detrending method contains a simple but nontrivial extension to multivariate time series. We apply the detrending method to multivariate time series generated from the Van der Pol oscillator, the Lorenz equations, the Hindmarsh-Rose model of neuronal spiking activity, and a univariate real-life measles data set. It is demonstrated that detrending heuristics can be objectively optimized with in-sample forecasting errors that correlate well with actual detrending errors.