TimeSieve: Extracting Temporal Dynamics through Information Bottlenecks

TL;DR

TimeSieve is a novel time series forecasting model that leverages wavelet transforms and information bottleneck theory to automatically extract multi-scale features and filter redundant information, improving accuracy and generalization.

Contribution

The paper introduces TimeSieve, a new forecasting model that eliminates manual hyperparameter tuning and enhances feature selection using wavelet transforms and information bottleneck theory.

Findings

Outperforms existing methods on 70% of datasets

Achieves higher predictive accuracy

Demonstrates better generalization across diverse datasets

Abstract

Time series forecasting has become an increasingly popular research area due to its critical applications in various real-world domains such as traffic management, weather prediction, and financial analysis. Despite significant advancements, existing models face notable challenges, including the necessity of manual hyperparameter tuning for different datasets, and difficulty in effectively distinguishing signal from redundant features in data characterized by strong seasonality. These issues hinder the generalization and practical application of time series forecasting models. To solve this issues, we propose an innovative time series forecasting model TimeSieve designed to address these challenges. Our approach employs wavelet transforms to preprocess time series data, effectively capturing multi-scale features without the need for additional parameters or manual hyperparameter tuning. Additionally, we introduce the information bottleneck theory that filters out redundant features from both detail and approximation coefficients, retaining only the most predictive information. This combination reduces significantly improves the model's accuracy. Extensive experiments demonstrate that our model outperforms existing state-of-the-art methods on 70% of the datasets, achieving higher predictive accuracy and better generalization across diverse datasets. Our results validate the effectiveness of our approach in addressing the key challenges in time series forecasting, paving the way for more reliable and efficient predictive models in practical applications. The code for our model is available at https://github.com/xll0328/TimeSieve.