A Comprehensive Survey of Deep Learning for Time Series Forecasting: Architectural Diversity and Open Challenges

TL;DR

This survey reviews the evolution and diversification of deep learning architectures for time series forecasting, highlighting recent trends, challenges, and the potential of hybrid and emerging models.

Contribution

It provides a comprehensive analysis of architectural diversity in deep learning for TSF and discusses open challenges, offering new insights and perspectives for researchers.

Findings

Transformers excel at long-term dependencies but can be outperformed by simple linear models.

Diverse architectures, including hybrid and foundation models, are gaining attention in TSF.

Open challenges include channel dependency, distribution shift, and causality understanding.

Abstract

Time series forecasting is a critical task that provides key information for decision-making. After traditional statistical and machine learning approaches, various fundamental deep learning architectures such as MLPs, CNNs, RNNs, and GNNs have been developed. However, the structural limitations caused by the inductive biases of each deep learning architecture constrained their performance. Transformer models, which excel at handling long-term dependencies, have become significant architectural components for time series forecasting. However, recent research has shown that alternatives such as simple linear layers can outperform Transformers. These findings have opened up new possibilities for using diverse architectures, ranging from fundamental deep learning models to emerging architectures and hybrid approaches. In this context, architectural modeling of time series forecasting has now entered a renaissance. This survey not only provides a historical context for time series forecasting but also offers comprehensive and timely analysis of the movement toward architectural diversification. By comparing and re-examining deep learning models, we uncover new perspectives and present recent trends, including hybrid, diffusion, Mamba, and foundation models. By focusing on the inherent characteristics of time series data, we also address open challenges that have gained attention in time series forecasting, such as channel dependency, distribution shift, causality, and feature extraction. These contributions help lower entry barriers for newcomers by providing a systematic understanding of the diverse research areas in time series forecasting (TSF), while offering seasoned researchers broader perspectives and new opportunities through in-depth exploration of TSF challenges. (Shortened due to arXiv's 1,920-character limit. Full version in the paper.)