SageFormer: Series-Aware Framework for Long-term Multivariate Time Series Forecasting
Zhenwei Zhang, Linghang Meng, Yuantao Gu

TL;DR
SageFormer is a novel series-aware Transformer framework that effectively models inter-series dependencies in long-term multivariate time series forecasting, outperforming existing methods.
Contribution
The paper introduces SageFormer, a graph-enhanced Transformer that explicitly captures inter-series relationships, addressing a key gap in long-term multivariate time series forecasting.
Findings
SageFormer achieves superior forecasting accuracy on real-world datasets.
The framework effectively models complex inter-series dependencies.
Experimental results outperform state-of-the-art methods.
Abstract
In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS forecasting requires adept models capable of capturing both intra- and inter-series dependencies. Recent advancements in deep learning, notably Transformers, have shown promise. However, many prevailing methods either marginalize inter-series dependencies or overlook them entirely. To bridge this gap, this paper introduces a novel series-aware framework, explicitly designed to emphasize the significance of such dependencies. At the heart of this framework lies our specific implementation: the SageFormer. As a Series-aware Graph-enhanced Transformer model, SageFormer proficiently discerns and models the intricate relationships between series using…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTime Series Analysis and Forecasting · Data Visualization and Analytics · Data Stream Mining Techniques
MethodsMulti-Head Attention · Attention Is All You Need · Matching The Statements · Layer Normalization · Absolute Position Encodings · Byte Pair Encoding · Linear Layer · Label Smoothing · Adam · Position-Wise Feed-Forward Layer
