A Survey of Transformer Enabled Time Series Synthesis
Alexander Sommers, Logan Cummins, Sudip Mittal, Shahram Rahimi, Maria, Seale, Joseph Jaboure, Thomas Arnold

TL;DR
This survey reviews the emerging application of transformer-based models for time series synthesis, highlighting the current approaches, challenges, and future directions in this underexplored area of generative AI.
Contribution
It identifies the gap in applying transformers to time series generation and summarizes various methods, providing insights and recommendations for future research.
Findings
Diverse approaches including GANs, diffusion models, and autoencoders are used with transformers.
The domain is still open with no consensus on best practices.
Several promising directions and recommendations for future work are proposed.
Abstract
Generative AI has received much attention in the image and language domains, with the transformer neural network continuing to dominate the state of the art. Application of these models to time series generation is less explored, however, and is of great utility to machine learning, privacy preservation, and explainability research. The present survey identifies this gap at the intersection of the transformer, generative AI, and time series data, and reviews works in this sparsely populated subdomain. The reviewed works show great variety in approach, and have not yet converged on a conclusive answer to the problems the domain poses. GANs, diffusion models, state space models, and autoencoders were all encountered alongside or surrounding the transformers which originally motivated the survey. While too open a domain to offer conclusive insights, the works surveyed are quite suggestive,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Applications · Time Series Analysis and Forecasting · Fuzzy Logic and Control Systems
MethodsDiffusion
