TSGM: Regular and Irregular Time-series Generation using Score-based Generative Models
Haksoo Lim, Jaehoon Lee, Sewon Park, Minjung Kim, Noseong Park

TL;DR
This paper introduces TSGM, a score-based generative model tailored for synthesizing both regular and irregular time-series data with high diversity and quality, leveraging a novel conditional score network and denoising loss.
Contribution
The paper develops a flexible conditional score network for time-series synthesis, capable of handling both regular and irregular data with minimal modifications.
Findings
Achieves state-of-the-art diversity and quality in time-series synthesis
Successfully synthesizes both regular and irregular time-series datasets
Demonstrates superior performance over existing methods
Abstract
Score-based generative models (SGMs) have demonstrated unparalleled sampling quality and diversity in numerous fields, such as image generation, voice synthesis, and tabular data synthesis, etc. Inspired by those outstanding results, we apply SGMs to synthesize time-series by learning its conditional score function. To this end, we present a conditional score network for time-series synthesis, deriving a denoising score matching loss tailored for our purposes. In particular, our presented denoising score matching loss is the conditional denoising score matching loss for time-series synthesis. In addition, our framework is such flexible that both regular and irregular time-series can be synthesized with minimal changes to our model design. Finally, we obtain exceptional synthesis performance on various time-series datasets, achieving state-of-the-art sampling diversity and quality.
Peer Reviews
Decision·Submitted to ICLR 2024
1. The methodology and experiment are clearly written. 2. The performance of the proposed TSGM is obvious better than the previous methods in terms of time series generation.
1. The paper introduces TSGM for time series data synthesis. The paper highlights TSGM's superior performance in time series generation compared to VAEs and GANs. However, the paper's weaknesses include a lack of clear justification for the importance of time series generation, a lack of novelty in comparison to existing works, the absence of comprehensive comparisons for forecasting and imputation, and issues related to the clarity of theorems and corollaries. 2. The authors did not clarify wh
Using an RNN to encapsulate the temporal information both leverages the strengths of previous works and does not allow the leakage of future information. This is an expressive and robust way to create a temporal latent space which has the added benefit of handling data with missing samples. With this encoder/decoder and a score-based generative model, this work combines two powerful architectures to generate time series that maintain data set characteristics much better than other methods. The
## Writing The writing of this paper is very poor and may have been submitted without being reviewed by others. After reading, I left this work with a similar amount of understanding as I would get from a short high-level conversation about a colleague's project. In general, this work is quite vague. There is a large amount of detail about this work that is missing. Below are a few 1) What does this model look like? This work is centered on a model that is not described! Instead, the authors va
- The authors address an intriguing problem in their research. - The architecture and concepts appear well-aligned with the identified issues. - The empirical assessment carried out on benchmark data demonstrates the promising potential of the proposed approach.
In my view, the contribution doesn't appear to be highly innovative. The authors rely on two established models, the autoencoder and the conditional score-based approach. While this combined concept demonstrates practical efficacy, it seems more evolutionary than revolutionary. Furthermore, it's worth noting that prior works also explore the use of score-based models for time series, as evidenced in the research by Tashiro, Yusuke, et al. in "Csdi: Conditional score-based diffusion models for pr
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Time Series Analysis and Forecasting · Machine Learning in Healthcare
