Semantically-Guided Inference for Conditional Diffusion Models: Enhancing Covariate Consistency in Time Series Forecasting
Rui Ding, Hanyang Meng, Zeyang Zhang, Jielong Yang

TL;DR
This paper introduces SemGuide, a versatile inference-time technique that improves covariate consistency in conditional diffusion models for time series forecasting, leading to better alignment and accuracy.
Contribution
SemGuide is a novel, model-agnostic inference method that enhances semantic alignment in conditional diffusion models without retraining, using a scoring network and importance reweighting.
Findings
Improves covariate alignment in time series forecasts.
Enhances predictive accuracy under complex conditions.
Compatible with any conditional diffusion model.
Abstract
Diffusion models have demonstrated strong performance in time series forecasting, yet often suffer from semantic misalignment between generated trajectories and conditioning covariates, especially under complex or multimodal conditions. To address this issue, we propose SemGuide, a plug-and-play, inference-time method that enhances covariate consistency in conditional diffusion models. Our approach introduces a scoring network to assess the semantic alignment between intermediate diffusion states and future covariates. These scores serve as proxy likelihoods in a stepwise importance reweighting procedure, which progressively adjusts the sampling path without altering the original training process. The method is model-agnostic and compatible with any conditional diffusion framework. Experiments on real-world forecasting tasks show consistent gains in both predictive accuracy and…
Peer Reviews
Decision·ICLR 2026 Conference Withdrawn Submission
**Non-Invasive**: It operates only at inference time, requiring no retraining or architectural changes to the base model. **Model-agnostic design**: The plug-and-play nature means SemGuide can be applied to any pre-trained conditional diffusion model without retraining.
**Reliance on Score Network Design**: The effectiveness of the scoring network, which is trained on positive and negative pairs, may be highly sensitive to the quality and diversity of these pairs. The paper does not analyze the robustness of the method to different design choices or potential limitations of the score network. **Limited Empirical Validation**: The empirical evaluation is restricted to a single domain (electricity price forecasting), albeit across five markets. The work lacks va
- The results improve consistently on the MSE and MAE. - The idea of using a score network to distinguish which samples are reasonable and which are not is interesting.
- There is no background section. Diffusion models are introduced in their methodology section without citing the corresponding papers. These works should be cited accordingly and not only in the introduction. - The related work section is missing many important references from the diffusion, conditional generation, and time series domains. - The notation is inconsistent and makes it hard to follow the method section. The subscript is used to describe both the diffusion time and the temporal dim
1. Identifying a real, understudied problem in conditional diffusion models involving future covariate conditioned time series forecasting 2. Attempting to propose model-agnostic solution that doesn't require retraining of the backbone diffusion models 3. In limited experiments, sampling efficiency is shown (though there are issues as listed below) 4. Figure 1 is well-made, and the algorithms are clearly explained. The experiment setup is also well written.
1. The first major weakness is the weak experimental support for the major claims. The method is only tested on electricity price forecasting (EPF) dataset. No evaluation on other time series domains (weather, traffic, healthcare, finance) used in the TSF community is shown to demonstrate generalizability. Forecast length of hourly price for day ahead (24) is only used, severely limiting the demonstration of the claims. 2. Despite the core contribution being semantic alignment, there's no quant
see summary
see summary
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMachine Learning in Healthcare · Forecasting Techniques and Applications · Stock Market Forecasting Methods
