Gen-DFL: Decision-Focused Generative Learning for Robust Decision Making
Prince Zizhuang Wang, Shuyi Chen, Jinhao Liang, Ferdinando Fioretto, Shixiang Zhu

TL;DR
Gen-DFL introduces a generative modeling framework to decision-focused learning, enhancing robustness and performance in high-dimensional, risk-sensitive decision-making problems by adaptively modeling uncertainty.
Contribution
It proposes a novel generative approach for decision-focused learning that improves robustness and handles complex uncertainty in optimization tasks.
Findings
Gen-DFL achieves better worst-case performance bounds.
Empirical results show strong performance on scheduling and logistics problems.
Theoretically, Gen-DFL outperforms traditional DFL in robustness.
Abstract
Decision-focused learning (DFL) integrates predictive models with downstream optimization, directly training machine learning models to minimize decision errors. While DFL has been shown to provide substantial advantages when compared to a counterpart that treats the predictive and prescriptive models separately, it has also been shown to struggle in high-dimensional and risk-sensitive settings, limiting its applicability in real-world settings. To address this limitation, this paper introduces decision-focused generative learning (Gen-DFL), a novel framework that leverages generative models to adaptively model uncertainty and improve decision quality. Instead of relying on fixed uncertainty sets, Gen-DFL learns a structured representation of the optimization parameters and samples from the tail regions of the learned distribution to enhance robustness against worst-case scenarios. This…
Peer Reviews
Decision·ICLR 2026 Poster
- The paper addresses a critical weakness of classical decision-focused learning approaches, namely the fact that the optimization models rely on a single point forecast, and addresses that weakness by using a SAA-based approach to compute a CVAR objective. - The paper provides a surrogate loss function that is then usable in a classical end-to-end learning pipeline, and quantifies the error introduced by the surrogate loss.
- The paper ignores the fact that there exist many papers that deal with contextual stochastic optimization, see e.g. the survey paper Sadaba et. al (2025) (A survey of contextual optimization methods for decision-making under uncertainty, European Journal of Operational Research, https://doi.org/10.1016/j.ejor.2024.03.020), many of them using SAA-based approaches that rely on generating samples from conditional distributions that are generated by machine learning models. - Given those approach
The topic is timely and relevant, as robust decision-making under uncertainty is a rapidly growing area at the intersection of optimization, learning, and generative modeling. The proposed framework is general and conceptually interesting—it integrates generative modeling and decision-focused optimization in a unified formulation that, in principle, could be applied across a wide range of uncertain decision-making problems. The problem setup is clearly motivated, and the generate–then–optimize s
- Limited conceptual novelty: The central idea—modeling parameter uncertainty via a generative model and optimizing CVaR—is highly similar to existing work in distributionally robust DFL and end-to-end conditional robust optimization (E2E-CRO). The paper does not clearly articulate how Gen-DFL differs from or improves upon these prior methods. - Mathematical presentation is confusing: As noted in the comments, notation is inconsistent ($p_\theta(c|x)$ vs. $q(c|x)$ in equation (7)); $w^\star$ is
It has clear empirical improvements and clear theory on generalization bounds and provides an interesting alternative method to the other formulations of DFL.
The justification of DFL versus point-wise robust methods is not theoretically clear. First, while they provide gaps between the point-prediction methods of pred-DFL and gen-DFL, first it is unclear what the \Delta R term really means. The differing definitions of regret for gen-DFL and pred-DFL make sense as one is with a regret realized by a singular cost value and the other is over a distribution of realizations. To then take the difference between these two terms is what seems a little stran
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsForecasting Techniques and Applications · Neural Networks and Applications · Bayesian Modeling and Causal Inference
