An Anytime Algorithm for Decision Making under Uncertainty
Michael C. Horsch, David L. Poole

TL;DR
This paper introduces an anytime algorithm for decision-making under uncertainty that incrementally constructs policies, providing useful solutions quickly before reaching optimality, especially useful for large, complex problems.
Contribution
The paper presents a novel anytime algorithm that builds decision policies incrementally for influence diagrams, enabling early useful solutions in complex scenarios.
Findings
The algorithm produces valuable sub-optimal policies rapidly.
It converges to the optimal policy given sufficient computation time.
Effective on large decision problems with complex influence diagrams.
Abstract
We present an anytime algorithm which computes policies for decision problems represented as multi-stage influence diagrams. Our algorithm constructs policies incrementally, starting from a policy which makes no use of the available information. The incremental process constructs policies which includes more of the information available to the decision maker at each step. While the process converges to the optimal policy, our approach is designed for situations in which computing the optimal policy is infeasible. We provide examples of the process on several large decision problems, showing that, for these examples, the process constructs valuable (but sub-optimal) policies before the optimal policy would be available by traditional methods.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBayesian Modeling and Causal Inference · AI-based Problem Solving and Planning · Data Mining Algorithms and Applications
