PLANSIEVE: Real-time Suboptimal Query Plan Detection Through Incremental Refinements
Asoke Datta, Yesdaulet Izenov, Brian Tsan, Abylay Amanbayev, Florin, Rusu

TL;DR
PLANSIEVE is a real-time framework that detects sub-optimal query plans during optimization by analyzing and incrementally refining cardinality estimates, significantly improving plan quality prediction accuracy.
Contribution
It introduces a novel real-time detection method that refines cardinality estimates during query optimization, unlike previous post-execution analysis approaches.
Findings
Achieves up to 88.7% accuracy in predicting sub-optimal plans.
Operates with surrogate cardinalities from third-party estimators.
Effectively refines estimates during query processing.
Abstract
Cardinality estimation remains a fundamental challenge in query optimization, often resulting in sub-optimal execution plans and degraded performance. While errors in cardinality estimation are inevitable, existing methods for identifying sub-optimal plans -- such as metrics like Q-error, P-error, or L1-error -- are limited to post-execution analysis, requiring complete knowledge of true cardinalities and failing to prevent the execution of sub-optimal plans in real-time. This paper introduces PLANSIEVE, a novel framework that identifies sub-optimal plans during query optimization. PLANSIEVE operates by analyzing the relative order of sub-plans generated by the optimizer based on estimated and true cardinalities. It begins with surrogate cardinalities from any third-party estimator and incrementally refines these surrogates as the system processes more queries. Experimental results on…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCloud Computing and Resource Management · Parallel Computing and Optimization Techniques · Web Data Mining and Analysis
