Maliva: Using Machine Learning to Rewrite Visualization Queries Under Time Constraints

TL;DR

Maliva is a machine learning-based middleware that optimizes visualization query rewriting under time constraints, improving responsiveness by learning to decide when and how to approximate or hint queries.

Contribution

The paper introduces Maliva, a novel ML-driven approach using MDPs to dynamically rewrite visualization queries within time limits, enhancing interactivity.

Findings

Maliva outperforms baseline methods in query response time.

Maliva increases the probability of serving requests interactively.

The approach is effective on both real and synthetic datasets.

Abstract

We consider data-visualization systems where a middleware layer translates a frontend request to a SQL query to a backend database to compute visual results. We study the problem of answering a visualization request within a limited time constraint due to the responsiveness requirement. We explore the optimization options of rewriting an original query by adding hints and/or doing approximations so that the total time is within the time constraint. We develop a novel middleware solution called Maliva based on machine learning (ML) techniques. It applies the Markov Decision Process (MDP) model to decide how to rewrite queries and uses training instances to learn an agent to make a sequence of decisions judiciously for an online request. We give a full specification of the technique, including how to construct an MDP model, how to train an agent, and how to use approximating rewrite options. Our experiments on both real and synthetic datasets show that Maliva performs significantly better than a baseline solution that does not do any rewriting, in terms of both the probability of serving requests interactively and query execution time.