Towards an Application-Centric Benchmark Suite for Spatiotemporal Database Systems

TL;DR

This paper advocates for an application-centric benchmark suite tailored for spatiotemporal database systems, addressing the lack of comprehensive evaluation tools for mobility-based applications amid growing IoT data.

Contribution

It identifies key requirements, discusses domain-specific challenges, and proposes a modular architecture for a new benchmark suite for spatiotemporal databases.

Findings

Highlights the need for comprehensive benchmarking in spatiotemporal databases

Proposes a modular architecture for the benchmark suite

Addresses domain-specific challenges in benchmarking

Abstract

Spatiotemporal data play a key role for mobility-based applications and are their produced volume is growing continuously, among others, due to the increased availability of IoT devices. When working with spatiotemporal data, developers rely on spatiotemporal database systems such as PostGIS or MobilityDB. For better understanding their quality of service behavior and then choosing the best system, benchmarking is the go-to approach. Unfortunately, existing work in this field studies only small isolated aspects and a comprehensive application-centric benchmark suite is still missing. In this paper, we argue that an application-centric benchmark suite for spatiotemporal database systems is urgently needed. We identify requirements for such a benchmark suite, discuss domain-specific challenges, and sketch-out the architecture of a modular benchmarking suite.