DBTuneSuite: An Extendible Experimental Suite to Test the Time Performance of Multi-layer Tuning Options on Database Management Systems

TL;DR

DBTuneSuite is an extendible experimental framework that evaluates the performance of popular database systems under various tuning options and workloads, providing insights for system optimization and comparison.

Contribution

It introduces a flexible suite of experiments with scripts and guidelines to test and compare tuning effects across multiple database systems.

Findings

Tuning options can significantly affect performance differently across systems

The suite helps identify the best system for specific query types

Quantitative evidence of tuning impacts on database performance

Abstract

DBTuneSuite is a suite of experiments on four widely deployed free database systems to test their performance under various query/upsert loads and under various tuning options. The suite provides: (i) scripts to generate data and to install and run tests, making it expandable to other tests and systems; (ii) suggestions of which systems work best for which query types; and (iii) quantitative evidence that tuning options widely used in practice can behave very differently across systems. This paper is most useful for database system engineers, advanced database users and troubleshooters, and students.