Database Benchmarks

TL;DR

This paper reviews major types of database benchmarks, focusing on XML and decision-support benchmarks, discussing their issues, tradeoffs, and future trends in database performance evaluation.

Contribution

It provides a comprehensive overview of current database benchmarks and highlights recent innovations in XML and decision-support benchmarking tools.

Findings

XML benchmarks are increasingly important for data exchange.

Decision-support benchmarks are evolving to handle larger datasets.

Tradeoffs exist between benchmark complexity and realism.

Abstract

The aim of this article is to present an overview of the major families of state-of-the-art data-base benchmarks, namely: relational benchmarks, object and object-relational benchmarks, XML benchmarks, and decision-support benchmarks, and to discuss the issues, tradeoffs and future trends in database benchmarking. We particularly focus on XML and decision-support benchmarks, which are currently the most innovative tools that are developed in this area.