LITMUS: An Open Extensible Framework for Benchmarking RDF Data Management Solutions

TL;DR

LITMUS is a flexible benchmarking framework designed to evaluate RDF data management solutions across various query languages, addressing the growing complexity of structured web data management.

Contribution

It introduces a novel, extensible architecture for benchmarking RDF data solutions across multiple query languages, surpassing traditional storage-focused frameworks.

Findings

Framework supports diverse query languages

Enables comprehensive performance analysis

Facilitates comparison of RDF data management solutions

Abstract

Developments in the context of Open, Big, and Linked Data have led to an enormous growth of structured data on the Web. To keep up with the pace of efficient consumption and management of the data at this rate, many data Management solutions have been developed for specific tasks and applications. We present LITMUS, a framework for benchmarking data management solutions. LITMUS goes beyond classical storage benchmarking frameworks by allowing for analysing the performance of frameworks across query languages. In this position paper we present the conceptual architecture of LITMUS as well as the considerations that led to this architecture.