LITMUS: An Open Extensible Framework for Benchmarking RDF Data Management Solutions
Harsh Thakkar, Mohnish Dubey, Gezim Sejdiu, Axel-Cyrille Ngonga Ngomo,, Jeremy Debattista, Christoph Lange, Jens Lehmann, S\"oren Auer, Maria-Esther, Vidal

TL;DR
LITMUS is a flexible benchmarking framework designed to evaluate RDF data management solutions across various query languages, addressing the growing complexity of structured web data management.
Contribution
It introduces a novel, extensible architecture for benchmarking RDF data solutions across multiple query languages, surpassing traditional storage-focused frameworks.
Findings
Framework supports diverse query languages
Enables comprehensive performance analysis
Facilitates comparison of RDF data management solutions
Abstract
Developments in the context of Open, Big, and Linked Data have led to an enormous growth of structured data on the Web. To keep up with the pace of efficient consumption and management of the data at this rate, many data Management solutions have been developed for specific tasks and applications. We present LITMUS, a framework for benchmarking data management solutions. LITMUS goes beyond classical storage benchmarking frameworks by allowing for analysing the performance of frameworks across query languages. In this position paper we present the conceptual architecture of LITMUS as well as the considerations that led to this architecture.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSemantic Web and Ontologies · Advanced Database Systems and Queries · Data Quality and Management
