TL;DR
The paper introduces the Global Benchmark Database (GBD), a comprehensive tool suite for managing benchmark instances and metadata, supporting empirical research and solver selection.
Contribution
It presents the data model, interfaces, and extension capabilities of GBD, enabling integration of custom data sources and problem domains.
Findings
Provides a flexible data model for benchmark metadata
Demonstrates integration of custom data sources
Supports extension to new problem domains
Abstract
This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
