PyGraft: Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips

TL;DR

PyGraft is a Python tool that generates customizable, logically consistent synthetic schemas and knowledge graphs to enhance benchmarking and evaluation of graph-based machine learning models across diverse domains.

Contribution

The paper introduces PyGraft, a novel tool for creating highly customizable, domain-agnostic synthetic schemas and KGs with logical consistency, addressing limitations of existing datasets for benchmarking.

Findings

Generates schemas with RDFS and OWL constructs

Produces KGs that emulate real-world characteristics and scale

Ensures logical consistency with a DL reasoner

Abstract

Knowledge graphs (KGs) have emerged as a prominent data representation and management paradigm. Being usually underpinned by a schema (e.g., an ontology), KGs capture not only factual information but also contextual knowledge. In some tasks, a few KGs established themselves as standard benchmarks. However, recent works outline that relying on a limited collection of datasets is not sufficient to assess the generalization capability of an approach. In some data-sensitive fields such as education or medicine, access to public datasets is even more limited. To remedy the aforementioned issues, we release PyGraft, a Python-based tool that generates highly customized, domain-agnostic schemas and KGs. The synthesized schemas encompass various RDFS and OWL constructs, while the synthesized KGs emulate the characteristics and scale of real-world KGs. Logical consistency of the generated resources is ultimately ensured by running a description logic (DL) reasoner. By providing a way of generating both a schema and KG in a single pipeline, PyGraft's aim is to empower the generation of a more diverse array of KGs for benchmarking novel approaches in areas such as graph-based machine learning (ML), or more generally KG processing. In graph-based ML in particular, this should foster a more holistic evaluation of model performance and generalization capability, thereby going beyond the limited collection of available benchmarks. PyGraft is available at: https://github.com/nicolas-hbt/pygraft.