Jelly-Patch: a Fast Format for Recording Changes in RDF Datasets

TL;DR

Jelly-Patch is a new binary serialization format for RDF dataset changes that significantly improves compression and processing speed, enhancing performance in large-scale, low-latency RDF applications.

Contribution

The paper introduces Jelly-Patch, a high-performance, compressed binary format for RDF changes, outperforming existing formats in speed and compression.

Findings

Achieves 3.5--8.9x better compression

Up to 2.5x higher serialization throughput

Up to 4.6x faster parsing

Abstract

Recording data changes in RDF systems is a crucial capability, needed to support auditing, incremental backups, database replication, and event-driven workflows. In large-scale and low-latency RDF applications, the high volume and frequency of updates can cause performance bottlenecks in the serialization and transmission of changes. To alleviate this, we propose Jelly-Patch -- a high-performance, compressed binary serialization format for changes in RDF datasets. To evaluate its performance, we benchmark Jelly-Patch against existing RDF Patch formats, using two datasets representing different use cases (change data capture and IoT streams). Jelly-Patch is shown to achieve 3.5--8.9x better compression, and up to 2.5x and 4.6x higher throughput in serialization and parsing, respectively. These significant advancements in throughput and compression are expected to improve the performance of large-scale and low-latency RDF systems.