STREAK: An Efficient Engine for Processing Top-k SPARQL Queries with Spatial Filters

TL;DR

Streak is a novel RDF engine optimized for processing complex top-k SPARQL queries with spatial filters, offering scalable performance on large geo-spatial datasets through innovative indexing and adaptive query processing.

Contribution

The paper introduces Streak, a comprehensive RDF system with novel spatial indexing and query strategies, enabling efficient handling of complex spatial SPARQL queries at scale.

Findings

Streak outperforms Virtuoso and PostgreSQL in top-k spatial join queries.

The system scales to large datasets like Yago3 and LinkedGeoData.

Innovative index and encoding strategies improve query efficiency.

Abstract

The importance of geo-spatial data in critical applications such as emergency response, transportation, agriculture etc., has prompted the adoption of recent GeoSPARQL standard in many RDF processing engines. In addition to large repositories of geo-spatial data -- e.g., LinkedGeoData, OpenStreetMap, etc. -- spatial data is also routinely found in automatically constructed knowledgebases such as Yago and WikiData. While there have been research efforts for efficient processing of spatial data in RDF/SPARQL, very little effort has gone into building end-to-end systems that can holistically handle complex SPARQL queries along with spatial filters. In this paper, we present Streak, a RDF data management system that is designed to support a wide-range of queries with spatial filters including complex joins, top-k, higher-order relationships over spatially enriched databases. Streak introduces various novel features such as a careful identifier encoding strategy for spatial and non-spatial entities, the use of a semantics-aware Quad-tree index that allows for early-termination and a clever use of adaptive query processing with zero plan-switch cost. We show that Streak can scale to some of the largest publicly available semantic data resources such as Yago3 and LinkedGeoData which contain spatial entities and quantifiable predicates useful for result ranking. For experimental evaluations, we focus on top-k distance join queries and demonstrate that Streak outperforms popular spatial join algorithms as well as state of the art end-to-end systems like Virtuoso and PostgreSQL.