CheetahGIS: Architecting a Scalable and Efficient Streaming Spatial Query Processing System

TL;DR

CheetahGIS is a scalable, efficient streaming spatial query system built on Apache Flink, designed to handle massive moving objects with optimized indexing, synchronization, and load balancing, validated through extensive experiments.

Contribution

The paper introduces CheetahGIS, a novel architecture for streaming spatial queries that leverages modular design and new optimizations for improved scalability and efficiency.

Findings

CheetahGIS achieves high scalability on large datasets.

The system effectively processes various spatial queries in real-time.

Extensive experiments demonstrate superior performance over existing solutions.

Abstract

Spatial data analytics systems are widely studied in both the academia and industry. However, existing systems are limited when handling a large number of moving objects and real time spatial queries. In this work, we architect a scalable and efficient system CheetahGIS to process streaming spatial queries over massive moving objects. In particular, CheetahGIS is built upon Apache Flink Stateful Functions (StateFun), an API for building distributed streaming applications with an actor-like model. CheetahGIS enjoys excellent scalability due to its modular architecture, which clearly decomposes different components and allows scaling individual components. To improve the efficiency and scalability of CheetahGIS, we devise a suite of optimizations, e.g., lightweight global grid-based index, metadata synchroniza tion strategies, and load balance mechanisms. We also formulate a generic paradigm for spatial query processing in CheetahGIS, and verify its generality by processing three representative streaming queries (i.e., object query, range count query, and k nearest neighbor query). We conduct extensive experiments on both real and synthetic datasets to evaluate CheetahGIS.