Towards Efficient Data Structures for Approximate Search with Range Queries

TL;DR

This paper introduces a new data structure called c-DAG that improves approximate range search efficiency by reducing false positives logarithmically while maintaining similar time and memory complexity as traditional trees.

Contribution

The paper proposes a c-DAG structure that enhances approximate range search by decreasing false positives and provides a theoretical and empirical analysis of its advantages over 1D-Tree.

Findings

c-DAG reduces false positives logarithmically compared to 1D-Tree

The time and memory complexity of c-DAG remains asymptotically similar to 1D-Tree

Empirical results on Gowalla dataset demonstrate effectiveness of c-DAG

Abstract

Range queries are simple and popular types of queries used in data retrieval. However, extracting exact and complete information using range queries is costly. As a remedy, some previous work proposed a faster principle, {\em approximate} search with range queries, also called single range cover (SRC) search. It can, however, produce some false positives. In this work we introduce a new SRC search structure, a $c$-DAG (Directed Acyclic Graph), which provably decreases the average number of false positives by logarithmic factor while keeping asymptotically same time and memory complexities as a classic tree structure. A $c$-DAG is a tunable augmentation of the 1D-Tree with denser overlapping branches ($c \geq 3$ children per node). We perform a competitive analysis of a $c$-DAG with respect to 1D-Tree and derive an additive constant time overhead and a multiplicative logarithmic improvement of the false positives ratio, on average. We also provide a generic framework to extend our results to empirical distributions of queries, and demonstrate its effectiveness for Gowalla dataset. Finally, we quantify and discuss security and privacy aspects of SRC search on $c$-DAG vs 1D-Tree, mainly mitigation of structural leakage, which makes $c$-DAG a good data structure candidate for deployment in privacy-preserving systems (e.g., searchable encryption) and multimedia retrieval.