HENN: A Hierarchical Epsilon Net Navigation Graph for Approximate Nearest Neighbor Search

TL;DR

HENN is a new hierarchical graph structure for approximate nearest neighbor search that offers strong theoretical guarantees on query time and high recall, while being practical and scalable for real-world data.

Contribution

HENN combines $ ext{ε}$-net theory with hierarchical graph design to provide provable polylogarithmic query time and high recall, addressing limitations of prior heuristic and theoretical methods.

Findings

HENN achieves faster query times than existing methods.

HENN maintains high recall across diverse and adversarial datasets.

Theoretical analysis confirms polylogarithmic worst-case query time.

Abstract

Hierarchical graph-based algorithms such as HNSW have achieved state-of-the-art performance for Approximate Nearest Neighbor (ANN) search in practice, yet they often lack theoretical guarantees on query time or recall due to their heavy use of randomized heuristic constructions. Conversely, existing theoretically grounded structures are typically difficult to implement and struggle to scale in real-world scenarios. We propose the Hierarchical $\varepsilon$-Net Navigation Graph (HENN), a novel graph-based indexing structure for ANN search that combines strong theoretical guarantees with practical efficiency. Built upon the theory of $\varepsilon$-nets, HENN guarantees polylogarithmic worst-case query time while preserving high recall and incurring minimal implementation overhead. Moreover, we establish a probabilistic polylogarithmic query time bound for HNSW, providing theoretical insight into its empirical success. In contrast to these prior hierarchical methods that may degrade to linear query time under adversarial data, HENN maintains provable performance independent of the input data distribution. Empirical evaluations demonstrate that HENN achieves faster query time while maintaining competitive recall on diverse data distributions, including adversarial inputs. These results underscore the effectiveness of HENN as a robust and scalable solution for fast and accurate nearest neighbor search.