DGAI: Decoupled On-Disk Graph-Based ANN Index for Efficient Updates and Queries

TL;DR

DGAI introduces a decoupled on-disk graph-based index for billion-scale ANNS, significantly enhancing update efficiency and query performance through innovative data layout and hierarchical PQ techniques.

Contribution

It proposes a novel decoupled storage architecture with co-designed query techniques, enabling efficient updates and low-latency queries in large-scale ANNS systems.

Findings

8.17x faster insertions and 8.16x faster deletions

67% reduction in peak query latency

Improved resource efficiency in large-scale ANNS

Abstract

On-disk graph-based indexes are favored for billion-scale Approximate Nearest Neighbor Search (ANNS) due to their high performance and cost-efficiency. However, existing systems typically rely on a coupled storage architecture that co-locates vectors and graph topology, which introduces substantial redundant I/O during index updates, thereby degrading usability in dynamic workloads. In this paper, we propose a decoupled storage architecture that physically separates heavy vectors from the lightweight graph topology. This design substantially improves update performance by reducing redundant I/O during updates. However, it introduces I/O amplification during ANNS, leading to degraded query efficiency.To improve query performance within the update-friendly architecture, we propose two techniques co-designed with the decoupled storage. We develop a similarity-aware dynamic layout that optimizes data placement online so that redundantly fetched data can be reused in subsequent search steps, effectively turning read amplification into useful prefetching. In addition, we propose a two-stage query mechanism enhanced by hierarchical PQ, which uses hierarchical PQ to rapidly and accurately identify promising candidates and performs exact refinement on raw vectors for only a small number of candidates. This design significantly reduces both the I/O and computational cost of the refinement stage. Overall, DGAI achieves resource-efficient updates and low-latency queries simultaneously. Experimental results demonstrate that \oursys improves update speed by 8.17x for insertions and 8.16x for deletions, while reducing peak query latency under mixed workloads by 67\% compared to state-of-the-art baselines.