SQUASH: Serverless and Distributed Quantization-based Attributed Vector Similarity Search

TL;DR

SQUASH is a novel fully serverless vector similarity search system that efficiently supports hybrid queries, achieves high accuracy, reduces costs, and outperforms existing solutions through innovative storage, pruning, and invocation techniques.

Contribution

It introduces SQUASH, the first fully serverless vector search system with hybrid query support, optimized quantization, and a multi-level pruning workflow for improved performance and cost-efficiency.

Findings

Significant performance improvements over state-of-the-art solutions

Lower operational costs in serverless environments

Effective hybrid query support with high accuracy

Abstract

Vector similarity search presents significant challenges in terms of scalability for large and high-dimensional datasets, as well as in providing native support for hybrid queries. Serverless computing and cloud functions offer attractive benefits such as elasticity and cost-effectiveness, but are difficult to apply to data-intensive workloads. Jointly addressing these two main challenges, we present SQUASH, the first fully serverless vector search solution with rich support for hybrid queries. It features OSQ, an optimized and highly parallelizable quantization-based approach for vectors and attributes. Its segment-based storage mechanism enables significant compression in resource-constrained settings and offers efficient dimensional extraction operations. SQUASH performs a single distributed pass to guarantee the return of sufficiently many vectors satisfying the filter predicate, achieving high accuracy and avoiding redundant computation for vectors which fail the predicate. A multi-level search workflow is introduced to prune most vectors early to minimize the load on Function-as-a-Service (FaaS) instances. SQUASH is designed to identify and utilize retention of relevant data in re-used runtime containers, which eliminates redundant I/O and reduces costs. Finally, we demonstrate a new tree-based method for rapid FaaS invocation, enabling the bi-directional flow of data via request/response payloads. Experiments comparing SQUASH with state-of-the-art serverless vector search solutions and server-based baselines on vector search benchmarks confirm significant performance improvements at a lower cost.