Learned Indexes with Distribution Smoothing via Virtual Points

TL;DR

This paper introduces a novel distribution smoothing technique using virtual points to enhance learned indexes, significantly improving query performance especially for challenging key regions with minimal additional storage.

Contribution

The paper proposes a distribution smoothing method with virtual points and an algorithm CSV to improve learned index accuracy and efficiency without structural changes.

Findings

Significant query performance improvements observed.

Enhanced accuracy for difficult key regions.

Low additional storage overhead.

Abstract

Recent research on learned indexes has created a new perspective for indexes as models that map keys to their respective storage locations. These learned indexes are created to approximate the cumulative distribution function of the key set, where using only a single model may have limited accuracy. To overcome this limitation, a typical method is to use multiple models, arranged in a hierarchical manner, where the query performance depends on two aspects: (i) traversal time to find the correct model and (ii) search time to find the key in the selected model. Such a method may cause some key space regions that are difficult to model to be placed at deeper levels in the hierarchy. To address this issue, we propose an alternative method that modifies the key space as opposed to any structural or model modifications. This is achieved through making the key set more learnable (i.e., smoothing the distribution) by inserting virtual points. Furthermore, we develop an algorithm named CSV to integrate our virtual point insertion method into existing learned indexes, reducing both their traversal and search time. We implement CSV on state-of-the-art learned indexes and evaluate them on real-world datasets. Extensive experimental results show significant query performance improvement for the keys in deeper levels of the index structures at a low storage cost.