Elastic Sketch under Random Stationary Streams: Limiting Behavior and Near-Optimal Configuration

TL;DR

This paper analyzes the Elastic-Sketch data structure under stationary random streams, deriving limiting behavior and providing practical guidelines for parameter tuning to optimize memory-accuracy trade-offs.

Contribution

It introduces a theoretical analysis of Elastic-Sketch's limiting distribution and error under stationary streams, enabling near-optimal parameter configuration.

Findings

Derived closed-form expressions for limiting distribution and expected error.

Provided practical grid-based tuning methods for parameters.

Validated asymptotic results with simulations on Zipf-distributed data.

Abstract

Elastic-Sketch is a hash-based data structure for counting item's appearances in a data stream, and it has been empirically shown to achieve a better memory-accuracy trade-off compared to classical methods. This algorithm combines a heavy block, which aims to maintain exact counts for a small set of dynamically elected items, with a light block that implements Count-Min Sketch (CM) for summarizing the remaining traffic. The heavy block dynamics are governed by a hash function $\beta$ that hashes items into $m_1$ buckets, and an eviction threshold $\lambda$, which controls how easily an elected item can be replaced. We show that the performance of Elastic-Sketch strongly depends on the stream characteristics and the choice of $\lambda$. Since optimal parameter choices depend on unknown stream properties, we analyze Elastic-Sketch under a stationary random stream model -- a common assumption that captures the statistical regularities observed in real workloads. Formally, as the stream length goes to infinity, we derive closed-form expressions for the limiting distribution of the counters and the resulting expected counting error. These expressions are efficiently computable, enabling practical grid-based tuning of the heavy and CM blocks memory split (via $m_1$) and the eviction threshold $\lambda$. We further characterize the structure of the optimal eviction threshold, substantially reducing the search space and showing how this threshold depends on the arrival distribution. Extensive numerical simulations validate our asymptotic results on finite streams from the Zipf distribution.