SQUID: Faster Analytics via Sampled Quantile Estimation

TL;DR

SQUID introduces a sampling-based quantile estimation method that accelerates large-scale streaming analytics, improves heavy hitter detection accuracy, and enhances network caching policies with practical hardware implementation.

Contribution

The paper presents SQUID, a novel sampling approach for quantile estimation that improves speed and accuracy in streaming analytics and enables advanced caching policies in hardware.

Findings

Up to 6.6x faster software performance compared to state-of-the-art methods.

Enhanced accuracy in weighted heavy hitter detection.

Achieves higher cache hit ratios than existing policies in hardware experiments.

Abstract

Streaming algorithms are fundamental in the analysis of large and online datasets. A key component of many such analytic tasks is $q$-MAX, which finds the largest $q$ values in a number stream. Modern approaches attain a constant runtime by removing small items in bulk and retaining the largest $q$ items at all times. Yet, these approaches are bottlenecked by an expensive quantile calculation. This work introduces a quantile-sampling approach called SQUID and shows its benefits in multiple analytic tasks. Using this approach, we design a novel weighted heavy hitters data structure that is faster and more accurate than the existing alternatives. We also show SQUID's practicality for improving network-assisted caching systems with a hardware-based cache prototype that uses SQUID to implement the cache policy. The challenge here is that the switch's dataplane does not allow the general computation required to implement many cache policies, while its CPU is orders of magnitude slower. We overcome this issue by passing just SQUID's samples to the CPU, thus bridging this gap. In software implementations, we show that our method is up to 6.6x faster than the state-of-the-art alternatives when using real workloads. For switch-based caching, SQUID enables a wide spectrum of data-plane-based caching policies and achieves higher hit ratios than the state-of-the-art P4LRU.