Generalization of LRU Cache Replacement Policy with Applications to Video Streaming

TL;DR

This paper introduces gLRU, an adaptation of LRU for asymmetric file sizes, with novel analysis and significant performance improvements in caching and video streaming applications.

Contribution

It proposes gLRU, a new cache replacement policy for partial files, with a novel approximation analysis validated by simulations and real-world data.

Findings

gLRU outperforms LRU for Zipf and Pareto distributions.

Significant reduction (32%) in stall duration for video streaming.

gLRU compares favorably to other cache policies on real traces.

Abstract

Caching plays a crucial role in networking systems to reduce the load on the network and is commonly employed by content delivery networks (CDNs) in order to improve performance. One of the commonly used mechanisms, Least Recently Used (LRU), works well for identical file sizes. However, for asymmetric file sizes, the performance deteriorates. This paper proposes an adaptation to the LRU strategy, called gLRU, where the file is sub-divided into equal-sized chunks. In this strategy, a chunk of the newly requested file is added in the cache, and a chunk of the least-recently-used file is removed from the cache. Even though approximate analysis for the hit rate has been studied for LRU, the analysis does not extend to gLRU since the metric of interest is no longer the hit rate as the cache has partial files. This paper provides a novel approximation analysis for this policy where the cache may have partial file contents. The approximation approach is validated by simulations. Further, gLRU outperforms the LRU strategy for a Zipf file popularity distribution and censored Pareto file size distribution for the file download times. Video streaming applications can further use the partial cache contents to help the stall duration significantly, and the numerical results indicate significant improvements (32\%) in stall duration using the gLRU strategy as compared to the LRU strategy. Furthermore, the gLRU replacement policy compares favorably to two other cache replacement policies when simulated on MSR Cambridge Traces obtained from the SNIA IOTTA repository.