Lightweight Robust Size Aware Cache Management
Gil Einziger, Ohad Eytan, Roy Friedman, Benjamin Manes

TL;DR
This paper introduces a simple, efficient extension of the TinyLFU cache policy to manage variable-sized objects, achieving comparable or better cache performance with significantly lower computational overhead.
Contribution
It presents a lightweight, easy-to-implement size-aware cache management algorithm that outperforms complex existing methods in both efficiency and effectiveness.
Findings
Achieves higher hit and byte hit ratios than state-of-the-art algorithms.
Imposes up to three times lower CPU overhead.
Requires only minor modifications to existing caching libraries.
Abstract
Modern key-value stores, object stores, Internet proxy caches, as well as Content Delivery Networks (CDN) often manage objects of diverse sizes, e.g., blobs, video files of different lengths, images with varying resolution, and small documents. In such workloads, size-aware cache policies outperform size-oblivious algorithms. Unfortunately, existing size-aware algorithms tend to be overly complicated and computationally~expensive. Our work follows a more approachable pattern; we extend the prevalent (size-oblivious) TinyLFU cache admission policy to handle variable sized items. Implementing our approach inside two popular caching libraries only requires minor changes. We show that our algorithms yield competitive or better hit-ratios and byte hit-ratios compared to the state of the art size-aware algorithms such as AdaptSize, LHD, LRB, and GDSF. Further, a runtime comparison indicates…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCaching and Content Delivery · Advanced Data Storage Technologies · Recommender Systems and Techniques
