Soft-TTL: Time-Varying Fractional Caching

TL;DR

This paper introduces soft-TTL, a cache management strategy that dynamically adjusts the fraction of a file stored over time, optimizing cache efficiency based on request patterns and the hazard function of request arrivals.

Contribution

It proposes a novel time-varying fractional caching method, extending traditional TTL caches by incorporating request probability decay over time.

Findings

Soft-TTL improves cache utilization by gradually evicting file parts.

The hazard function significantly influences optimal caching strategies.

Analytical results demonstrate the effectiveness of the soft-TTL approach.

Abstract

Standard Time-to-Live (TTL) cache management prescribes the storage of entire files, or possibly fractions thereof, for a given amount of time after a request. As a generalization of this approach, this work proposes the storage of a time-varying, diminishing, fraction of a requested file. Accordingly, the cache progressively evicts parts of the file over an interval of time following a request. The strategy, which is referred to as soft-TTL, is justified by the fact that traffic traces are often characterized by arrival processes that display a decreasing, but non-negligible, probability of observing a request as the time elapsed since the last request increases. An optimization-based analysis of soft-TTL is presented, demonstrating the important role played by the hazard function of the inter-arrival request process, which measures the likelihood of observing a request as a function of the time since the most recent request.