WritePolicyBench: Benchmarking Memory Write Policies under Byte Budgets

TL;DR

WritePolicyBench is a comprehensive benchmark designed to evaluate memory write policies under strict byte budgets, incorporating task generators, an action interface, a cost model, and standardized metrics for assessing success and efficiency.

Contribution

It introduces a novel benchmarking framework for memory write policies that accounts for non-stationarity, explicit memory actions, and cost-effective decision-making.

Findings

Provides a standardized evaluation platform for write policies.

Enables comparison of policies under controlled non-stationary conditions.

Facilitates optimization of memory management strategies.

Abstract

We introduce WritePolicyBench, a benchmark for evaluating memory write policies: decision rules that choose what to store, merge, and evict under a strict byte budget while processing a stream with document/API drift. The benchmark provides (i) task generators with controlled non-stationarity, (ii) an explicit action interface for external memory, (iii) a byte-accurate cost model, and (iv) standardized metrics that measure both task success and budget efficiency.