CBP: Coordinated management of cache partitioning, bandwidth partitioning and prefetch throttling

TL;DR

CBP is a dynamic coordination mechanism that manages cache, bandwidth, and prefetching to reduce memory access time and enhance multi-core system performance, outperforming existing techniques.

Contribution

It introduces CBP, the first coordinated management system for cache, bandwidth, and prefetching, enabling better resource trade-offs during workload consolidation.

Findings

CBP improves performance by 11% over state-of-the-art.

CBP achieves 50% higher performance than baseline.

Coordination of resources yields significant performance gains.

Abstract

Reducing the average memory access time is crucial for improving the performance of applications running on multi-core architectures. With workload consolidation this becomes increasingly challenging due to shared resource contention. Techniques for partitioning of shared resources - cache and bandwidth - and prefetching throttling have been proposed to mitigate contention and reduce the average memory access time. However, existing proposals only employ a single or a subset of these techniques and are therefore not able to exploit the full potential of coordinated management of cache, bandwidth and prefetching. Our characterization results show that application performance, in several cases, is sensitive to prefetching, cache and bandwidth allocation. Furthermore, the results show that managing these together provides higher performance potential during workload consolidation as it enables more resource trade-offs. In this paper, we propose CBP a coordination mechanism for dynamically managing prefetching throttling, cache and bandwidth partitioning, in order to reduce average memory access time and improve performance. CBP works by employing individual resource managers to determine the appropriate setting for each resource and a coordinating mechanism in order to enable inter-resource trade-offs. Our evaluation on a 16-core CMP shows that CBP, on average, improves performance by 11% compared to the state-of-the-art technique that manages cache partitioning and prefetching and by 50% compared to the baseline without cache partitioning, bandwidth partitioning and prefetch throttling.