S\"{o}ze: One Network Telemetry Is All You Need for Per-flow Weighted Bandwidth Allocation at Scale

TL;DR

S"{o}ze is a lightweight decentralized system that uses simple network telemetry to enable scalable, precise per-flow weighted bandwidth allocation in data centers, improving job completion times.

Contribution

S"{o}ze introduces a novel approach leveraging commodity switch telemetry for scalable, precise bandwidth allocation without complex topology or routing knowledge.

Findings

Improves TPC-H job completion time by up to 0.59x

Achieves up to 0.79x average improvement

Demonstrated effectiveness through simulations and testbed experiments

Abstract

Weighted bandwidth allocation is a powerful abstraction that has a wide range of use cases in modern data center networks. However, realizing highly agile and precise weighted bandwidth allocation for large-scale cloud environments is fundamentally challenging. In this paper, we propose S\"{o}ze, a lightweight decentralized weighted bandwidth allocation system that leverages simple network telemetry features of commodity Ethernet switches. Given the flow weights, S\"{o}ze can effectively use the telemetry information to compute and enforce the weighted bandwidth allocations without per-flow, topology, or routing knowledge. We demonstrate the effectiveness of S\"{o}ze through simulations and testbed experiments, improving TPC-H jobs completion time by up to $0.59\times$ and $0.79\times$ on average.