ZipLine: In-Network Compression at Line Speed

TL;DR

ZipLine introduces a hardware-accelerated in-network compression system using Tofino and P4_16, enabling line-speed data compression and decompression to improve network throughput efficiently.

Contribution

This paper presents ZipLine, a novel in-network compression system leveraging programmable hardware for line-speed processing, addressing resource waste and performance bottlenecks in data transmission.

Findings

Achieves high throughput and low latency in compression/decompression

Demonstrates effectiveness on real-world network traces

Shows trade-offs between compression ratio and resource usage

Abstract

Network appliances continue to offer novel opportunities to offload processing from computing nodes directly into the data plane. One popular concern of network operators and their customers is to move data increasingly faster. A common technique to increase data throughput is to compress it before its transmission. However, this requires compression of the data -- a time and energy demanding pre-processing phase -- and decompression upon reception -- a similarly resource consuming operation. Moreover, if multiple nodes transfer similar data chunks across the network hop (e.g., a given pair of switches), each node effectively wastes resources by executing similar steps. This paper proposes ZipLine, an approach to design and implement (de)compression at line speed leveraging the Tofino hardware platform which is programmable using the P4_16 language. We report on lessons learned while building the system and show throughput, latency and compression measurements on synthetic and real-world traces, showcasing the benefits and trade-offs of our design.