AdvNet: Revealing Performance Issues in Network Protocols by Generating Adversarial Environments

TL;DR

AdvNet is an automated system that generates adversarial network environments to test and reveal performance issues and hidden bugs in network protocol implementations, especially congestion control protocols.

Contribution

It introduces a machine learning-based approach to automatically create challenging environments, uncovering unseen protocol limitations and bugs in Linux kernel congestion control implementations.

Findings

AdvNet successfully generated adversarial scenarios for 27 kernel-space CC implementations.

The system uncovered previously unnoticed Linux kernel bugs and limitations.

Results demonstrate the value of automated adversarial testing for protocol robustness.

Abstract

Infrastructure protocols like Congestion Control (CC) seek to provide reliable performance across a wide range of Internet environments. Currently, protocol designers assess performance through hand-designed test cases or data sets captured from real environments. However, such approaches may inadvertently overlook critical facets of the algorithm's behavior when they encounter an unanticipated environment or workload. We seek to understand the unanticipated with AdvNet, a system that automatically generates adversarial network environments that cause a target protocol implementation to perform poorly. AdvNet employs machine learning-based optimization to generate environments, and incorporates a robust noise-handling mechanism to mitigate the variability inherent in real-world protocol performance. Although our approach is more general, this paper focuses specifically on transport protocols and their CC implementations. We showcase AdvNet's capability to create adversarial scenarios for 27 kernel-space implementations of both single-path and multi-path CC protocols, for several use cases with different performance goals. AdvNet identifies problematic network conditions that expose previously unnoticed Linux kernel bugs and uncovers hidden limitations in CC implementations, and provides insights about robustness. These results suggest that automated adversarial testing can be a valuable tool in protocol development, and that robustness is a useful new dimension for benchmarking CC protocols.