Cruise Control: Dynamic Model Selection for ML-Based Network Traffic Analysis

TL;DR

Cruise Control is an online system that dynamically selects the most suitable machine learning model for network traffic analysis, improving accuracy and reducing packet loss under changing network conditions.

Contribution

It introduces a system-driven, online approach for dynamic model selection in network traffic analysis, addressing deployment constraints and traffic variability.

Findings

Median accuracy increased by 2.78% with Cruise Control.

Packet loss reduced by a factor of four.

Effective adaptation to real-world network conditions.

Abstract

Modern networks increasingly rely on machine learning models for real-time insights, including traffic classification, application quality of experience inference, and intrusion detection. However, existing approaches prioritize prediction accuracy without considering deployment constraints or the dynamism of network traffic, leading to potentially suboptimal performance. Because of this, deploying ML models in real-world networks with tight performance constraints remains an open challenge. In contrast with existing work that aims to select an optimal candidate model for each task based on offline information, we propose an online, system-driven approach to dynamically select the best ML model for network traffic analysis. To this end, we present Cruise Control, a system that pre-trains several models for a given task with different accuracy-cost tradeoffs and selects the most appropriate model based on lightweight signals representing the system's current traffic processing ability. Experimental results using two real-world traffic analysis tasks demonstrate Cruise Control's effectiveness in adapting to changing network conditions. Our evaluation shows that Cruise Control improves median accuracy by 2.78% while reducing packet loss by a factor of four compared to offline-selected models.