KubePACS: Kubernetes Cluster Using Performant, Highly Available, and Cost Efficient Spot Instances

TL;DR

KubePACS is a Kubernetes system that optimizes spot instance selection for cost, performance, and availability using multi-objective ILP, outperforming existing solutions significantly.

Contribution

It introduces a multi-objective optimization approach incorporating real-time data for spot instance provisioning in Kubernetes, enhancing cost-efficiency and reliability.

Findings

Achieves up to 81.06% higher performance per dollar.

Demonstrates 55.09% average improvement over state-of-the-art solutions.

Effectively balances cost, performance, and availability in spot instance provisioning.

Abstract

Cloud users aim to minimize cost while maximizing performance by selecting the most suitable instance types for their workloads. To reduce expenses, spot instances have been widely adopted due to their steep discounts compared to on-demand pricing. However, their use introduces reliability risks due to potential interruptions, and existing research has primarily focused on mitigating this trade-off from a cost or availability perspective alone. Despite the diversity in hardware capabilities among instance types, current provisioning systems tend to ignore performance variation, selecting nodes solely based on minimum resource requirements. In this paper, we present KubePACS, a Kubernetes-native spot instance provisioning system that constructs node pools optimized for both cost and performance while guaranteeing high availability. KubePACS formulates the node selection process as a multi-objective optimization problem, incorporating real-time data such as spot prices, performance benchmarks, and availability scores, including the multi-node Spot Placement Score (SPS). It solves this problem efficiently using an Integer Linear Programming (ILP) approach guided by the Golden Section Search (GSS) algorithm to find the optimal configuration. By integrating with the Karpenter node autoscaler, KubePACS jointly optimizes instance-type selection and node scaling decisions within a standard provisioning workflow. KubePACS also adopts a novel heuristic to support workload-specific preferences by scaling performance metrics for specialized instances. Through extensive evaluation across synthetic and real-world workloads, KubePACS demonstrates on average 55.09% and up to 81.06% higher performance per dollar over state-of-the-art solutions such as Karpenter, SpotVerse, and SpotKube, which only reference the spot instance prices and limited availability data.