Kubernetes in Action: Exploring the Performance of Kubernetes Distributions in the Cloud

TL;DR

This paper evaluates the performance of four Kubernetes distributions across different virtualization modes and container runtimes on CloudLab, providing insights into their scalability and efficiency for containerized applications.

Contribution

It offers a comparative analysis of Kubernetes distributions, virtualization modes, and container runtimes, highlighting optimal configurations for cloud-based container orchestration.

Findings

Kubeadm and K3s perform best with HVM mode.

Containerd shows superior performance over Docker in CPU workloads.

Scaling behavior varies significantly among distributions.

Abstract

Kubernetes has emerged as a leading open-source platform for container orchestration, allowing organizations to efficiently manage and deploy containerized applications at scale. This paper investigates the performance of four Kubernetes distributions, namely Kubeadm, K3s, MicroK8s, and K0s when running OpenFaaS as a containerized service on a cluster of computing nodes on CloudLab. For this purpose, experiments are conducted to examine the performance of two virtualization modes, namely HVM and PV, supported by Xen as the underlying hypervisor. Moreover, two container runtimes that are integrated with Kubernetes, namely Docker, and Containerd, are examined to assess their performance on both disk-intensive and CPU-intensive workloads. After determining the appropriate underlying Xen mode and container runtime, the Kubernetes distributions are set up and their performance is measured using various metrics, such as request rate, CPU utilization, and scaling behavior.