CloudNativeSim: a toolkit for modeling and simulation of cloud-native applications

TL;DR

CloudNativeSim is a simulation toolkit designed to model and analyze cloud-native applications with microservice architectures, addressing scalability, complexity, and resource management challenges in a cost-effective manner.

Contribution

It introduces a comprehensive, dynamic simulation framework for cloud-native applications, enabling policy testing and QoS analysis without large-scale deployment.

Findings

Achieves over 94.5% response time accuracy in validation

Demonstrates effectiveness of various scaling policies

Supports customizable scenarios and user feedback

Abstract

Cloud-native applications are increasingly becoming popular in modern software design. Employing a microservice-based architecture into these applications is a prevalent strategy that enhances system availability and flexibility. However, cloud-native applications also introduce new challenges, such as frequent inter-service communication and the complexity of managing heterogeneous codebases and hardware, resulting in unpredictable complexity and dynamism. Furthermore, as applications scale, only limited research teams or enterprises possess the resources for large-scale deployment and testing, which impedes progress in the cloud-native domain. To address these challenges, we propose CloudNativeSim, a simulator for cloud-native applications with a microservice-based architecture. CloudNativeSim offers several key benefits: (i) comprehensive and dynamic modeling for cloud-native applications, (ii) an extended simulation framework with new policy interfaces for scheduling cloud-native applications, and (iii) support for customized application scenarios and user feedback based on Quality of Service (QoS) metrics. CloudNativeSim can be easily deployed on standard computers to manage a high volume of requests and services. Its performance was validated through a case study, demonstrating higher than 94.5% accuracy in terms of response time. The study further highlights the feasibility of CloudNativeSim by illustrating the effects of various scaling policies.