CHESS: A Framework for Evaluation of Self-adaptive Systems based on Chaos Engineering

TL;DR

CHESS introduces a systematic framework using chaos engineering for evaluating the resilience and self-healing capabilities of self-adaptive systems through fault injection in microservice environments.

Contribution

This paper presents CHESS, a novel evaluation framework employing chaos engineering for assessing self-adaptive and self-healing systems, with adaptable components demonstrated via two microservice case studies.

Findings

Effective fault injection scenarios for infrastructure and functional faults.

CHESS's modular design facilitates adaptation to different systems.

Case studies validate CHESS's ability to evaluate system resilience.

Abstract

There is an increasing need to assess the correct behavior of self-adaptive and self-healing systems due to their adoption in critical and highly dynamic environments. However, there is a lack of systematic evaluation methods for self-adaptive and self-healing systems. We proposed CHESS, a novel approach to address this gap by evaluating self-adaptive and self-healing systems through fault injection based on chaos engineering (CE) [ arXiv:2208.13227 ]. The artifact presented in this paper provides an extensive overview of the use of CHESS through two microservice-based case studies: a smart office case study and an existing demo application called Yelb. It comes with a managing system service, a self-monitoring service, as well as five fault injection scenarios covering infrastructure faults and functional faults. Each of these components can be easily extended or replaced to adopt the CHESS approach to a new case study, help explore its promises and limitations, and identify directions for future research. Keywords: self-healing, resilience, chaos engineering, evaluation, artifact