On the benchmarking of partitioned real-time systems

TL;DR

This paper introduces SFPBench, a benchmark framework designed specifically for evaluating performance metrics of partitioned real-time systems, addressing the unique challenges posed by standards like ARINC-653.

Contribution

The paper presents a novel benchmarking framework tailored for partitioned RTSs, which are not adequately assessed by existing tools, and demonstrates its application on an industrial OS.

Findings

SFPBench effectively measures performance metrics of partitioned RTSs.

Application on an industrial OS shows practical utility of the framework.

Highlights the need for specialized benchmarks for partitioned real-time systems.

Abstract

Avionic software is the subject of critical real time, determinism and safety constraints. Software designers face several challenges, one of them being the estimation of worst-case execution time (WCET) of applications, that dictates the execution time of the system. A pessimistic WCET estimation can lead to low execution performances of the system, while an over-optimistic estimation can lead to deadline misses, breaking one the basic constraints of critical real-time systems (RTS). Partitioned systems are one special category of real time systems, employed by the avionic community to deploy avionic software. The ARINC-653 standard is one common avionic standard that employs the concept of partitions. This standard defines partitioned architectures where one partition should never directly interfere with another one. Assessing WCET of general purpose RTSs is achievable by the usage of one of the many published benchmark or WCET estimation frameworks. Contrarily, partitioned RTSs are special cases, in which common benchmark tools may not capture all the metrics. In this document, we present SFPBench, a generic benchmark framework for the assessment of performance metrics on partitioned RTSs. The general organization of the framework and its applications are illustrated, as well as an use-case, employing SFPBench on an industrial partitioned operating system (OS) executing on a Commercial Off-The-shelf (COTS) processor.