RT-Bench: an Extensible Benchmark Framework for the Analysis and Management of Real-Time Applications
Mattia Nicolella (1), Shahin Roozkhosh (1), Denis Hoornaert (2),, Andrea Bastoni (2), Renato Mancuso (1) ((1) Boston University Boston USA, (2), TU M\"unchen Germany)

TL;DR
RT-bench is an open-source, extensible benchmarking framework designed to accurately evaluate real-time applications by incorporating key real-time features and providing a unified interface for customization and analysis.
Contribution
It introduces a flexible framework that adds real-time capabilities to existing benchmarks, addressing limitations of current suites and simplifying real-time system evaluation.
Findings
Supports periodic behavior and deadline semantics
Enables easy customization of real-time parameters
Successfully integrates with existing benchmark suites
Abstract
Benchmarking is crucial for testing and validating any system, even more so in real-time systems. Typical real-time applications adhere to well-understood abstractions: they exhibit a periodic behavior, operate on a well-defined working set, and strive for stable response time avoiding non-predicable factors such as page faults. Unfortunately, available benchmark suites fail to reflect key characteristics of real-time applications. Practitioners and researchers must resort to either benchmark heavily approximated real-time environments, or to re-engineer available benchmarks to add -- if possible -- the sought-after features. Additionally, the measuring and logging capabilities provided by most benchmark suites are not tailored "out-of-the-box" to real-time environments, and changing basic parameters such as the scheduling policy often becomes a tiring and error-prone exercise. In…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
