Offloading tracing for real-time systems using a scalable cloud infrastructure

TL;DR

This paper introduces a scalable cloud-based architecture for real-time system tracing that enables long-term, collaborative analysis and improves efficiency over traditional local tools.

Contribution

It presents a novel microservices and edge computing architecture for offloading trace processing to the cloud, supporting scalable, long-term, and collaborative analysis of real-time systems.

Findings

Handles many parallel tracing sessions efficiently

Per-session throughput decreases with system load

Overall throughput increases with more sessions

Abstract

Real-time embedded systems require precise timing and fault detection to ensure correct behavior. Traditional tracing tools often rely on local desktops with limited processing and storage capabilities, which hampers large-scale analysis. This paper presents a scalable, cloud-based architecture for software tracing in real-time systems based on microservices and edge computing. Our approach shifts the trace processing workload from the developer's machine to the cloud, using a dedicated tracing component that captures trace data and forwards it to a scalable backend via WebSockets and Apache Kafka. This enables long-term monitoring and collaborative analysis of target executions, e.g., to detect and investigate sporadic errors. We demonstrate how this architecture supports scalable analysis of parallel tracing sessions and lays the foundation for future integration of rule-based testing and runtime verification. The evaluation results show that the architecture can handle many parallel tracing sessions efficiently, although the per-session throughput decreases slightly as the system load increases, while the overall throughput increases. Although the design includes a dedicated tracer for analysis during development, this approach is not limited to such setups. Target systems with network connectivity can stream reduced trace data directly, enabling runtime monitoring in the field.