WURBench: Toward Benchmarking Wake-up Radio-based Systems

TL;DR

This paper proposes a benchmarking framework for wake-up radio systems to standardize performance evaluation, enabling consistent, repeatable, and comparable assessments of diverse WUR-based technologies.

Contribution

It introduces an evaluation framework and benchmark for wake-up radio systems, addressing the lack of standardization in performance measurement methods.

Findings

Developed a comprehensive benchmarking methodology

Facilitated consistent comparison of different WUR systems

Enabled more reliable performance evaluation

Abstract

The performance of wake-up radios must be clearly measured and understood while designing and developing robust, dependable, and affordable systems, considering both benefits and shortcomings. State-of-the-art WURs display significant diversity in their architecture, processing capability, energy consumption, and receiver sensitivity. Standard methodologies for benchmarking are crucial for quantitatively evaluating the performance of this emerging technology, however, currently, no accepted standard for such quantitative measurement exists. Further, there is no consensus on what objective evaluation procedures and metrics should be used to understand the performance of whole systems exploiting this technology. This lack of standardization has prevented researchers from comparing results and leveraging previous work that could otherwise avoid duplication and speed up the validation process. This paper leads toward an evaluation framework, a benchmark, to enable accurate and repeatable profiling of WUR-based systems, leading to more consistent and therefore comparable evaluations for current and future systems.