A Survey of Benchmarks to Evaluate Data Analytics for Smart-* Applications
Athanasios Kiatipis, Alvaro Brandon, Rizkallah Touma, Pierre Matri,, Michal Zasadzinski, Linh Thuy Nhuyen, Adrien Lebre, Alexandru Costan

TL;DR
This survey reviews existing benchmarks for evaluating data analytics systems in Smart-* Applications, highlighting their unique challenges and proposing future research directions for comprehensive performance assessment.
Contribution
It provides a detailed overview of benchmarks tailored to Smart-* Applications and discusses open issues and future research directions in this domain.
Findings
Identifies key characteristics and requirements of Smart-* Applications.
Describes existing benchmarks for performance evaluation.
Highlights open challenges and future research directions.
Abstract
The growth of ubiquitous sensor networks at an accelerating pace cuts across many areas of modern day life. They enable measuring, inferring, understanding and acting upon a wide variety of indicators, in fields ranging from agriculture to healthcare or to complex urban environments. The applications devoted to this task are designated as Smart-* Applications. They hide a staggering complexity, relying on multiple layers of data collection, transmission, aggregation, analysis and also storage, both at the network edge and on the cloud. Furthermore, Smart-* Applications raise additional specific challenges, such as the need to process and extract knowledge from diverse data, which is flowing at high velocity in near real-time or in the heavily distributed environment they rely on. How to assess the performance of such a complex stack, when faced with the specifics of \mbox{Smart-*}…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsIoT and Edge/Fog Computing · Data Stream Mining Techniques · Big Data and Business Intelligence
