Reproducibility Report for the Paper: QN-based Modeling and Analysis of Software Performance Antipatterns for Cyber-Physical Systems

TL;DR

This reproducibility report confirms that the artifact associated with the paper enables seamless re-execution of experiments, with well-documented dependencies and verified results, supporting transparency and long-term accessibility.

Contribution

The paper provides a detailed reproducibility assessment of a QN-based modeling approach for software performance antipatterns in cyber-physical systems, including artifact validation.

Findings

All results are reproducible and verified.

The artifact is well-documented and easy to run.

The paper receives multiple badges indicating artifact quality.

Abstract

The authors have uploaded their artifact to Zenodo, which ensures a long-term retention of the artifact. The artifact allows to re-run the experiments very smoothly, and the dependencies are well documented. The process to regenerate data for the figures and tables in the paper completes, and all results are reproducible. This paper can thus receive the Artifacts Available badge. The software in the artifact runs correctly with no trouble, and is relevant to the paper, thus deserving the Artifacts Evaluated -- Functional badge. Given the successful reproduction of all figures and tables, the Results Reproduced badge can be assigned.