Repeatable Experiments with LabWiki
Thierry Rakotoarivelo, Guillaume Jourjon, Olivier Mehani, Maximilian, Ott, Mike Zink

TL;DR
This paper introduces LabWiki, a workspace tool designed to facilitate the planning, execution, and documentation of experiments in distributed computing, ensuring repeatability and validation of scientific results.
Contribution
It presents a methodology and a set of tools that automate experiment documentation and support repeatability, building on existing standards and protocols.
Findings
LabWiki enables automatic capture of experiment dependencies.
The methodology improves experiment repeatability and validation.
Real experiments demonstrate the workspace's effectiveness.
Abstract
The ability to repeat the experiments from a research study and obtain similar results is a corner stone in experiment-based scientific discovery. This essential feature has been often ignored by the distributed computing and networking community. There are many reasons for that, such as the complexity of provisioning, configuring, and orchestrating the resources used by experiments, their multiple external dependencies, and the difficulty to seamlessly record these dependencies. This paper describes a methodology based on well-established principles to plan, prepare and execute experiments. We propose and describe a family of tools, the LabWiki workspace, to support an experimenter's workflow based on that methodology. This proposed workspace provides services and mechanisms for each step of an experiment-based study, while automatically capturing the necessary information to allow…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsScientific Computing and Data Management · Cloud Computing and Resource Management · Software System Performance and Reliability
