json2run: a tool for experiment design & analysis

TL;DR

json2run is a versatile tool that simplifies experiment design, execution, and analysis by using JSON configurations, supporting parallel runs, parameter tuning, and data management with MongoDB and R.

Contribution

It introduces a novel approach to experiment management by integrating JSON-based configuration with automated execution and analysis features.

Findings

Enables concise experiment description with JSON

Supports parallel experiment execution

Integrates parameter tuning and data analysis tools

Abstract

json2run is a tool to automate the running, storage and analysis of experiments. The main advantage of json2run is that it allows to describe a set of experiments concisely as a JSON-formatted parameter tree. It also supports parallel execution of experiments, automatic parameter tuning through the F-Race framework and storage and analysis of experiments with MongoDB and R.