The First Reactive Synthesis Competition (SYNTCOMP 2014)

TL;DR

The paper presents the first reactive synthesis competition (SYNTCOMP 2014), aiming to evaluate and advance synthesis tools for finite-state systems with safety specifications through a structured benchmark and evaluation process.

Contribution

It introduces the first competition framework for reactive synthesis, including benchmark formats, rules, participating tools, and an analysis of initial results.

Findings

Identification of current strengths and weaknesses of synthesis tools

Benchmark results highlighting performance differences

Insights into future research directions in reactive synthesis

Abstract

We introduce the reactive synthesis competition (SYNTCOMP), a long-term effort intended to stimulate and guide advances in the design and application of synthesis procedures for reactive systems. The first iteration of SYNTCOMP is based on the controller synthesis problem for finite-state systems and safety specifications. We provide an overview of this problem and existing approaches to solve it, and report on the design and results of the first SYNTCOMP. This includes the definition of the benchmark format, the collection of benchmarks, the rules of the competition, and the five synthesis tools that participated. We present and analyze the results of the competition and draw conclusions on the state of the art. Finally, we give an outlook on future directions of SYNTCOMP.