The 3rd Reactive Synthesis Competition (SYNTCOMP 2016): Benchmarks, Participants & Results
Swen Jacobs (Saarland University), Roderick Bloem (Graz University of, Technology), Romain Brenguier (University of Oxford), Ayrat Khalimov (Graz, University of Technology), Felix Klein (Saarland University), Robert, K\"onighofer (Graz University of Technology)
TL;DR
The paper reports on the benchmarks, participants, and results of SYNTCOMP 2016, highlighting new benchmark formats, competition entries, and comparative analysis of synthesis tools in reactive synthesis.
Contribution
It introduces extended benchmark libraries for TLSF and AIGER formats, and provides a comprehensive overview and analysis of the 2016 reactive synthesis competition.
Findings
Six tools in the AIGER-based track
Three participants in the TLSF-based track
Comparison with previous competition results
Abstract
We report on the benchmarks, participants and results of the third reactive synthesis competition(SYNTCOMP 2016). The benchmark library of SYNTCOMP 2016 has been extended to benchmarks in the new LTL-based temporal logic synthesis format (TLSF), and 2 new sets of benchmarks for the existing AIGER-based format for safety specifications. The participants of SYNTCOMP 2016 can be separated according to these two classes of specifications, and we give an overview of the 6 tools that entered the competition in the AIGER-based track, and the 3 participants that entered the TLSF-based track. We briefly describe the benchmark selection, evaluation scheme and the experimental setup of SYNTCOMP 2016. Finally, we present and analyze the results of our experimental evaluation, including a comparison to participants of previous competitions and a legacy tool.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.