The 4th Reactive Synthesis Competition (SYNTCOMP 2017): Benchmarks, Participants & Results
Swen Jacobs (1), Nicolas Basset (2), Roderick Bloem (3), Romain, Brenguier (4), Maximilien Colange (5), Peter Faymonville (1), Bernd, Finkbeiner (1), Ayrat Khalimov (3), Felix Klein (1), Thibaud Michaud (5),, Guillermo A. P\'erez (2), Jean-Fran\c{c}ois Raskin (2)
TL;DR
The paper reports on SYNTCOMP 2017, detailing new benchmarks, participant tools, evaluation methods, and results, providing insights into the state of reactive synthesis tools and their performance.
Contribution
It introduces two new benchmark classes, describes the evaluation scheme, and analyzes the performance of competing tools in SYNTCOMP 2017.
Findings
Introduction of two new benchmark classes
New tools entered the competition
Ranking of tools based on solution quality and quantity
Abstract
We report on the fourth reactive synthesis competition (SYNTCOMP 2017). We introduce two new benchmark classes that have been added to the SYNTCOMP library, and briefly describe the benchmark selection, evaluation scheme and the experimental setup of SYNTCOMP 2017. We present the participants of SYNTCOMP 2017, with a focus on changes with respect to the previous years and on the two completely new tools that have entered the competition. Finally, we present and analyze the results of our experimental evaluation, including a ranking of tools with respect to quantity and quality of solutions.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.