Old and New Benchmarks for Relative Termination of String Rewrite Systems
Dieter Hofbauer, Johannes Waldmann

TL;DR
This paper critically assesses existing benchmarks for relative string rewrite system termination, identifies issues, and provides new enumerations of small systems to improve evaluation standards.
Contribution
It offers a thorough critique of current benchmarks and introduces comprehensive enumerations of small relative string rewrite systems for better evaluation.
Findings
Many existing benchmarks are actually strictly terminating.
Complete enumerations for small systems are provided up to size 11 for 2-letter alphabets.
Discussion on methods to prove termination for selected benchmarks.
Abstract
We provide a critical assessment of the current set of benchmarks for relative SRS termination in the Termination Problems Database (TPDB): most of the benchmarks in Waldmann_19 and ICFP_10_relative are, in fact, strictly terminating (i. e., terminating when non-strict rules are considered strict), so these benchmarks should be removed, or relabelled. To fill this gap, we enumerate small relative string rewrite systems. At present, we have complete enumerations for a 2-letter alphabet up to size 11, and for a 3-letter alphabet up to size 8. For some selected benchmarks, old and new, we discuss how to prove termination, automated or not.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNatural Language Processing Techniques · semigroups and automata theory · Algorithms and Data Compression
