Automated Generation of Test Models from Semi-Structured Requirements

TL;DR

This paper presents an automated approach using machine learning and rule-based methods to identify semi-structured requirements in natural language documents and translate them into Cause-Effect-Graphs for test case generation, significantly reducing manual effort.

Contribution

It introduces algorithms for detecting semi-structured requirements and translating them into test models, enabling fully automated test model creation from natural language documents.

Findings

Achieved 86% time savings in test model creation.

Successfully identified 14% of requirements as semi-structured.

Maintained test model quality with automation.

Abstract

[Context:] Model-based testing is an instrument for automated generation of test cases. It requires identifying requirements in documents, understanding them syntactically and semantically, and then translating them into a test model. One light-weight language for these test models are Cause-Effect-Graphs (CEG) that can be used to derive test cases. [Problem:] The creation of test models is laborious and we lack an automated solution that covers the entire process from requirement detection to test model creation. In addition, the majority of requirements is expressed in natural language (NL), which is hard to translate to test models automatically. [Principal Idea:] We build on the fact that not all NL requirements are equally unstructured. We found that 14 % of the lines in requirements documents of our industry partner contain "pseudo-code"-like descriptions of business rules. We apply Machine Learning to identify such semi-structured requirements descriptions and propose a rule-based approach for their translation into CEGs. [Contribution:] We make three contributions: (1) an algorithm for the automatic detection of semi-structured requirements descriptions in documents, (2) an algorithm for the automatic translation of the identified requirements into a CEG and (3) a study demonstrating that our proposed solution leads to 86 % time savings for test model creation without loss of quality.