Requirements-Aided Automatic Test Case Generation for Industrial Cyber-physical Systems

TL;DR

This paper presents a framework that uses formalized natural language requirements to automatically generate test cases across different abstraction levels in industrial cyber-physical systems, improving testing accuracy and efficiency.

Contribution

It introduces a novel requirements-driven approach with a formal ontology for automatic test case generation in model-driven engineering of industrial systems.

Findings

Effective test case generation at all design stages

Successful application to an industrial water process system

Automated testing enhances safety and reliability

Abstract

Industrial cyber-physical systems require complex distributed software to orchestrate many heterogeneous mechatronic components and control multiple physical processes. Industrial automation software is typically developed in a model-driven fashion where abstractions of physical processes called plant models are co-developed and iteratively refined along with the control code. Testing such multi-dimensional systems is extremely difficult because often models might not be accurate, do not correspond accurately with subsequent refinements, and the software must eventually be tested on the real plant, especially in safety-critical systems like nuclear plants. This paper proposes a framework wherein high-level functional requirements are used to automatically generate test cases for designs at all abstraction levels in the model-driven engineering process. Requirements are initially specified in natural language and then analyzed and specified using a formalized ontology. The requirements ontology is then refined along with controller and plant models during design and development stages such that test cases can be generated automatically at any stage. A representative industrial water process system case study illustrates the strengths of the proposed formalism. The requirements meta-model proposed by the CESAR European project is used for requirements engineering while IEC 61131-3 and model-driven concepts are used in the design and development phases. A tool resulting from the proposed framework called REBATE (Requirements Based Automatic Testing Engine) is used to generate and execute test cases for increasingly concrete controller and plant models.