Adaptive Testing for Specification Coverage
Ezio Bartocci (1), Roderick Bloem (2), Benedikt Maderbacher (2),, Niveditha Manjunath (1, 3), Dejan Ni\v{c}kovi\'c (3) ((1) Vienna, University of Technology, (2) Graz University of Technology, (3) AIT Austrian, Institute of Technology)

TL;DR
This paper introduces an adaptive testing method for cyber-physical systems using Signal Temporal Logic, combining reachability games and optimization to systematically explore system behaviors and improve specification coverage.
Contribution
It presents the first adaptive testing approach directly applicable to MATLAB/Simulink models, enhancing systematic testing and specification coverage for CPS.
Findings
Effective in incrementally reaching test objectives
Generates test suites that improve specification coverage
Infers implemented parts of the specification
Abstract
Ensuring correctness of cyber-physical systems (CPS) is an extremely challenging task that is in practice often addressed with simulation based testing. Formal specification languages, such as Signal Temporal Logic (STL), are used to mathematically express CPS requirements and thus render the simulation activity more systematic and principled. We propose a novel method for adaptive generation of tests with specification coverage for STL. To achieve this goal, we devise cooperative reachability games that we combine with numerical optimization to create tests that explore the system in a way that exercise various parts of the specification. To the best of our knowledge our approach is the first adaptive testing approach that can be applied directly to MATLAB\texttrademark\; Simulink/Stateflow models. We implemented our approach in a prototype tool and evaluated it on several illustrating…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSoftware Testing and Debugging Techniques · Software Reliability and Analysis Research · Formal Methods in Verification
