Behavior Driven Development for 3D Games

TL;DR

This paper demonstrates how integrating Behavior-driven Development with the iv4XR framework enhances automated testing for complex 3D games, improving collaboration and enabling long-play scenario automation.

Contribution

It introduces a BDD approach within iv4XR, facilitating easier test script creation and extending automation capabilities for diverse 3D game testing scenarios.

Findings

Successful automation of regression testing in Space Engineers

Enhanced collaboration between developers and testers using BDD

Extended iv4XR with tactical programming for long-play scenarios

Abstract

Computer 3D games are complex software environments that require novel testing processes to ensure high-quality standards. The Intelligent Verification/Validation for Extended Reality Based Systems (iv4XR) framework addresses this need by enabling the implementation of autonomous agents to automate game testing scenarios. This framework facilitates the automation of regression test cases for complex 3D games like Space Engineers. Nevertheless, the technical expertise required to define test scripts using iv4XR can constrain seamless collaboration between developers and testers. This paper reports how integrating a Behavior-driven Development (BDD) approach with the iv4XR framework allows the industrial company behind Space Engineers to automate regression testing. The success of this industrial collaboration has inspired the iv4XR team to integrate the BDD approach to improve the automation of play-testing for the experimental 3D game LabRecruits. Furthermore, the iv4XR framework has been extended with tactical programming to enable the automation of long-play test scenarios in Space Engineers. These results underscore the versatility of the iv4XR framework in supporting diverse testing approaches while showcasing how BDD empowers users to create, manage, and execute automated game tests using comprehensive and human-readable statements.