Video as a By-Product of Digital Prototyping: Capturing the Dynamic Aspect of Interaction

TL;DR

This paper introduces a method to generate videos from digital prototypes to better capture and communicate the dynamic aspects of user interaction, enhancing understanding and reducing effort compared to traditional recording methods.

Contribution

The paper presents a novel approach to automatically generate interaction videos from digital prototypes, improving the communication of dynamic behavior in requirements engineering.

Findings

Generated videos support faster understanding of scenarios.

Method reduces effort compared to traditional screencasts.

Videos can be easily updated with prototype modifications.

Abstract

Requirements engineering provides several practices to analyze how a user wants to interact with a future software. Mockups, prototypes, and scenarios are suitable to understand usability issues and user requirements early. Nevertheless, users are often dissatisfied with the usability of a resulting software. Apparently, previously explored information was lost or no longer accessible during the development phase. Scenarios are one effective practice to describe behavior. However, they are commonly notated in natural language which is often improper to capture and communicate interaction knowledge comprehensible to developers and users. The dynamic aspect of interaction is lost if only static descriptions are used. Digital prototyping enables the creation of interactive prototypes by adding responsive controls to hand- or digitally drawn mockups. We propose to capture the events of these controls to obtain a representation of the interaction. From this data, we generate videos, which demonstrate interaction sequences, as additional support for textual scenarios. Variants of scenarios can be created by modifying the captured event sequences and mockups. Any change is unproblematic since videos only need to be regenerated. Thus, we achieve video as a by-product of digital prototyping. This reduces the effort compared to video recording such as screencasts. A first evaluation showed that such a generated video supports a faster understanding of a textual scenario compared to static mockups.