Cine-AI: Generating Video Game Cutscenes in the Style of Human Directors

TL;DR

Cine-AI is an open-source toolset that automates the creation of in-game video cutscenes in the style of renowned human directors, ensuring stylistic consistency and user-friendly design.

Contribution

This work introduces Cine-AI, a novel procedural cinematography system in Unity that mimics specific director styles and includes a user interface for design-time and runtime control.

Findings

Participants correctly identified director styles in generated cutscenes.

Cine-AI produced cutscenes with high stylistic consistency.

The tool received above-average usability scores.

Abstract

Cutscenes form an integral part of many video games, but their creation is costly, time-consuming, and requires skills that many game developers lack. While AI has been leveraged to semi-automate cutscene production, the results typically lack the internal consistency and uniformity in style that is characteristic of professional human directors. We overcome this shortcoming with Cine-AI, an open-source procedural cinematography toolset capable of generating in-game cutscenes in the style of eminent human directors. Implemented in the popular game engine Unity, Cine-AI features a novel timeline and storyboard interface for design-time manipulation, combined with runtime cinematography automation. Via two user studies, each employing quantitative and qualitative measures, we demonstrate that Cine-AI generates cutscenes that people correctly associate with a target director, while providing above-average usability. Our director imitation dataset is publicly available, and can be extended by users and film enthusiasts.