Towards Game-based Metrics for Computational Co-creativity

TL;DR

This paper explores how game-like interactive systems can serve as effective environments for measuring the success of co-creative agents, focusing on metrics related to creativity such as novelty and surprise.

Contribution

It introduces a framework linking game environments to co-creativity research and proposes specific metrics for evaluating cooperative agents in these settings.

Findings

Mapped modern games to co-creativity research problems

Proposed new metrics for evaluating creativity in game environments

Outlined application scenarios for future research

Abstract

We propose the following question: what game-like interactive system would provide a good environment for measuring the impact and success of a co-creative, cooperative agent? Creativity is often formulated in terms of novelty, value, surprise and interestingness. We review how these concepts are measured in current computational intelligence research and provide a mapping from modern electronic and tabletop games to open research problems in mixed-initiative systems and computational co-creativity. We propose application scenarios for future research, and a number of metrics under which the performance of cooperative agents in these environments will be evaluated.