A Framework for Exploring and Evaluating Mechanics in Human Computation Games

TL;DR

This paper introduces a formal framework for analyzing and comparing mechanics in human computation games, aiming to improve their design and effectiveness in solving complex tasks.

Contribution

It presents a structured representation of HCG mechanics and a methodology for experimental exploration to enhance game design and task performance.

Findings

Framework enables visualization and comparison of HCG mechanics

Design experiments reveal effects of game elements on player experience

Applications demonstrate improved HCG development

Abstract

Human computation games (HCGs) are a crowdsourcing approach to solving computationally-intractable tasks using games. In this paper, we describe the need for generalizable HCG design knowledge that accommodates the needs of both players and tasks. We propose a formal representation of the mechanics in HCGs, providing a structural breakdown to visualize, compare, and explore the space of HCG mechanics. We present a methodology based on small-scale design experiments using fixed tasks while varying game elements to observe effects on both the player experience and the human computation task completion. Finally we discuss applications of our framework using comparisons of prior HCGs and recent design experiments. Ultimately, we wish to enable easier exploration and development of HCGs, helping these games provide meaningful player experiences while solving difficult problems.