What We Measure in Mixed Reality Experiments

TL;DR

This paper discusses the different evaluation approaches in mixed reality experiments, emphasizing the importance of context and proposing directions for more robust measurement methods to advance the field.

Contribution

It highlights various evaluation stances in mixed reality research and suggests future directions for developing more reliable measurement techniques.

Findings

Different evaluation stances depend on experience framing

Illustrates evaluation approaches through team projects

Proposes directions for robust measurement development

Abstract

There are many potential measures that one might use when evaluating mixed-reality experiences. In this position paper I will argue that there are various stances to take for evaluation, depending on the framing of the experience within a larger body of work. I will draw upon various types of work that my team has been involved with in order to illustrate these different stances. I will then sketch out some directions for developing more robust measures that can help the field move forward.