Towards Situation Awareness and Attention Guidance in a Multiplayer Environment using Augmented Reality and Carcassonne

TL;DR

This paper introduces an augmented reality adaptation of Carcassonne to study situation awareness and attention guidance, leveraging AR sensors, AI, and gaze tracking for enhanced user interaction and training.

Contribution

It presents a new AR environment for research on situation awareness and attention guidance, including game state encoding, AI development, and gaze tracking systems.

Findings

Developed a prototype AR Carcassonne environment

Created game state encoding and AI for gameplay

Designed initial situation modeling and gaze tracking systems

Abstract

Augmented reality (AR) games are a rich environment for researching and testing computational systems that provide subtle user guidance and training. In particular computer systems that aim to augment a user's situation awareness benefit from the range of sensors and computing power available in AR headsets. In this work-in-progress paper, we present a new environment for research into situation awareness and attention guidance (SAAG): an augmented reality version of the board game Carcassonne. We also present our initial work in producing a SAAG pipeline, including the creation of game state encodings, the development and training of a gameplay AI, and the design of situation modelling and gaze tracking systems.