Head-mounted Displays, Smartphones, or Smartwatches? -- Augmenting Conversations with Digital Representation of Self

TL;DR

This study compares head-mounted displays, smartphones, and smartwatches in supporting digital self-augmentation during face-to-face conversations, revealing user preferences and interaction effects to inform design guidelines.

Contribution

It provides empirical insights into device preferences and interaction dynamics, offering design recommendations for integrating digital self-representation in social settings.

Findings

Head-mounted displays support privacy preferences.

Smartwatches and smartphones facilitate conversational grounding and repair.

Group interactions benefit from screen-sharing features.

Abstract

Technologies that augment face-to-face interactions with a digital sense of self have been used to support conversations. That work has employed one homogenous technology, either 'off-the-shelf' or with a bespoke prototype, across all participants. Beyond speculative instances, it is unclear what technology individuals themselves would choose, if any, to augment their social interactions; what influence it may exert; or how use of heterogeneous devices may affect the value of this augmentation. This is important, as the devices that we use directly affect our behaviour, influencing affordances and how we engage in social interactions. Through a study of 28 participants, we compared head-mounted display, smartphones, and smartwatches to support digital augmentation of self during face-to-face interactions within a group. We identified a preference among participants for head-mounted displays to support privacy, while smartwatches and smartphones better supported conversational events (such as grounding and repair), along with group use through screen-sharing. Accordingly, we present software and hardware design recommendations and user interface guidelines for integrating a digital form of self into face-to-face conversations.