Video-Conferencing Beyond Screen-Sharing and Thumbnail Webcam Videos: Gesture-Aware Augmented Reality Video for Data-Rich Remote Presentations

TL;DR

This paper discusses enhancing remote data-rich presentations by integrating gesture-aware augmented reality video into video-conferencing, moving beyond traditional screen-sharing and thumbnail videos to improve audience engagement.

Contribution

It introduces a novel approach combining multimodal interaction and augmented reality video to improve data presentation in remote conferencing environments.

Findings

AR video enhances data comprehension during remote presentations

Gesture-aware interaction improves user engagement

Proposed method offers richer data communication than traditional video-conferencing

Abstract

Synchronous data-rich conversations are commonplace within enterprise organizations, taking place at varying degrees of formality between stakeholders at different levels of data literacy. In these conversations, representations of data are used to analyze past decisions, inform future course of action, as well as persuade customers, investors, and executives. However, it is difficult to conduct these conversations between remote stakeholders due to poor support for presenting data when video-conferencing, resulting in disappointing audience experiences. In this position statement, I reflect on our recent work incorporating multimodal interaction and augmented reality video, suggesting that video-conferencing does not need to be limited to screen-sharing and relegating a speaker's video to a separate thumbnail view. I also comment on future research directions and collaboration opportunities.