Gaze and Gestures in Telepresence: multimodality, embodiment, and roles of collaboration

TL;DR

This paper explores how gaze awareness and gesture recognition can enhance remote collaboration by redesigning experiments with advanced technology to better study multimodal communication, support free movement, and ensure symmetrical interaction.

Contribution

It introduces a new experimental framework using modern technology to investigate multimodal communication in remote collaboration, addressing previous limitations.

Findings

Enhanced understanding of gaze and gesture roles in remote work

Improved experimental design for studying multimodal communication

Insights into supporting symmetrical and natural collaboration

Abstract

This paper proposes a controlled experiment to further investigate the usefulness of gaze awareness and gesture recognition in the support of collaborative work at a distance. We propose to redesign experiments conducted several years ago with more recent technology that would: a) enable to better study of the integration of communication modalities, b) allow users to freely move while collaborating at a distance and c) avoid asymmetries of communication between collaborators.