Gaze as a Supplementary Modality for Interacting with Ambient Intelligence Environments

TL;DR

This paper explores using gaze as a supplementary and primary interaction modality in augmented reality and virtual environments, focusing on usability and accessibility improvements.

Contribution

It introduces two user interfaces that utilize gaze for interaction, enhancing accessibility for motor-disabled users and improving gaze-contingent display usability.

Findings

Gaze can be effectively used as a supplementary pointing modality.

Gaze-based interfaces improve accessibility for motor-disabled users.

Usability of gaze-contingent displays can be enhanced through iterative testing.

Abstract

We present our current research on the implementation of gaze as an efficient and usable pointing modality supplementary to speech, for interacting with augmented objects in our daily environment or large displays, especially immersive virtual reality environments, such as reality centres and caves. We are also addressing issues relating to the use of gaze as the main interaction input modality. We have designed and developed two operational user interfaces: one for providing motor-disabled users with easy gaze-based access to map applications and graphical software; the other for iteratively testing and improving the usability of gaze-contingent displays.