Towards Around-Device Interaction using Corneal Imaging

TL;DR

This paper explores using corneal reflections captured by high-resolution front-facing cameras to enable around-device interaction, extending input capabilities of mobile devices through eye imaging.

Contribution

It introduces a novel approach to around-device interaction using corneal reflective imaging and provides a workflow, prototype, and evaluation for feasibility.

Findings

Spatial sensing resolution of 5 cm near the device under optimal conditions

Feasibility demonstrated with high-resolution cameras and potential migration to lower resolutions

Prototype shows potential for practical around-device interaction using eye reflections

Abstract

Around-device interaction techniques aim at extending the input space using various sensing modalities on mobile and wearable devices. In this paper, we present our work towards extending the input area of mobile devices using front-facing device-centered cameras that capture reflections in the human eye. As current generation mobile devices lack high resolution front-facing cameras we study the feasibility of around-device interaction using corneal reflective imaging based on a high resolution camera. We present a workflow, a technical prototype and an evaluation, including a migration path from high resolution to low resolution imagers. Our study indicates, that under optimal conditions a spatial sensing resolution of 5 cm in the vicinity of a mobile phone is possible.