VergeIO: Depth-Aware Eye Interaction on Glasses

TL;DR

VergeIO introduces a depth-aware eye interaction system on glasses using EOG sensors, achieving high accuracy in gesture recognition with low power and no calibration, advancing unobtrusive eye-tracking technology.

Contribution

This work presents the first EOG-based glasses capable of depth-aware eye gestures with optimized electrode layout and a novel smart glass prototype.

Findings

Achieves 83-98% accuracy in distinguishing depth-based eye gestures.

Generalizes to unseen users with 77-97% accuracy without calibration.

Operates in real time with 3 mW power consumption.

Abstract

There is growing industry interest in creating unobtrusive designs for electrooculography (EOG) sensing of eye gestures on glasses (e.g. JINS MEME and Apple eyewear). We present VergeIO, the first EOG-based glasses that enables depth-aware eye interaction using vergence with an optimized electrode layout and novel smart glass prototype. It can distinguish between four and six depth-based eye gestures with 83-98% accuracy using personalized models in a user study across 20 users and 2,400 gesture instances. It generalizes to unseen users with an accuracy of 77-97% without any calibration. To reduce false detections, we incorporate a motion artifact detection pipeline and a preamble-based activation scheme. The system uses dry sensors without any adhesives or gel, and operates in real time with 3 mW power consumption by the sensing front-end, making it suitable for always-on sensing.