Compact Eye Tracking for VR/AR Displays via Deep Learned MicroLED Projection and Single-Pixel Sensing

TL;DR

This paper presents a compact, high-speed eye tracking system for VR/AR headsets using microLED projection and single-pixel sensing, achieving high accuracy and measurement rate.

Contribution

It introduces a novel eye tracking approach combining microLED arrays and deep learned illumination patterns for improved speed and form factor.

Findings

Angular accuracy better than one degree

Measurement rate up to 3.59 kHz

Lightweight hardware suitable for VR/AR headsets

Abstract

Fast and accurate eye tracking in a virtual reality or augmented reality headset could lead to better display performance and enable novel methods of user interaction with the system. However, it remains a challenge for a system to combine the required operational speed and accuracy of eye tracking with a technology that has a small enough form factor and weight to be easily integrated into a user-friendly headset. By using small, lightweight hardware comprising a high frame rate microLED array and fast single pixel detector, we report a model eye tracking system based on single pixel tracking and a specially developed set of deep learned illumination patterns. This model system is used to demonstrate eye tracking with an angular accuracy of better than one degree and a measurement rate of up to $3.59 \,$ kHz.