Exploring Keyboard Positioning and Ten-Finger Typing in Mixed Reality

TL;DR

This study investigates tactile feedback and ten-finger typing in mixed reality, finding that users prefer tactile cues and ten-finger input methods, with trade-offs in speed and accuracy.

Contribution

It introduces a novel eye-tracking technique for ten-finger typing in mixed reality and compares different tactile feedback methods, advancing understanding of optimal input strategies.

Findings

Midair keyboard achieved 12 wpm with similar error rates across conditions.

Participants preferred tactile feedback and ten-finger typing with eye-tracking.

Index finger typing without eye-tracking was faster at 11 wpm.

Abstract

Accuracy and speed are pivotal when typing. Mixed reality typing is typically performed by typing on a midair keyboard with your index fingers. This deprives users of both the tactile feedback available on physical devices and the ability to press keys with the most convenient finger. Our first experiment investigated providing tactile feedback by positioning the virtual keyboard on a table or wall. The keyboard was deterministic (without auto-correct), supported mixed case typing with symbols, and relied only on the hand-tracking provided by a commodity headset's egocentric cameras. Users preferred and had the highest entry rate of 12 words-per-minute using a midair keyboard. Error rates were similar in all conditions. Our second experiment explored ten-finger typing and used a novel eye-tracking technique to avoid accidental key presses. This technique was preferred for ten-finger typing and halved corrections. However, participants were faster using their index fingers without eye-tracking at 11 words-per-minute.