# FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking

## TL;DR

FingerType is a one-handed text input method using 3D hand tracking that improves typing speed and eyes-free performance in VR.

## Contribution

A novel one-handed thumb-to-finger text input system using 3D hand tracking and a T9-style layout for VR.

## Key findings

- FingerType achieved 94.97% tap detection accuracy and 72 FPS performance.
- Typing speed improved from 5.88 to 10.63 WPM after practice.
- Users maintained better gaze alignment with the display compared to touch input.

## Abstract

We present FingerType, a one-handed text input method based on thumb-to-finger gestures. FingerType detects tap events from 3D hand data using a Temporal Convolutional Network (TCN) and decodes the tap sequence into words with an n-gram language model. To inform the design, we examined thumb-to-finger interactions and collected comfort ratings of finger regions. We used these results to design an improved T9-style key layout. Our system runs at 72 frames per second and reaches 94.97% accuracy for tap detection. We conducted a six-block user study with 24 participants and compared FingerType with controller input and touch input. Entry speed increased from 5.88 WPM in the first practice block to 10.63 WPM in the final block. FingerType also supported more eyes-free typing: attention on the display panel within ±15° of head-gaze was 84.41%, higher than touch input (69.47%). Finally, we report error patterns and WPM learning curves, and a model-based analysis suggests improving gesture recognition accuracy could further increase speed and narrow the gap to traditional VR input methods.