Say it or AI it: Evaluating Hands-Free Text Correction in Virtual Reality

TL;DR

This paper evaluates the effectiveness of AI-based hands-free text correction in VR, finding it more usable than voice input, and explores its potential to improve text entry without controllers.

Contribution

It introduces an evaluation of AI-driven text correction in VR, highlighting its advantages over voice input for hands-free text entry.

Findings

AI correction shows better usability than voice input

AI improves efficiency in hands-free VR text entry

Study demonstrates potential of AI for VR text correction

Abstract

Text entry in Virtual Reality (VR) is challenging, even when accounting for the use of controllers. Prior work has tackled this challenge head-on, improving the efficiency of input methods. These techniques have the advantage of allowing for relatively straightforward text correction. However, text correction without the use of controllers is a topic that has not received the same amount of attention, even though it can be desirable in several scenarios, and can even be the source of frustration. Large language models have been adopted and evaluated as a corrective methodology, given their high power for predictions. Nevertheless, their predictions are not always correct, which can lead to lower usability. In this paper, we investigate whether, for text correction in VR that is hands-free, the use of AI could surpass in terms of usability and efficiency. We observed better usability for AI text correction when compared to voice input.