Comparing the Effects of Visual, Haptic, and Visuohaptic Encoding on Memory Retention of Digital Objects in Virtual Reality

TL;DR

This study demonstrates that combining visual and haptic feedback in virtual reality significantly enhances users' ability to memorize digital objects, outperforming unimodal encoding methods.

Contribution

The paper introduces and empirically evaluates visuohaptic integration as a method to improve memory retention of virtual objects in VR environments.

Findings

Visuohaptic encoding improves memorization accuracy.

Haptic integration reduces error rates in memory tasks.

Enhanced recall performance with combined sensory modalities.

Abstract

Although Virtual Reality (VR) has undoubtedly improved human interaction with 3D data, users still face difficulties retaining important details of complex digital objects in preparation for physical tasks. To address this issue, we evaluated the potential of visuohaptic integration to improve the memorability of virtual objects in immersive visualizations. In a user study (N=20), participants performed a delayed match-to-sample task where they memorized stimuli of visual, haptic, or visuohaptic encoding conditions. We assessed performance differences between these encoding modalities through error rates and response times. We found that visuohaptic encoding significantly improved memorization accuracy compared to unimodal visual and haptic conditions. Our analysis indicates that integrating haptics into immersive visualizations enhances the memorability of digital objects. We discuss its implications for the optimal encoding design in VR applications that assist professionals who need to memorize and recall virtual objects in their daily work.