Virtual Encounters of the Haptic Kind: Towards a Multi-User VR System for Real-Time Social Touch

TL;DR

This paper introduces a multi-user VR system with wearable haptic devices enabling real-time social touch, enhancing immersion and emotional connection in virtual communication.

Contribution

It presents a novel wearable haptic system with vibrotactile feedback for real-time social touch in VR, tested through user studies to improve social presence.

Findings

Haptic feedback enhances social presence and emotional engagement.

Gesture speed and feedback modality significantly affect user experience.

The system is usable and improves immersion in social VR interactions.

Abstract

Physical touch, a fundamental aspect of human social interaction, remains largely absent in real-time virtual communication. We present a haptic-enabled multi-user Virtual Reality (VR) system that facilitates real-time, bi-directional social touch communication among physically distant users. We developed wearable gloves and forearm sleeves, embedded with 26 vibrotactile actuators for each hand and arm, actuated via a WiFi-based communication system. The system enables VR-transmitted data to be universally interpreted by haptic devices, allowing feedback rendering based on their capabilities. Users can perform and receive social touch gestures such as stroke, pat, poke, and squeeze, with other users within a shared virtual space or interact with other virtual objects, and they receive vibrotactile feedback. Through a two-part user study involving six pairs of participants, we investigate the impact of gesture speed, haptic feedback modality, and user roles, during real-time haptic communication in VR, on affective and sensory experiences, as well as evaluate the overall system usability. Our findings highlight key design considerations that significantly improve affective experiences, presence, embodiment, pleasantness, and naturalness, to foster more immersive and expressive mediated social touch experiences in VR.