ETHOS: A Robotic Encountered-Type Haptic Display for Social Interaction in Virtual Reality

TL;DR

ETHOS introduces a dynamic haptic display system that enables realistic physical contact in VR for social interactions, combining robotics, real-time tracking, and safety features to enhance virtual social presence.

Contribution

The paper presents ETHOS, a novel system integrating robotic manipulators and dynamic control strategies to enable natural, safe, and high-fidelity social touch in virtual reality.

Findings

Static colocation accuracy of 5.09 mm

Average contact latency of 28.53 ms

Feasibility of recreating socially meaningful haptics in VR

Abstract

We present ETHOS (Encountered-Type Haptics for On-demand Social Interaction), a dynamic encountered-type haptic display (ETHD) that enables natural physical contact in virtual reality (VR) during social interactions such as handovers, fist bumps, and high-fives. The system integrates a torque-controlled robotic manipulator with interchangeable passive props (silicone hand replicas and a baton), marker-based physical-virtual registration via a ChArUco board, and a safety monitor that gates motion based on the user's head and hand pose. We introduce two control strategies: (i) a static mode that presents a stationary prop aligned with its virtual counterpart, consistent with prior ETHD baselines, and (ii) a dynamic mode that continuously updates prop position by exponentially blending an initial mid-point trajectory with real-time hand tracking, generating a unique contact point for each interaction. Bench tests show static colocation accuracy of 5.09 +/- 0.94 mm, while user interactions achieved temporal alignment with an average contact latency of 28.53 +/- 31.21 ms across all interaction and control conditions. These results demonstrate the feasibility of recreating socially meaningful haptics in VR. By incorporating essential safety and control mechanisms, ETHOS establishes a practical foundation for high-fidelity, dynamic interpersonal interactions in virtual environments.