A Framework to Prevent Biometric Data Leakage in the Immersive Technologies Domain

TL;DR

This paper presents a framework designed to prevent biometric data leakage in immersive technologies, addressing privacy risks associated with facial dynamics and voice command data captured by headsets.

Contribution

The authors develop a novel, simple technical framework to mitigate biometric data privacy leaks in immersive devices, validated across six datasets.

Findings

Effective in preventing biometric data leaks

Feasible for real-world implementation

Validated with multiple datasets

Abstract

Doubtlessly, the immersive technologies have potential to ease people's life and uplift economy, however the obvious data privacy risks cannot be ignored. For example, a participant wears a 3D headset device which detects participant's head motion to track the pose of participant's head to match the orientation of camera with participant's eyes positions in the real-world. In a preliminary study, researchers have proved that the voice command features on such headsets could lead to major privacy leakages. By analyzing the facial dynamics captured with the motion sensors, the headsets suffer security vulnerabilities revealing a user's sensitive speech without user's consent. The psychography data (such as voice command features, facial dynamics, etc.) is sensitive data and it should not be leaked out of the device without users consent else it is a privacy breach. To the best of our literature review, the work done in this particular research problem is very limited. Motivated from this, we develop a simple technical framework to mitigate sensitive data (or biometric data) privacy leaks in immersive technology domain. The performance evaluation is conducted in a robust way using six data sets, to show that the proposed solution is effective and feasible to prevent this issue.