The Dark Side of Perceptual Manipulations in Virtual Reality
Wen-Jie Tseng, Elise Bonnail, Mark McGill, Mohamed Khamis, Eric, Lecolinet, Samuel Huron, Jan Gugenheimer

TL;DR
This paper investigates the malicious potential of Virtual-Physical Perceptual Manipulations (VPPMs) in VR, highlighting risks, proposing mitigations, and demonstrating how they can be exploited to cause harm.
Contribution
It defines and demonstrates VPPMs, explores associated risks through speculative design, and shows how existing VPPMs can be maliciously exploited to cause physical harm.
Findings
VPPMs can be maliciously exploited to manipulate user actions.
Speculative design workshops reveal significant security risks.
Two applications demonstrate potential for physical harm through VPPM misuse.
Abstract
"Virtual-Physical Perceptual Manipulations" (VPPMs) such as redirected walking and haptics expand the user's capacity to interact with Virtual Reality (VR) beyond what would ordinarily physically be possible. VPPMs leverage knowledge of the limits of human perception to effect changes in the user's physical movements, becoming able to (perceptibly and imperceptibly) nudge their physical actions to enhance interactivity in VR. We explore the risks posed by the malicious use of VPPMs. First, we define, conceptualize and demonstrate the existence of VPPMs. Next, using speculative design workshops, we explore and characterize the threats/risks posed, proposing mitigations and preventative recommendations against the malicious use of VPPMs. Finally, we implement two sample applications to demonstrate how existing VPPMs could be trivially subverted to create the potential for physical harm.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
