Eye-See-You: Reverse Pass-Through VR and Head Avatars
Ankan Dash, Jingyi Gu, Guiling Wang, Chen Chen

TL;DR
RevAvatar is an AI-driven framework that reconstructs high-fidelity 3D head avatars from partial VR face data, improving social interaction and communication in virtual reality environments.
Contribution
The paper introduces RevAvatar, a novel AI-based system for reconstructing detailed 3D head avatars from partial observations, advancing VR social interaction capabilities.
Findings
Successfully reconstructs 3D head avatars from partial face data.
Creates a large VR-specific dataset with diverse occlusion scenarios.
Enhances social presence in VR through improved avatar realism.
Abstract
Virtual Reality (VR) headsets, while integral to the evolving digital ecosystem, present a critical challenge: the occlusion of users' eyes and portions of their faces, which hinders visual communication and may contribute to social isolation. To address this, we introduce RevAvatar, an innovative framework that leverages AI methodologies to enable reverse pass-through technology, fundamentally transforming VR headset design and interaction paradigms. RevAvatar integrates state-of-the-art generative models and multimodal AI techniques to reconstruct high-fidelity 2D facial images and generate accurate 3D head avatars from partially observed eye and lower-face regions. This framework represents a significant advancement in AI4Tech by enabling seamless interaction between virtual and physical environments, fostering immersive experiences such as VR meetings and social engagements.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFace recognition and analysis · Face Recognition and Perception · Social Robot Interaction and HRI
