Uncovering the Metaverse within Everyday Environments: a Coarse-to-Fine Approach

TL;DR

This paper presents a vision-based method using Artcode markers to detect and localize hidden metaverse links in everyday environments, enabling interaction with augmented virtual worlds.

Contribution

It introduces a coarse-to-fine localization approach for uncovering embedded metaverse links in real-world settings using visual markers.

Findings

Effective Artcode localization demonstrated in experiments

Enables new interaction opportunities with virtual environments

Progressive localization improves detection accuracy

Abstract

The recent release of the Apple Vision Pro has reignited interest in the metaverse, showcasing the intensified efforts of technology giants in developing platforms and devices to facilitate its growth. As the metaverse continues to proliferate, it is foreseeable that everyday environments will become increasingly saturated with its presence. Consequently, uncovering links to these metaverse items will be a crucial first step to interacting with this new augmented world. In this paper, we address the problem of establishing connections with virtual worlds within everyday environments, especially those that are not readily discernible through direct visual inspection. We introduce a vision-based approach leveraging Artcode visual markers to uncover hidden metaverse links embedded in our ambient surroundings. This approach progressively localises the access points to the metaverse, transitioning from coarse to fine localisation, thus facilitating an exploratory interaction process. Detailed experiments are conducted to study the performance of the proposed approach, demonstrating its effectiveness in Artcode localisation and enabling new interaction opportunities.