Connecting Everyday Objects with the Metaverse: A Unified Recognition Framework
Liming Xu, Dave Towey, Andrew P. French, Steve Benford

TL;DR
This paper introduces a unified visual recognition framework to connect physical objects with virtual counterparts in the metaverse, demonstrated through experiments using decorative Artcode patterns for augmented reality interactions.
Contribution
It proposes a novel, comprehensive recognition framework for linking physical objects with virtual elements, facilitating seamless metaverse interactions.
Findings
The framework effectively recognizes objects under various conditions.
Artcode patterns enable attractive and unobtrusive virtual connections.
Experimental results demonstrate practical applicability in augmented reality environments.
Abstract
The recent Facebook rebranding to Meta has drawn renewed attention to the metaverse. Technology giants, amongst others, are increasingly embracing the vision and opportunities of a hybrid social experience that mixes physical and virtual interactions. As the metaverse gains in traction, it is expected that everyday objects may soon connect more closely with virtual elements. However, discovering this "hidden" virtual world will be a crucial first step to interacting with it in this new augmented world. In this paper, we address the problem of connecting physical objects with their virtual counterparts, especially through connections built upon visual markers. We propose a unified recognition framework that guides approaches to the metaverse access points. We illustrate the use of the framework through experimental studies under different conditions, in which an interactive and visually…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVisual Attention and Saliency Detection · Virtual Reality Applications and Impacts · Advanced Image and Video Retrieval Techniques
