Connecting Everyday Objects with the Metaverse: A Unified Recognition Framework

TL;DR

This paper introduces a unified visual recognition framework to connect physical objects with virtual counterparts in the metaverse, demonstrated through experiments using decorative Artcode patterns for augmented reality interactions.

Contribution

It proposes a novel, comprehensive recognition framework for linking physical objects with virtual elements, facilitating seamless metaverse interactions.

Findings

The framework effectively recognizes objects under various conditions.

Artcode patterns enable attractive and unobtrusive virtual connections.

Experimental results demonstrate practical applicability in augmented reality environments.

Abstract

The recent Facebook rebranding to Meta has drawn renewed attention to the metaverse. Technology giants, amongst others, are increasingly embracing the vision and opportunities of a hybrid social experience that mixes physical and virtual interactions. As the metaverse gains in traction, it is expected that everyday objects may soon connect more closely with virtual elements. However, discovering this "hidden" virtual world will be a crucial first step to interacting with it in this new augmented world. In this paper, we address the problem of connecting physical objects with their virtual counterparts, especially through connections built upon visual markers. We propose a unified recognition framework that guides approaches to the metaverse access points. We illustrate the use of the framework through experimental studies under different conditions, in which an interactive and visually attractive decoration pattern, an Artcode, is used as the approach to enable the connection. This paper will be of interest to, amongst others, researchers working in Interaction Design or Augmented Reality who are seeking techniques or guidelines for augmenting physical objects in an unobtrusive, complementary manner.