Meta-Objects: Interactive and Multisensory Virtual Objects Learned from the Real World for Use in Augmented Reality

TL;DR

This paper introduces meta-objects, virtual entities that replicate real-world objects with multisensory and interactive features, enabling seamless, real-time augmented reality experiences within a scalable simulation platform.

Contribution

It presents a novel framework for creating fully integrated, multisensory virtual objects that mirror real-world counterparts for immersive AR applications.

Findings

Meta-objects enable real-time, multisensory AR interactions.

The framework supports scalable ecosystem integration.

Enhanced physical and action realism in virtual objects.

Abstract

We introduce the concept of a meta-object, a next-generation virtual object that inherits the form, properties, and functions of its real-world counterpart, enabling seamless synchronization, interaction, and sharing between the physical and virtual worlds. While plenty of today's virtual objects provide some sensory feedback and dynamic behavior, meta-objects fully integrate interactive and multisensory features within a structured data framework to enable real-time immersive experiences in a post-metaverse intelligent simulation platform. Three key components underpin the utilization of meta-objects in the post-metaverse: property-embedded modeling for physical and action realism, adaptive multisensory feedback tailored to user interactions, and a scene graph-based intelligence simulation platform for scalable and efficient ecosystem integration. By leveraging meta-objects through wearable AR/VR devices, the post-metaverse facilitates seamless interactions that transcend spatial and temporal barriers, paving the way for a transformative reality-virtuality convergence.