ARfy: A Pipeline for Adapting 3D Scenes to Augmented Reality

TL;DR

ARfy is a pipeline that automatically adapts pre-existing 3D scenes for augmented reality without requiring user intervention or asset annotation, streamlining virtual content placement in physical environments.

Contribution

This work introduces ARfy, a novel pipeline that enables automatic adaptation of generic 3D scenes for AR, eliminating manual placement and annotation efforts.

Findings

Successfully adapts 3D scenes for AR in simulations

Provides evaluation tools for adaptive virtual content placement

Supports arbitrary physical spaces without user intervention

Abstract

Virtual content placement in physical scenes is a crucial aspect of augmented reality (AR). This task is particularly challenging when the virtual elements must adapt to multiple target physical environments that are unknown during development. AR authors use strategies such as manual placement performed by end-users, automated placement powered by author-defined constraints, and procedural content generation to adapt virtual content to physical spaces. Although effective, these options require human effort or annotated virtual assets. As an alternative, we present ARfy, a pipeline to support the adaptive placement of virtual content from pre-existing 3D scenes in arbitrary physical spaces. ARfy does not require intervention by end-users or asset annotation by AR authors. We demonstrate the pipeline capabilities using simulations on a publicly available indoor space dataset. ARfy automatically makes any generic 3D scene AR-ready and provides evaluation tools to facilitate future research on adaptive virtual content placement.