Linking Physical Objects to Their Digital Twins via Fiducial Markers Designed for Invisibility to Humans

TL;DR

This paper introduces a novel method for linking physical objects to their digital twins using CSR-based fiducial markers that are invisible to humans but easily detectable by computer vision, enhancing security and integration.

Contribution

It proposes a new CSR-based fiducial marker system for secure, seamless linking of physical assets to digital models, addressing limitations of traditional codes.

Findings

CSR markers are easily detected by computer vision.

Markers remain practically invisible to humans.

Potential applications in autonomous navigation and augmented reality.

Abstract

The ability to label and track physical objects that are assets in digital representations of the world is foundational to many complex systems. Simple, yet powerful methods such as bar- and QR-codes have been highly successful, e.g. in the retail space, but the lack of security, limited information content and impossibility of seamless integration with the environment have prevented a large-scale linking of physical objects to their digital twins. This paper proposes to link digital assets created through BIM with their physical counterparts using fiducial markers with patterns defined by Cholesteric Spherical Reflectors (CSRs), selective retroreflectors produced using liquid crystal self-assembly. The markers leverage the ability of CSRs to encode information that is easily detected and read with computer vision while remaining practically invisible to the human eye. We analyze the potential of a CSR-based infrastructure from the perspective of BIM, critically reviewing the outstanding challenges in applying this new class of functional materials, and we discuss extended opportunities arising in assisting autonomous mobile robots to reliably navigate human-populated environments, as well as in augmented reality.