Ninja Codes: Neurally Generated Fiducial Markers for Stealthy 6-DoF Tracking

TL;DR

Ninja Codes are visually subtle, neurally generated fiducial markers that enable stealthy 6-DoF tracking in real-world environments, suitable for robotics and augmented reality applications.

Contribution

This work introduces Ninja Codes, a novel method for creating visually inconspicuous fiducial markers using neural encoding for stealthy tracking.

Findings

Reliable indoor tracking demonstrated under common lighting.

Markers blend into diverse environmental textures.

Can be printed with standard color printers and detected with RGB cameras.

Abstract

In this paper we describe Ninja Codes, neurally generated fiducial markers that can be made to naturally blend into various real-world environments. An encoder network converts arbitrary images into Ninja Codes by applying visually modest alterations; the resulting codes, printed and pasted onto surfaces, can provide stealthy 6-DoF location tracking for a wide range of applications including robotics and augmented reality. Ninja Codes can be printed using standard color printers on regular printing paper, and can be detected using any device equipped with a modern RGB camera and capable of running inference. Through experiments, we demonstrate Ninja Codes' ability to provide reliable location tracking under common indoor lighting conditions, while successfully concealing themselves within diverse environmental textures. We expect Ninja Codes to offer particular value in scenarios where the conspicuous appearance of conventional fiducial markers makes them undesirable for aesthetic and other reasons.