Enabling Tangible Interaction through Detection and Augmentation of Everyday Objects

TL;DR

This paper presents three tracking algorithms for detecting and recognizing everyday objects to enable augmented reality interactions, extending their functionalities beyond regular use in various environments.

Contribution

It introduces novel tracking algorithms and demonstrates how augmented reality can enhance tangible interaction with common objects.

Findings

Effective object tracking in diverse environments

Extended object functionalities via augmented reality

Feasibility of user-defined interactions with everyday items

Abstract

Digital interaction with everyday objects has become popular since the proliferation of camera-based systems that detect and augment objects "just-in-time". Common systems use a vision-based approach to detect objects and display their functionalities to the user. Sensors, such as color and depth cameras, have become inexpensive and allow seamless environmental tracking in mobile as well as stationary settings. However, object detection in different contexts faces challenges as it highly depends on environmental parameters and the conditions of the object itself. In this work, we present three tracking algorithms which we have employed in past research projects to track and recognize objects. We show, how mobile and stationary augmented reality can be used to extend the functionalities of objects. We conclude, how common items can provide user-defined tangible interaction beyond their regular functionality.