Realizing Half-Diminished Reality from Video Stream of Manipulating Objects

TL;DR

This paper presents a real-time method to generate Half-Diminished Reality videos, making hands semi-transparent to reveal manipulated objects clearly, enhancing visual understanding during object manipulation.

Contribution

It introduces a novel real-time Half-Diminished Reality technique that effectively visualizes manipulated objects by semi-transparently overlaying hands in video streams.

Findings

The method operates in real time with high accuracy.

It effectively reveals obscured parts of objects during manipulation.

The approach is validated through successful experiments.

Abstract

When we watch a video, in which human hands manipulate objects, these hands may obscure some parts of those objects. We are willing to make clear how the objects are manipulated by making the image of hands semi-transparent, and showing the complete images of the hands and the object. By carefully choosing a Half-Diminished Reality method, this paper proposes a method that can process the video in real time and verifies that the proposed method works well.