Mouse Simulation Using Two Coloured Tapes

TL;DR

This paper introduces a novel camera-based HCI method using coloured tapes for gesture recognition to control mouse functions, offering an alternative to traditional hardware modifications.

Contribution

It presents a new computer vision approach using coloured tapes for gesture-based mouse control, enhancing robustness and user independence.

Findings

Effective gesture recognition with coloured tapes.

Comparable performance to traditional mouse devices.

Robustness across different users.

Abstract

In this paper, we present a novel approach for Human Computer Interaction (HCI) where, we control cursor movement using a real-time camera. Current methods involve changing mouse parts such as adding more buttons or changing the position of the tracking ball. Instead, our method is to use a camera and computer vision technology, such as image segmentation and gesture recognition, to control mouse tasks (left and right clicking, double-clicking, and scrolling) and we show how it can perform everything as current mouse devices can. The software will be developed in JAVA language. Recognition and pose estimation in this system are user independent and robust as we will be using colour tapes on our finger to perform actions. The software can be used as an intuitive input interface to applications that require multi-dimensional control e.g. computer games etc.