A Prototype System for Controlling a Computer by Head Movements and Voice Commands

TL;DR

This paper presents a prototype multimodal system enabling people with severe disabilities to control a computer using head movements tracked by a camera and voice commands, offering an accessible alternative to traditional peripherals.

Contribution

The paper introduces a novel multimodal interface combining head movement tracking and voice commands specifically designed for disabled users to access computers.

Findings

Effective head movement tracking for cursor control

Successful voice command integration

Potential for improved accessibility for disabled users

Abstract

This paper introduces a new prototype system for controlling a PC by head movements and also with voice commands. Our system is a multimodal interface concerned with controlling the computer. The selected modes of interaction are speech and gestures. We are seeing the revolutionary of computers and information technologies into daily practice. Healthy people use keyboard, mouse, trackball, or touchpad for controlling the PC. However these peripheries are usually not suitable for handicapped people. They may have problems using these standard peripheries, for example when they suffer from myopathy, or cannot move their hands after an injury. Our system has been developed to provide computer access for people with severe disabilities. This system tracks the computer user's Head movements with a video camera and translates them into the movements of the mouse pointer on the screen and the voice as button presses. Therefore we are coming with a proposal system that can be used with handicapped people to control the PC.