Syst\`{e}me d'indexation et de recherche de vid\'{e}o int\'{e}grant un syst\`{e}me gestuel pour les personnes handicap\'{e}es

TL;DR

This paper presents a video indexing and retrieval system that incorporates gesture and voice commands to improve accessibility for disabled users, utilizing a weighted concept membership approach and a structured audio-visual data model.

Contribution

The paper introduces a novel video retrieval system that combines indexing, structured data, and multimodal access methods tailored for disabled users, with an implemented prototype.

Findings

Effective video retrieval with high precision

Multimodal access improves usability for disabled users

Prototype demonstrates practical feasibility

Abstract

The amount of audio-visual information has increased dramatically with the advent of High Speed Internet. Furthermore, technological advances in recent years in the field of information technology, have simplified the use of video data in various fields by the general public. This made it possible to store large collections of video documents into computer systems. To enable efficient use of these collections, it is necessary to develop tools to facilitate access to these documents and handling them. In this paper we propose a method for indexing and retrieval of video sequences in a video database of large dimension, based on a weighting technique to calculate the degree of membership of a concept in a video also a structuring of the data of the audio-visual (context / concept / video). Finally, we decided to create a search system, offering in addition to the usual commands, different types of access to the system, depending on the disability of the person. Indeed, the application consists of a search system but offers access to commands through voice or gestures. Our contribution at the experimental level consists with the implementation of prototype. We integrated the techniques proposed in system to evaluate it contributions in terms of effectiveness and precision.