Evaluation Framework for Computer Vision-Based Guidance of the Visually Impaired

TL;DR

This paper introduces an evaluation framework for computer vision systems aimed at guiding visually impaired individuals in critical situations, addressing the lack of standardized assessment methods in this field.

Contribution

It presents a novel evaluation framework that includes labeling interfaces and decision comparison methods for assessing computer vision guidance accuracy.

Findings

Framework enables systematic comparison of human and computer decisions.

Proposes specific evaluation criteria for simplified guiding instructions.

Facilitates development of more reliable assistive guidance systems.

Abstract

Visually impaired persons have significant problems in their everyday movement. Therefore, some of our previous work involves computer vision in developing assistance systems for guiding the visually impaired in critical situations. Some of those situations includes crosswalks on road crossings and stairs in indoor and outdoor environment. This paper presents an evaluation framework for computer vision-based guiding of the visually impaired persons in such critical situations. Presented framework includes the interface for labeling and storing referent human decisions for guiding directions and compares them to computer vision-based decisions. Since strict evaluation methodology in this research field is not clearly defined and due to the specifics of the transfer of information to visually impaired persons, evaluation criterion for specific simplified guiding instructions is proposed.