Accessibility evaluation of major assistive mobile applications available for the visually impaired

TL;DR

This paper evaluates the accessibility and usability of four popular AI/CV-based mobile apps for the visually impaired, highlighting challenges and areas for improvement to enhance independence and functionality.

Contribution

It provides a comprehensive assessment of existing AI/CV mobile apps for the visually impaired, combining guideline-based evaluation with user feedback to identify development gaps.

Findings

Apps face challenges in accuracy and response time

User feedback highlights privacy and energy efficiency concerns

Recommendations for improving app accessibility and usability

Abstract

People with visual impairments face numerous challenges in their daily lives, including mobility, access to information, independent living, and employment. Artificial Intelligence (AI) with Computer Vision (CV) has the potential to improve their daily lives, provide them with necessary independence, and it will also spawn new opportunities in education and employment. However, while many such AI/CV-based mobile applications are now available, these apps are still not the preferred choice amongst visually impaired persons and are generally limited to advanced users only, due to certain limitations. This study evaluates the challenges faced by visually impaired persons when using AI/CV-based mobile apps. Four popular AI/CV- based apps, namely Seeing AI, Supersense, Envision and Lookout, are assessed by blind and low-vision users. Hence these mobile applications are evaluated on a set of parameters, including generic parameters based on the Web Content Accessibility Guidelines (WCAG) and specific parameters related to mobile app testing. The evaluation not only focused on the guidelines but also on the feedback that was gathered from these users on parameters covering the apps' accuracy, response time, reliability, accessibility, privacy, energy efficiency and usability. The paper also identifies the areas of improvement in the development and innovation of these assistive apps. This work will help developers create better accessible AI-based apps for the visually impaired.