Are UX evaluation methods truly accessible

TL;DR

This paper critically reviews and tests UX evaluation methods for Deaf users, revealing significant accessibility barriers and emphasizing the need for adapted methods to ensure inclusive and accurate user experience assessments.

Contribution

It provides a systematic analysis of existing UX evaluation methods for Deaf users, highlighting their limitations and proposing the necessity for tailored approaches.

Findings

Traditional methods rely on auditory and cognitive abilities unsuitable for Deaf users

Most evaluation methods lack consideration for communication accessibility

Adapted methods are essential for accurate assessment of Deaf users' experiences

Abstract

Providing an equitable and inclusive user experience (UX) for people with disabilities (PWD) is a central goal of accessible design. In the specific case of Deaf users, whose hearing impairments impact language development and communication, it is essential to consider their specific needs during software evaluation processes. This study aimed to analyze a set of UX evaluation methods suggested in the literature as suitable for Deaf individuals, with the goal of validating their level of accessibility in real-world contexts. The research was based on a critical review and practical application of these methods, identifying their strengths and limitations in relation to the interaction, perception, and comprehension of Deaf users. Traditional evaluation instruments, commonly designed for hearing individuals, pose significant barriers when applied to Deaf users due to their re-liance on auditory and cognitive abilities, as well as the lack of consideration for commu-nicational accessibility. The results show that although these methods are frequently rec-ommended, they exhibit critical shortcomings that hinder the collection of accurate and representative data. It is concluded that it is essential to adapt UX evaluation methods to ensure genuinely accessible processes that address the communicative and cognitive needs of the Deaf community and accurately reflect their user experience.