Accessibility Scout: Personalized Accessibility Scans of Built Environments

TL;DR

Accessibility Scout leverages large language models to provide personalized, scalable accessibility assessments of built environments, adapting to individual needs through collaborative human-AI interaction.

Contribution

This work introduces Accessibility Scout, a novel LLM-based system that personalizes accessibility scans for built environments, addressing limitations of manual and generic automatic assessments.

Findings

Accurately identifies accessibility concerns from photos.

Personalizes scans based on user mobility and preferences.

Extends accessibility considerations beyond ADA standards.

Abstract

Assessing the accessibility of unfamiliar built environments is critical for people with disabilities. However, manual assessments, performed by users or their personal health professionals, are laborious and unscalable, while automatic machine learning methods often neglect an individual user's unique needs. Recent advances in Large Language Models (LLMs) enable novel approaches to this problem, balancing personalization with scalability to enable more adaptive and context-aware assessments of accessibility. We present Accessibility Scout, an LLM-based accessibility scanning system that identifies accessibility concerns from photos of built environments. With use, Accessibility Scout becomes an increasingly capable "accessibility scout", tailoring accessibility scans to an individual's mobility level, preferences, and specific environmental interests through collaborative Human-AI assessments. We present findings from three studies: a formative study with six participants to inform the design of Accessibility Scout, a technical evaluation of 500 images of built environments, and a user study with 10 participants of varying mobility. Results from our technical evaluation and user study show that Accessibility Scout can generate personalized accessibility scans that extend beyond traditional ADA considerations. Finally, we conclude with a discussion on the implications of our work and future steps for building more scalable and personalized accessibility assessments of the physical world.