LLM-Driven Optimization of HTML Structure to Support Screen Reader Navigation

TL;DR

This paper presents a GenAI-powered browser plugin that dynamically restructures webpage content to improve screen reader navigation for visually impaired users, addressing accessibility challenges in online shopping.

Contribution

It introduces a real-time webpage restructuring method using GenAI to enhance screen reader support, a novel approach in web accessibility tools.

Findings

Significant improvement in header hierarchy and labeling accuracy.

Enhanced user experience demonstrated through user interviews.

Automated tools confirmed better accessibility of revised webpages.

Abstract

Online interactions and e-commerce are commonplace among BLV users. Despite the implementation of web accessibility standards, many e-commerce platforms continue to present challenges to screen reader users, particularly in areas like webpage navigation and information retrieval. We investigate the difficulties encountered by screen reader users during online shopping experiences. We conducted a formative study with BLV users and designed a web browser plugin that uses GenAI to restructure webpage content in real time. Our approach improved the header hierarchy and provided correct labeling for essential information. We evaluated the effectiveness of this solution using an automated accessibility tool and through user interviews. Our results show that the revised webpages generated by our system offer significant improvements over the original webpages regarding screen reader navigation experience. Based on our findings, we discuss its potential usage as both a user and developer tool that can significantly enhance screen reader accessibility of webpages.