DanmuA11y: Making Time-Synced On-Screen Video Comments (Danmu) Accessible to Blind and Low Vision Users via Multi-Viewer Audio Discussions

TL;DR

DanmuA11y transforms on-screen time-synced comments into accessible multi-viewer audio discussions, significantly improving comprehension and social engagement for blind and low vision users in video viewing.

Contribution

The paper introduces DanmuA11y, a novel system that makes Danmu comments accessible through audio discussions, addressing visual challenges for BLV viewers.

Findings

Improved Danmu comprehension among BLV viewers

Enhanced viewing experience and social connection

Significant positive feedback from user evaluations

Abstract

By overlaying time-synced user comments on videos, Danmu creates a co-watching experience for online viewers. However, its visual-centric design poses significant challenges for blind and low vision (BLV) viewers. Our formative study identified three primary challenges that hinder BLV viewers' engagement with Danmu: the lack of visual context, the speech interference between comments and videos, and the disorganization of comments. To address these challenges, we present DanmuA11y, a system that makes Danmu accessible by transforming it into multi-viewer audio discussions. DanmuA11y incorporates three core features: (1) Augmenting Danmu with visual context, (2) Seamlessly integrating Danmu into videos, and (3) Presenting Danmu via multi-viewer discussions. Evaluation with twelve BLV viewers demonstrated that DanmuA11y significantly improved Danmu comprehension, provided smooth viewing experiences, and fostered social connections among viewers. We further highlight implications for enhancing commentary accessibility in video-based social media and live-streaming platforms.