Memory Reviver: Supporting Photo-Collection Reminiscence for People with Visual Impairment via a Proactive Chatbot

TL;DR

Memory Reviver is a proactive chatbot designed to assist people with visual impairment in reminiscing with photo collections, overcoming previous challenges by organizing information hierarchically and proactively guiding conversations.

Contribution

It introduces Memory Reviver with a hierarchical Memory Tree and proactive strategies, advancing chatbot support for photo reminiscence in visually impaired users.

Findings

Enhanced engagement in reminiscence activities

Improved understanding of photo collections

Natural conversational experience achieved

Abstract

Reminiscing with photo collections offers significant psychological benefits but poses challenges for people with visual impairment (PVI). Their current reliance on sighted help restricts the flexibility of this activity. In response, we explored using a chatbot in a preliminary study. We identified two primary challenges that hinder effective reminiscence with a chatbot: the scattering of information and a lack of proactive guidance. To address these limitations, we present Memory Reviver, a proactive chatbot that helps PVI reminisce with a photo collection through natural language communication. Memory Reviver incorporates two novel features: (1) a Memory Tree, which uses a hierarchical structure to organize the information in a photo collection; and (2) a Proactive Strategy, which actively delivers information to users at proper conversation rounds. Evaluation with twelve PVI demonstrated that Memory Reviver effectively facilitated engaging reminiscence, enhanced understanding of photo collections, and delivered natural conversational experiences. Based on our findings, we distill implications for supporting photo reminiscence and designing chatbots for PVI.