Applying Think-Aloud in ICTD: A Case Study of a Chatbot Use by Teachers in Rural C\^ote d'Ivoire

TL;DR

This study evaluates the effectiveness of think-aloud usability testing with teachers in rural Cote d'Ivoire to identify challenges in using a chatbot, highlighting cultural considerations in cross-cultural HCI methods.

Contribution

It demonstrates how think-aloud sessions can be adapted for cross-cultural settings in the Global South and provides insights into usability issues faced by teachers in rural contexts.

Findings

Identified usability challenges in chatbot navigation

Revealed culturally influenced interaction patterns

Provided recommendations for culturally sensitive design

Abstract

Think-alouds are a common HCI usability method where participants verbalize their thoughts while using interfaces. However, their utility in cross-cultural settings, particularly in the Global South, is unclear, where cultural differences impact user interactions. This paper investigates the usability challenges teachers in rural C\^ote d'Ivoire faced when using a chatbot designed to support an educational program. We conducted think-aloud sessions with 20 teachers two weeks after a chatbot deployment, analyzing their navigation, errors, and time spent on tasks. We discuss our approach and findings that helped us identify usability issues and challenging features for improving the chatbot designs. Our note summarizes our reflections on using think-aloud and contributes to discussions on its culturally sensitive adaptation in the Global South.