Real-Time Pill Identification for the Visually Impaired Using Deep Learning

TL;DR

This paper presents a deep learning mobile app using YOLO for real-time pill identification to assist visually impaired users, improving medication safety and independence.

Contribution

It introduces a novel mobile application integrating YOLO and TTS for real-time pill recognition tailored for visually impaired individuals.

Findings

High detection accuracy demonstrated in tests

Positive user feedback on usability and effectiveness

Potential to enhance medication safety for the visually impaired

Abstract

The prevalence of mobile technology offers unique opportunities for addressing healthcare challenges, especially for individuals with visual impairments. This paper explores the development and implementation of a deep learning-based mobile application designed to assist blind and visually impaired individuals in real-time pill identification. Utilizing the YOLO framework, the application aims to accurately recognize and differentiate between various pill types through real-time image processing on mobile devices. The system incorporates Text-to- Speech (TTS) to provide immediate auditory feedback, enhancing usability and independence for visually impaired users. Our study evaluates the application's effectiveness in terms of detection accuracy and user experience, highlighting its potential to improve medication management and safety among the visually impaired community. Keywords-Deep Learning; YOLO Framework; Mobile Application; Visual Impairment; Pill Identification; Healthcare