Newvision: application for helping blind people using deep learning

TL;DR

This paper presents a deep learning-based headgear designed to assist visually impaired individuals by providing real-time environmental information through computer vision, sensors, and voice interaction.

Contribution

It introduces a novel headgear integrating deep learning, ultrasonic sensors, and voice recognition to aid navigation and object identification for the visually impaired.

Findings

Prototype demonstrates effective object and obstacle detection.

User interaction via voice commands is successfully implemented.

Potential to improve independence for visually impaired users.

Abstract

As able-bodied people, we often take our vision for granted. For people who are visually impaired, however, their disability can have a significant impact on their daily lives. We are developing proprietary headgear that will help visually impaired people navigate their surroundings, identify objects and people, read text, and avoid obstacles. The headgear will use a combination of computer vision, distance estimation with ultrasonic sensors, voice recognition, and voice assistants to provide users with real-time information about their environment. Users will be able to interact with the headgear through voice commands, such as ''What is that?'' to identify an object or ''Navigate to the front door'' to find their way around. The headgear will then provide the user with a verbal description of the object or spoken navigation instructions. We believe that this headgear has the potential to make a significant difference in the lives of visually impaired people, allowing them to live more independently and participate more fully in society.