Text images processing system using artificial intelligence models

TL;DR

This paper presents an AI-based text image processing system capable of classifying images into categories like Invoice or Report, effectively handling challenging conditions with a recognition rate of 94.62%.

Contribution

It introduces an integrated AI-driven workflow combining DBNet++ and BART models for robust text detection and classification in diverse imaging scenarios.

Findings

Achieved 94.62% text recognition accuracy on Total-Text dataset.

Effectively handles challenging conditions like low resolution and partial coverage.

Supports both gallery and live camera modes.

Abstract

This is to present a text image classifier device that identifies textual content in images and then categorizes each image into one of four predefined categories, including Invoice, Form, Letter, or Report. The device supports a gallery mode, in which users browse files on flash disks, hard disk drives, or microSD cards, and a live mode which renders feeds of cameras connected to it. Its design is specifically aimed at addressing pragmatic challenges, such as changing light, random orientation, curvature or partial coverage of text, low resolution, and slightly visible text. The steps of the processing process are divided into four steps: image acquisition and preprocessing, textual elements detection with the help of DBNet++ (Differentiable Binarization Network Plus) model, BART (Bidirectional Auto-Regressive Transformers) model that classifies detected textual elements, and the presentation of the results through a user interface written in Python and PyQt5. All the stages are connected in such a way that they form a smooth workflow. The system achieved a text recognition rate of about 94.62% when tested over ten hours on the mentioned Total-Text dataset, that includes high resolution images, created so as to represent a wide range of problematic conditions. These experimental results support the effectiveness of the suggested methodology to practice, mixed-source text categorization, even in uncontrolled imaging conditions.