synthocr-gen: A synthetic ocr dataset generator for low-resource languages- breaking the data barrier

TL;DR

SynthOCR-Gen is an open-source tool that creates synthetic OCR datasets for low-resource languages, enabling the development of OCR systems where data scarcity has been a major obstacle.

Contribution

The paper introduces SynthOCR-Gen, a comprehensive pipeline for generating large-scale, annotated OCR datasets from Unicode text for low-resource languages.

Findings

Generated a 600,000-sample Kashmiri OCR dataset

Demonstrated the tool's effectiveness in supporting low-resource language OCR development

Released the dataset publicly on HuggingFace

Abstract

Optical Character Recognition (OCR) for low-resource languages remains a significant challenge due to the scarcity of large-scale annotated training datasets. Languages such as Kashmiri, with approximately 7 million speakers and a complex Perso-Arabic script featuring unique diacritical marks, currently lack support in major OCR systems including Tesseract, TrOCR, and PaddleOCR. Manual dataset creation for such languages is prohibitively expensive, time-consuming, and error-prone, often requiring word by word transcription of printed or handwritten text. We present SynthOCR-Gen, an open-source synthetic OCR dataset generator specifically designed for low-resource languages. Our tool addresses the fundamental bottleneck in OCR development by transforming digital Unicode text corpora into ready-to-use training datasets. The system implements a comprehensive pipeline encompassing text segmentation (character, word, n-gram, sentence, and line levels), Unicode normalization with script purity enforcement, multi-font rendering with configurable distribution, and 25+ data augmentation techniques simulating real-world document degradations including rotation, blur, noise, and scanner artifacts. We demonstrate the efficacy of our approach by generating a 600,000-sample word-segmented Kashmiri OCR dataset, which we release publicly on HuggingFace. This work provides a practical pathway for bringing low-resource languages into the era of vision-language AI models, and the tool is openly available for researchers and practitioners working with underserved writing systems worldwide.