Sketch Recognition using Domain Classification

TL;DR

This paper presents a sketch recognition system that simplifies the creation of domain-specific sketch recognition tools by enabling non-experts to classify and recognize sketches through segmentation and domain classification techniques.

Contribution

The system allows users without expertise in sketch recognition to build domain-specific recognition systems using heuristic segmentation and classification methods.

Findings

Successfully recognizes sketches across multiple domains

Enables non-experts to develop sketch recognition applications

Achieves smooth sketch rendering

Abstract

Conceptualizing away the sketch processing details in a user interface will enable general users and domain experts to create more complex sketches. There are many domains for which sketch recognition systems are being developed. But they entail image-processing skill if they are to handle the details of each domain, and also they are lengthy to build. The implemented system goal is to enable user interface designers and domain experts who may not have proficiency in sketch recognition to be able to construct these sketch systems. This sketch recognition system takes in rough sketches from user drawn with the help of mouse as its input. It then recognizes the sketch using segmentation and domain classification, the properties of the user drawn sketch and segments are searched heuristically in the domains and each figures of each domain, and finally it shows its domain, the figure name and properties. It also draws the sketch smoothly. The work is resulted through extensive research and study of many existing image processing and pattern matching algorithms.