SimCleaner -- Sistema de Padroniza\c{c}\~ao de Bases de Dados utilizando Fun\c{c}\~oes de Similaridade

TL;DR

This paper introduces SimCleaner, a tool that uses similarity functions to standardize and clean databases, improving data consistency for better pattern detection in data mining tasks.

Contribution

The paper presents a novel data cleaning tool based on similarity functions that effectively standardizes databases, demonstrated on a public security system database.

Findings

Efficient standardization of a public security database

Reusable tool applicable to various databases

Improved data consistency for data mining

Abstract

The Knowledge Discovery in Database (KDD) process permits the detection of pattern in databases, where this analysis may be compromised if database is not consistent, making necessary the use of data cleaning techniques. This paper presents a tool based in similarity functions to help the preprocessing of databases and it behaved efficiently in the standardization of a System of Public Security of the State of Par\'a database and may be reused with other databases and other data mining projects.