Using Qualitative Hypotheses to Identify Inaccurate Data

TL;DR

This paper introduces a novel method using qualitative correlations and a support coefficient function to identify inaccurate data, demonstrated through infrared spectra analysis with superior results over traditional methods.

Contribution

The paper presents a new approach leveraging qualitative correlations and support coefficient functions to improve inaccurate data detection in datasets.

Findings

The method effectively identifies inaccurate data in infrared spectra.

It outperforms conventional data correction methods.

The approach is applicable to real-world spectral data.

Abstract

Identifying inaccurate data has long been regarded as a significant and difficult problem in AI. In this paper, we present a new method for identifying inaccurate data on the basis of qualitative correlations among related data. First, we introduce the definitions of related data and qualitative correlations among related data. Then we put forward a new concept called support coefficient function (SCF). SCF can be used to extract, represent, and calculate qualitative correlations among related data within a dataset. We propose an approach to determining dynamic shift intervals of inaccurate data, and an approach to calculating possibility of identifying inaccurate data, respectively. Both of the approaches are based on SCF. Finally we present an algorithm for identifying inaccurate data by using qualitative correlations among related data as confirmatory or disconfirmatory evidence. We have developed a practical system for interpreting infrared spectra by applying the method, and have fully tested the system against several hundred real spectra. The experimental results show that the method is significantly better than the conventional methods used in many similar systems.