Weighting Scheme for a Pairwise Multi-label Classifier Based on the Fuzzy Confusion Matrix

TL;DR

This paper introduces a novel weighting scheme for pairwise multi-label classifiers using fuzzy confusion matrices, improving robustness against class imbalance and enhancing classification quality.

Contribution

It proposes a new correction method for label pairwise ensembles that incorporates classifier-specific competence measures and information-theoretic weighting.

Findings

Reduces vulnerability to class imbalance.

Achieves high classification quality across criteria.

Less sensitive to data set fluctuations.

Abstract

In this work we addressed the issue of applying a stochastic classifier and a local, fuzzy confusion matrix under the framework of multi-label classification. We proposed a novel solution to the problem of correcting label pairwise ensembles. The main step of the correction procedure is to compute classifier-specific competence and cross-competence measures, which estimates error pattern of the underlying classifier. At the fusion phase we employed two weighting approaches based on information theory. The classifier weights promote base classifiers which are the most susceptible to the correction based on the fuzzy confusion matrix. During the experimental study, the proposed approach was compared against two reference methods. The comparison was made in terms of six different quality criteria. The conducted experiments reveals that the proposed approach eliminates one of main drawbacks of the original FCM-based approach i.e. the original approach is vulnerable to the imbalanced class/label distribution. What is more, the obtained results shows that the introduced method achieves satisfying classification quality under all considered quality criteria. Additionally, the impact of fluctuations of data set characteristics is reduced.