# ML-KFHE: Multi-label ensemble classification algorithm exploiting sensor fusion properties of the Kalman filter

## TL;DR

This paper introduces ML-KFHE, a multi-label ensemble classification algorithm that leverages the sensor fusion capabilities of the Kalman filter, demonstrating significant performance improvements over existing methods on multiple datasets.

## Contribution

The paper proposes a novel multi-label ensemble method, ML-KFHE, utilizing Kalman filter sensor fusion, and introduces two variants based on HOMER and Classifier Chain algorithms.

## Key findings

- ML-KFHE significantly outperforms bagged HOMER and CC methods.
- ML-KFHE-HOMER consistently performs better than existing multi-label algorithms.
- Extensive experiments on thirteen datasets validate the effectiveness of ML-KFHE.

## Abstract

Despite the success of ensemble classification methods in multi-class classification problems, ensemble methods based on approaches other than bagging have not been widely explored for multi-label classification problems. The Kalman Filter-based Heuristic Ensemble (KFHE) is an ensemble method that exploits the sensor fusion properties of the Kalman filter to combine several classifier models, and that has been shown to be very effective. This work proposes a multi-label version of KFHE, ML-KFHE, demonstrating the effectiveness of the KFHE method on multi-label datasets. Two variants are introduced based on the underlying component classifier algorithm, ML-KFHE-HOMER, and ML-KFHE-CC which uses HOMER and Classifier Chain (CC) as the underlying multi-label algorithms respectively. ML-KFHE-HOMER and ML-KFHE-CC sequentially train multiple HOMER and CC multi-label classifiers and aggregate their outputs using the sensor fusion properties of the Kalman filter. Extensive experiments and detailed analysis were performed on thirteen multi-label datasets and eight other algorithms, which included state-of-the-art ensemble methods. The results show, for both versions, the ML-KFHE framework improves the predictive performance significantly with respect to bagged combinations of HOMER (named E-HOMER), also introduced in this paper, and bagged combination of CC, Ensemble Classifier Chains (ECC), thus demonstrating the effectiveness of ML-KFHE. Also, the ML-KFHE-HOMER variant was found to perform consistently and significantly better than the compared multi-label methods including existing approaches based on ensembles.