Comparative Analysis of XGBoost and Minirocket Algortihms for Human Activity Recognition

TL;DR

This study compares XGBoost and MiniRocket algorithms for human activity recognition using smartphone sensor data, demonstrating high accuracy and efficiency, with XGBoost slightly outperforming MiniRocket in classification tasks.

Contribution

The paper provides a comparative analysis of XGBoost and MiniRocket for HAR, highlighting their performance and computational efficiency on a real-world dataset, which is a novel evaluation in this context.

Findings

Both algorithms achieve up to 0.99 accuracy and F1 scores.

XGBoost has faster training times than MiniRocket.

MiniRocket performs well with raw, unprocessed sensor data.

Abstract

Human Activity Recognition (HAR) has been extensively studied, with recent emphasis on the implementation of advanced Machine Learning (ML) and Deep Learning (DL) algorithms for accurate classification. This study investigates the efficacy of two ML algorithms, eXtreme Gradient Boosting (XGBoost) and MiniRocket, in the realm of HAR using data collected from smartphone sensors. The experiments are conducted on a dataset obtained from the UCI repository, comprising accelerometer and gyroscope signals captured from 30 volunteers performing various activities while wearing a smartphone. The dataset undergoes preprocessing, including noise filtering and feature extraction, before being utilized for training and testing the classifiers. Monte Carlo cross-validation is employed to evaluate the models' robustness. The findings reveal that both XGBoost and MiniRocket attain accuracy, F1 score, and AUC values as high as 0.99 in activity classification. XGBoost exhibits a slightly superior performance compared to MiniRocket. Notably, both algorithms surpass the performance of other ML and DL algorithms reported in the literature for HAR tasks. Additionally, the study compares the computational efficiency of the two algorithms, revealing XGBoost's advantage in terms of training time. Furthermore, the performance of MiniRocket, which achieves accuracy and F1 values of 0.94, and an AUC value of 0.96 using raw data and utilizing only one channel from the sensors, highlights the potential of directly leveraging unprocessed signals. It also suggests potential advantages that could be gained by utilizing sensor fusion or channel fusion techniques. Overall, this research sheds light on the effectiveness and computational characteristics of XGBoost and MiniRocket in HAR tasks, providing insights for future studies in activity recognition using smartphone sensor data.