Addressing database variability in learning from medical data: an ensemble-based approach using convolutional neural networks and a case of study applied to automatic sleep scoring

TL;DR

This paper proposes an ensemble-based convolutional neural network approach to improve the robustness and generalization of sleep scoring models across multiple external medical databases, addressing variability issues.

Contribution

It introduces a novel ensemble method that enhances cross-database generalization in sleep staging, along with analysis of data preprocessing and model configurations.

Findings

Ensemble models outperform single models in cross-database scenarios.

Data preprocessing significantly affects model generalization.

Ensemble approach improves scalability and robustness.

Abstract

In this work we examine some of the problems associated with the development of machine learning models with the objective to achieve robust generalization capabilities on common-task multiple-database scenarios. Referred to as the "database variability problem", we focus on a specific medical domain (sleep staging in sleep medicine) to show the non-triviality of translating the estimated model's local generalization capabilities into independent external databases. We analyze some of the scalability problems when multiple-database data are used as inputs to train a single learning model. Then, we introduce a novel approach based on an ensemble of local models, and we show its advantages in terms of inter-database generalization performance and data scalability. In addition, we analyze different model configurations and data pre-processing techniques to determine their effects on the overall generalization performance. For this purpose, we carry out experimentation that involves several sleep databases and evaluates different machine learning models based on convolutional neural networks