MPLite: Multi-Aspect Pretraining for Mining Clinical Health Records

TL;DR

MPLite introduces a multi-aspect pretraining framework that leverages structured medical data and lab results to improve patient health outcome predictions from electronic health records.

Contribution

The paper presents a novel multi-aspect pretraining approach using lab results to enhance medical concept representation and prediction accuracy in healthcare models.

Findings

Improves diagnosis prediction accuracy on MIMIC datasets.

Achieves higher weighted-F1 and recall scores.

Effectively integrates lab results with structured medical data.

Abstract

The adoption of digital systems in healthcare has resulted in the accumulation of vast electronic health records (EHRs), offering valuable data for machine learning methods to predict patient health outcomes. However, single-visit records of patients are often neglected in the training process due to the lack of annotations of next-visit information, thereby limiting the predictive and expressive power of machine learning models. In this paper, we present a novel framework MPLite that utilizes Multi-aspect Pretraining with Lab results through a light-weight neural network to enhance medical concept representation and predict future health outcomes of individuals. By incorporating both structured medical data and additional information from lab results, our approach fully leverages patient admission records. We design a pretraining module that predicts medical codes based on lab results, ensuring robust prediction by fusing multiple aspects of features. Our experimental evaluation using both MIMIC-III and MIMIC-IV datasets demonstrates improvements over existing models in diagnosis prediction and heart failure prediction tasks, achieving a higher weighted-F1 and recall with MPLite. This work reveals the potential of integrating diverse aspects of data to advance predictive modeling in healthcare.