Trustworthy deep domain adaptation for wearable photoplethysmography signal analysis with decision-theoretic uncertainty quantification

TL;DR

This paper proposes a decision-theoretic framework to evaluate the trustworthiness of deep generative models in domain adaptation, demonstrated on photoplethysmography data for atrial fibrillation classification.

Contribution

It introduces a novel decision-theoretic uncertainty quantification approach to assess the quality and utility of generated data in domain adaptation tasks.

Findings

Framework effectively evaluates the trustworthiness of generated signals.

Application to PPG denoising improves AF classification accuracy.

Decision-theoretic approach aligns uncertainty with downstream task utility.

Abstract

In principle, deep generative models can be used to perform domain adaptation; i.e. align the input feature representations of test data with that of a separate discriminative model's training data. This can help improve the discriminative model's performance on the test data. However, generative models are prone to producing hallucinations and artefacts that may degrade the quality of generated data, and therefore, predictive performance when processed by the discriminative model. While uncertainty quantification can provide a means to assess the quality of adapted data, the standard framework for evaluating the quality of predicted uncertainties may not easily extend to generative models due to the common lack of ground truths (among other reasons). Even with ground truths, this evaluation is agnostic to how the generated outputs are used on the downstream task, limiting the extent to which the uncertainty reliability analysis provides insights about the utility of the uncertainties with respect to the intended use case of the adapted examples. Here, we describe how decision-theoretic uncertainty quantification can address these concerns and provide a convenient framework for evaluating the trustworthiness of generated outputs, in particular, for domain adaptation. We consider a case study in photoplethysmography time series denoising for Atrial Fibrillation classification. This formalises a well-known heuristic method of using a downstream classifier to assess the quality of generated outputs.