Fine-grained Correlation Loss for Regression

TL;DR

This paper introduces novel correlation-based loss functions for regression tasks in medical imaging, directly optimizing population-wise correlation metrics to improve performance over traditional point-wise loss functions.

Contribution

It proposes robust strategies for Pearson and Spearman correlation losses, enhancing stability and ranking accuracy in regression learning.

Findings

Significant performance improvements in ultrasound image regression tasks.

Robust Pearson correlation loss with outlier resistance and distribution regularization.

Effective coarse-to-fine scheme for Spearman rank correlation learning.

Abstract

Regression learning is classic and fundamental for medical image analysis. It provides the continuous mapping for many critical applications, like the attribute estimation, object detection, segmentation and non-rigid registration. However, previous studies mainly took the case-wise criteria, like the mean square errors, as the optimization objectives. They ignored the very important population-wise correlation criterion, which is exactly the final evaluation metric in many tasks. In this work, we propose to revisit the classic regression tasks with novel investigations on directly optimizing the fine-grained correlation losses. We mainly explore two complementary correlation indexes as learnable losses: Pearson linear correlation (PLC) and Spearman rank correlation (SRC). The contributions of this paper are two folds. First, for the PLC on global level, we propose a strategy to make it robust against the outliers and regularize the key distribution factors. These efforts significantly stabilize the learning and magnify the efficacy of PLC. Second, for the SRC on local level, we propose a coarse-to-fine scheme to ease the learning of the exact ranking order among samples. Specifically, we convert the learning for the ranking of samples into the learning of similarity relationships among samples. We extensively validate our method on two typical ultrasound image regression tasks, including the image quality assessment and bio-metric measurement. Experiments prove that, with the fine-grained guidance in directly optimizing the correlation, the regression performances are significantly improved. Our proposed correlation losses are general and can be extended to more important applications.