Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibration

TL;DR

This paper introduces a dual-view pyramid pooling method that combines spatial and cross-channel pooling to enhance medical image classification accuracy and confidence calibration in deep neural networks.

Contribution

It systematically analyzes the roles of spatial and cross-channel pooling and proposes a novel dual-view pyramid pooling method to leverage their strengths for improved performance.

Findings

DVPP outperforms existing pooling methods in classification accuracy.

DVPP improves confidence calibration across multiple DNN architectures.

Extensive experiments on six medical datasets validate the effectiveness of DVPP.

Abstract

Spatial pooling (SP) and cross-channel pooling (CCP) operators have been applied to aggregate spatial features and pixel-wise features from feature maps in deep neural networks (DNNs), respectively. Their main goal is to reduce computation and memory overhead without visibly weakening the performance of DNNs. However, SP often faces the problem of losing the subtle feature representations, while CCP has a high possibility of ignoring salient feature representations, which may lead to both miscalibration of confidence issues and suboptimal medical classification results. To address these problems, we propose a novel dual-view framework, the first to systematically investigate the relative roles of SP and CCP by analyzing the difference between spatial features and pixel-wise features. Based on this framework, we propose a new pooling method, termed dual-view pyramid pooling (DVPP), to aggregate multi-scale dual-view features. DVPP aims to boost both medical image classification and confidence calibration performance by fully leveraging the merits of SP and CCP operators from a dual-axis perspective. Additionally, we discuss how to fulfill DVPP with five parameter-free implementations. Extensive experiments on six 2D/3D medical image classification tasks show that our DVPP surpasses state-of-the-art pooling methods in terms of medical image classification results and confidence calibration across different DNNs.