Introducing Hann windows for reducing edge-effects in patch-based image segmentation

TL;DR

This paper proposes using Hann windows to mitigate edge effects in patch-based image segmentation, significantly improving the quality of CNN predictions on large images by reducing artifacts at patch borders.

Contribution

It introduces a signal processing windowing technique, specifically the Hann window, to enhance patch-based segmentation accuracy without modifying existing CNN models.

Findings

Hann window outperforms other tested windows in SSIM improvement.

Applying windowing reduces edge artifacts in patch-based segmentation.

Method is compatible with any CNN model for segmentation.

Abstract

There is a limitation in the size of an image that can be processed using computationally demanding methods such as e.g. Convolutional Neural Networks (CNNs). Some imaging modalities - notably biological and medical - can result in images up to a few gigapixels in size, meaning that they have to be divided into smaller parts, or patches, for processing. However, when performing image segmentation, this may lead to undesirable artefacts, such as edge effects in the final re-combined image. We introduce windowing methods from signal processing to effectively reduce such edge effects. With the assumption that the central part of an image patch often holds richer contextual information than its sides and corners, we reconstruct the prediction by overlapping patches that are being weighted depending on 2-dimensional windows. We compare the results of four different windows: Hann, Bartlett-Hann, Triangular and a recently proposed window by Cui et al., and show that the cosine-based Hann window achieves the best improvement as measured by the Structural Similarity Index (SSIM). The proposed windowing method can be used together with any CNN model for segmentation without any modification and significantly improves network predictions.