Exploiting Digital Surface Models for Inferring Super-Resolution for Remotely Sensed Images

TL;DR

This paper introduces a novel super-resolution method for remote sensing images that leverages pixel-level information from Digital Surface Models during training, resulting in highly realistic reconstructions without needing additional data during inference.

Contribution

The proposed approach uses nDSM data as a perceptual loss during training, improving remote sensing super-resolution without extra data at inference time.

Findings

Super-resolution images are visually superior and realistic.

Results on DFC2018 dataset are nearly indistinguishable from ground truth.

Method outperforms non-specialized SRR models on remote sensing data.

Abstract

Despite the plethora of successful Super-Resolution Reconstruction (SRR) models applied to natural images, their application to remote sensing imagery tends to produce poor results. Remote sensing imagery is often more complicated than natural images and has its peculiarities such as being of lower resolution, it contains noise, and often depicting large textured surfaces. As a result, applying non-specialized SRR models on remote sensing imagery results in artifacts and poor reconstructions. To address these problems, this paper proposes an architecture inspired by previous research work, introducing a novel approach for forcing an SRR model to output realistic remote sensing images: instead of relying on feature-space similarities as a perceptual loss, the model considers pixel-level information inferred from the normalized Digital Surface Model (nDSM) of the image. This strategy allows the application of better-informed updates during the training of the model which sources from a task (elevation map inference) that is closely related to remote sensing. Nonetheless, the nDSM auxiliary information is not required during production and thus the model infers a super-resolution image without any additional data besides its low-resolution pairs. We assess our model on two remotely sensed datasets of different spatial resolutions that also contain the DSM pairs of the images: the DFC2018 dataset and the dataset containing the national Lidar fly-by of Luxembourg. Based on visual inspection, the inferred super-resolution images exhibit particularly superior quality. In particular, the results for the high-resolution DFC2018 dataset are realistic and almost indistinguishable from the ground truth images.