Image Compression with Isotropic and Anisotropic Shepard Inpainting

TL;DR

This paper explores simplified Shepard inpainting variants for image compression, introducing anisotropy and data subdivision to improve quality and efficiency, outperforming traditional codecs like JPEG at high compression ratios.

Contribution

It presents novel extensions of Shepard inpainting, including anisotropy and data subdivision, and introduces joint inpainting and prediction for more efficient image compression.

Findings

Outperforms JPEG and JPEG2000 at high compression ratios.

Achieves a better trade-off between simplicity and quality.

Demonstrates the effectiveness of anisotropic Shepard inpainting.

Abstract

Inpainting-based codecs store sparse selected pixel data and decode by reconstructing the discarded image parts by inpainting. Successful codecs (coders and decoders) traditionally use inpainting operators that solve partial differential equations. This requires some numerical expertise if efficient implementations are necessary. Our goal is to investigate variants of Shepard inpainting as simple alternatives for inpainting-based compression. They can be implemented efficiently when we localise their weighting function. To turn them into viable codecs, we have to introduce novel extensions of classical Shepard interpolation that adapt successful ideas from previous codecs: Anisotropy allows direction-dependent inpainting, which improves reconstruction quality. Additionally, we incorporate data selection by subdivision as an efficient way to tailor the stored information to the image structure. On the encoding side, we introduce the novel concept of joint inpainting and prediction for isotropic Shepard codecs, where storage cost can be reduced based on intermediate inpainting results. In an ablation study, we show the usefulness of these individual contributions and demonstrate that they offer synergies which elevate the performance of Shepard inpainting to surprising levels. Our resulting approaches offer a more favourable trade-off between simplicity and quality than traditional inpainting-based codecs. Experiments show that they can outperform JPEG and JPEG2000 at high compression ratios.