Neural Restoration of Greening Defects in Historical Autochrome Photographs Based on Purely Synthetic Data

TL;DR

This paper presents a novel AI-based method for automatically removing greening defects in digitized autochrome photographs by synthesizing defect data for training, enabling effective restoration of color artifacts in historical images.

Contribution

It introduces a synthetic data generation approach for defect simulation and a specialized training method for restoring autochromes with greening defects, addressing data scarcity and improving restoration accuracy.

Findings

Effective removal of greening defects demonstrated

Synthetic data enables training without real defect datasets

Outperforms existing manual and automated restoration techniques

Abstract

The preservation of early visual arts, particularly color photographs, is challenged by deterioration caused by aging and improper storage, leading to issues like blurring, scratches, color bleeding, and fading defects. Despite great advances in image restoration and enhancement in recent years, such systematic defects often cannot be restored by current state-of-the-art software features as available e.g. in Adobe Photoshop, but would require the incorporation of defect-aware priors into the underlying machine learning techniques. However, there are no publicly available datasets of autochromes with defect annotations. In this paper, we address these limitations and present the first approach that allows the automatic removal of greening color defects in digitized autochrome photographs. For this purpose, we introduce an approach for accurately simulating respective defects and use the respectively obtained synthesized data with its ground truth defect annotations to train a generative AI model with a carefully designed loss function that accounts for color imbalances between defected and non-defected areas. As demonstrated in our evaluation, our approach allows for the efficient and effective restoration of the considered defects, thereby overcoming limitations of alternative techniques that struggle with accurately reproducing original colors and may require significant manual effort.