A Deep-Learning Method Using Auto-encoder and Generative Adversarial Network for Anomaly Detection on Ancient Stone Stele Surfaces

TL;DR

This paper introduces a deep-learning approach combining autoencoders and GANs for real-time, unsupervised anomaly detection on ancient stone stele surfaces, enhancing preservation efforts with high accuracy and no need for extensive anomaly samples.

Contribution

It presents a novel unsupervised deep-learning method using AE and GAN architectures for anomaly detection in cultural heritage preservation, requiring no extensive anomaly samples.

Findings

Reconstruction accuracy of 99.74% on case study

Proficient detection of seven artificially designed anomalies

No false alarms during evaluation

Abstract

Accurate detection of natural deterioration and man-made damage on the surfaces of ancient stele in the first instance is essential for their preventive conservation. Existing methods for cultural heritage preservation are not able to achieve this goal perfectly due to the difficulty of balancing accuracy, efficiency, timeliness, and cost. This paper presents a deep-learning method to automatically detect above mentioned emergencies on ancient stone stele in real time, employing autoencoder (AE) and generative adversarial network (GAN). The proposed method overcomes the limitations of existing methods by requiring no extensive anomaly samples while enabling comprehensive detection of unpredictable anomalies. the method includes stages of monitoring, data acquisition, pre-processing, model structuring, and post-processing. Taking the Longmen Grottoes' stone steles as a case study, an unsupervised learning model based on AE and GAN architectures is proposed and validated with a reconstruction accuracy of 99.74\%. The method's evaluation revealed the proficient detection of seven artificially designed anomalies and demonstrated precision and reliability without false alarms. This research provides novel ideas and possibilities for the application of deep learning in the field of cultural heritage.