Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data

TL;DR

This paper demonstrates that self-supervised learning significantly improves anomaly detection in structural health monitoring data, especially when labeled data is scarce, by effectively utilizing large amounts of unlabeled data.

Contribution

The work introduces a self-supervised learning framework for SHM anomaly detection that outperforms traditional supervised methods with limited labeled data.

Findings

SSL methods increase F1 scores over supervised training.

SSL effectively leverages unlabeled SHM data for anomaly detection.

The approach is validated on real bridge monitoring data.

Abstract

Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective utilization. Recently, deep learning has emerged as an efficient and effective approach for anomaly detection in bridge SHM. Despite its progress, many deep learning models require large amounts of labeled data for training. The process of labeling data, however, is labor-intensive, time-consuming, and often impractical for large-scale SHM datasets. To address these challenges, this work explores the use of self-supervised learning (SSL), an emerging paradigm that combines unsupervised pre-training and supervised fine-tuning. The SSL-based framework aims to learn from only a very small quantity of labeled data by fine-tuning, while making the best use of the vast amount of unlabeled SHM data by pre-training. Mainstream SSL methods are compared and validated on the SHM data of two in-service bridges. Comparative analysis demonstrates that SSL techniques boost data anomaly detection performance, achieving increased F1 scores compared to conventional supervised training, especially given a very limited amount of labeled data. This work manifests the effectiveness and superiority of SSL techniques on large-scale SHM data, providing an efficient tool for preliminary anomaly detection with scarce label information.