A hybrid filtering method with no-reference quality assessment for synthetic aperture sonar images

TL;DR

This paper introduces a new hybrid filtering method with a no-reference quality assessment for improving synthetic aperture sonar images.

Contribution

The novel contribution is a hybrid filtering method with an objective no-reference quality assessment for SAS images.

Findings

The hybrid method outperforms mid-value and mean-value filtering in noise suppression.

The proposed no-reference quality assessment efficiently evaluates filtering performance.

The method preserves image edges better than existing techniques.

Abstract

Synthetic Aperture Sonar (SAS) imaging technology is wildly used in the underwater applications. In the work process of SAS imaging, filtering technologies are important for SAS imaging, which can suppress different noises to improve signal quality. However, the existing filtering methods face many challenges, such as insufficient noise suppression, degradation of image detail, edge blurring and so on. Furthermore, the existing quality assessments for filtering methods are sometimes subjective, which limits the research development for filtering technologies. To solve these problems, we propose a hybrid filtering method with a no-reference quality assessment for SAS images in this paper. The proposed method includes two-stages, the first stage is to suppress local statistical interference, and the second stage is to preserve edge information by weighted smoothing. With the no-reference quality assessment, the hybrid filtering method and other filtering methods, including mid-value filtering and mean-value filtering methods, are investigated. The numerical results show that the no-reference quality assessment method can efficiently analyze different filtering methods, and the proposed methods can perform better than other filtering methods.

Figures

Filtering results comparison.

Equations

Full text

1 Introduction

In underwater environments where traditional optical and electromagnetic sensing methods are limited, severe challenges arise in human cognition of the underwater world due to light attenuation and the short propagation distance of electromagnetic waves. Consequently, underwater regions are often referred to as “blind spots" in human perception [1,2]. Synthetic aperture sonar (SAS) imaging, as an acoustic wave-based imaging technique, effectively overcomes these limitations by leveraging the physical property that sound waves propagate efficiently and over long distances in water [3]. Currently, sonar imaging has been widely applied in key fields such as fundamental scientific research, national security, engineering construction, and resource exploration, becoming a “core infrastructure" supporting the development of intelligent underwater perception systems. With continuous improvements in resolution and imaging accuracy, sonar images are steadily expanding the boundaries of human perception of the deep-sea world [4–7].

In the SAS image processing workflow, filtering technology plays a crucial role as a key preprocessing step [8,9]. Its primary objectives are to suppress multi-source noise and enhance target signals, thereby providing a clear and reliable image foundation for subsequent high-level tasks such as target detection, terrain mapping, and ecological analysis [10–12]. The noise components in SAS images are complex, commonly including random noise, stripe noise, impulse noise, and attenuation or blurring caused by the propagation process. These factors directly affect the usability and analytical accuracy of images, for example, increasing false detection rates or causing inaccurate terrain boundaries. Therefore, filtering is regarded as the “first line of defense” in the SAS image analysis process [13–17].

Through proper filtering operations, noise interference can be effectively suppressed, significantly enhancing image quality [18–20]. For example, after noise suppression, previously obscured target details become visible, and edge structures in the image become clearer, which helps improve the accuracy of subsequent recognition and analysis [21,22]. Furthermore, image enhancement filtering techniques can adjust image contrast and brightness, highlighting edges and texture features, thereby assisting operators in intuitively judging spatial characteristics of targets such as position, shape, and size [23–26]. Additionally, filtering can emphasize key features in the image (such as texture, edges, and geometric shapes) and strengthen the contrast between targets and background, thereby significantly improving target recognition accuracy and reliability, ultimately providing more valuable visual information for underwater operations [12,27]. Among numerous filtering methods, median filtering and mean filtering are widely used due to their simplicity and effectiveness. Median filtering, proposed by J.W. Tukey in 1971, is a nonlinear filtering method based on order statistics theory, which effectively removes impulse noise while smoothing the image and preserving edge information. However, classical median filters may cause loss of image detail during noise reduction [28]. To address this issue, various improved algorithms have been proposed. For instance, Brownrigg introduced weighted median filtering, which assigns different weights to pixels within the filtering window to prioritize noise suppression and protect signal points. Additionally, variants based on fuzzy logic and adaptive mechanisms have emerged to further balance noise removal capability and detail preservation [29–31]. Signal processing challenges in underwater environments extend beyond sonar imaging to encompass various sensor modalities used in marine robotics and autonomous underwater vehicles (AUVs). Similar to SAS imaging, these systems often employ rotary encoders and position sensors that face comparable noise interference and signal degradation issues [32,33]. The fundamental principles of noise suppression and signal enhancement developed for such applications can provide valuable insights for improving sonar image processing methodologies.

In contrast, mean filtering [34], as a linear image smoothing technique, works by averaging pixel values within a local neighborhood to reduce local grayscale variations, thereby suppressing random noise in the image. Since the 1960s, mean filtering has been extensively applied in fields such as medical image processing, remote sensing image analysis, and computer vision [35]. Although this method performs well in noise suppression, its ability to protect image details is limited. With advancements in image processing algorithms and computational resources, modern research is attempting to integrate traditional mean filtering methods with new technologies such as deep learning and adaptive control to enhance performance and intelligence across diverse application scenarios [36]. In the process of SAS image processing and filter algorithm optimization, image quality evaluation methods play an indispensable role [37,38]. Acting as a bridge between theoretical algorithms and practical applications, quality evaluation methods not only provide objective measurements of filtering effects but also serve as the foundation for technological iteration, optimization, and standardization. By clearly defining evaluation metrics such as signal-to-noise ratio (SNR), mean squared error (MSE), and structural similarity index (SSIM), the filtering performance can be comprehensively assessed in terms of noise suppression, detail preservation, and edge integrity. These metrics offer unified quantitative standards for comparing different filtering algorithms or parameter settings and provide guidance for algorithm selection and system tuning [39–42].

Moreover, combining image quality evaluation metrics with algorithm performance indicators (such as computational complexity, runtime, and memory consumption) helps find an optimal balance between effectiveness and resource usage, improving overall system efficiency and practicality [43–45]. By analyzing trends in evaluation metrics, researchers can identify current algorithm limitations and further promote developments toward “stronger noise suppression, less detail loss, and higher adaptability.” Meanwhile, a unified quality evaluation system facilitates the establishment of industry standards, enhancing comparability and reproducibility of results across different research teams and application platforms, thus avoiding discrepancies caused by inconsistent standards [46–49].

In summary, considering the importance of SAS imaging, filtering as a fundamental preprocessing technology undertakes the dual responsibilities of noise suppression and information enhancement, while image quality evaluation methods provide scientific and quantitative assessment criteria. Together, these three elements form a tightly integrated technical loop within intelligent underwater perception systems, serving as key driving forces for continuous advancement in sonar image processing technology and the deep integration of theory and practice [50–52].

In this paper, we propose a two-stage hybrid filtering method, including local statistical interference suppression and edge-preserving weighted smoothing, to solve the problems in SAS imaging. The no-reference quality assessment is also adopted to evaluate the performance of the filtering methods. The experimental results show the proposed filtering method can perform better than other filtering methods with good filtering effect.

2 Methodology

2.1 Hybrid filtering

To enhance the processability and robustness of the original image in subsequent analysis tasks, this paper designs and adopts a two-stage image preprocessing framework, which respectively achieves robust suppression of local strong interference and edge-sensitive nonlinear smoothing reconstruction. The algorithm is described as follows.

Stage One: Local statistical interference suppression

Let the input image be $[eqn]$ , where $[eqn]$ is the 2D spatial domain, and $[eqn]$ is the RGB intensity vector at pixel (x,y), with $[eqn]$ denoting the red, green, and blue intensity components, respectively. To address isolated extreme pixel values that may appear in the image, this paper first performs local statistical mapping on each color channel $[eqn]$ individually. Specifically, for any pixel location (x,y), its local neighborhood is defined as Nk(x,y), where $[eqn]$ denotes the neighborhood size, and the local intensity set is constructed as:

$$[eqn]$$ $$[eqn]$$

Based on this, a sorting statistical operation is applied to the set Sc(x,y), from which a representative central statistic $[eqn]$ is extracted as the updated value for the current pixel, generating the intermediate image $[eqn]$ . The specific calculation is as follows:

$$[eqn]$$

where $[eqn]$ denotes the sorted version of Sc(x,y), and $[eqn]$ represents the maximum pixel intensity in the neighborhood;

$$[eqn]$$

Stage Two: Edge-preserving weighted smoothing

For each pixel location (x,y) in channel c, its smoothed output value $[eqn]$ is defined as:

$$[eqn]$$

where Nd(x,y) denotes the spatial neighborhood centered at pixel (x,y), $[eqn]$ is the exponential function, $[eqn]$ is the squared Euclidean distance between two 2D coordinates. $[eqn]$ is the standard deviation in the intensity domain, used to measure pixel value similarity and control the influence of color consistency on the weights; $[eqn]$ is the standard deviation in the spatial domain, used to measure geometric distance and suppress the influence of distant regions on the current pixel. Zc(x,y) is the normalization factor, defined as:

$$[eqn]$$

This weighting mechanism constructs an adaptive local fusion function centered on intensity similarity and spatial proximity. Its core advantage lies in performing significant smoothing in structurally consistent regions while preserving edges from being blurred, thereby significantly improving visual consistency and structural fidelity of the image.

In summary, the first-stage operation has nonlinear and non-local mean characteristics, which can significantly reduce the impact of impulse-like disturbances and avoid edge blurring caused by linear smoothing. While the first stage effectively mitigates extreme pixel interference, low-amplitude high-frequency noise may still exist in real images, especially in textured areas. The second stage adopts a structure-aware nonlinear filtering method that accounts for both spatial proximity and intensity similarity to reconstruct the result of the first stage with detail preservation and noise suppression.

2.2 No-reference quality assessment method

A method, named Unified Quality Assessment method for Sonar Imaging and Processing (UASIP), was proposed in [50], whose core concept is Attribute Consistency. Specifically, the UASIP method evaluates image quality from both perceptual and structural perspectives, and defines four key quality attributes:

Region Discrimination (RD): assesses the separability between targets and background in the grayscale domain.Geometric Integrity (GI): reflects the fidelity of the target’s spatial structure.Detail Preservation (DP): evaluates the richness and spatial distribution of texture information.Cleanness Level (CL): measures the degree of noise suppression and background interference.

Based on these attributes, the method constructs a lightweight 10-dimensional feature vector that comprehensively represents the above information. This vector is then mapped to a continuous quality score using Support Vector Regression (SVR), enabling effective and objective sonar image quality assessment.

2.2.1 Region discrimination.

Global Region Discrimination is quantified by the Kullback-Leibler (KL) divergence between the grayscale histogram f(t) of the image and a uniform distribution g(t):

$$[eqn]$$

Local Region Discrimination is modeled using local contrast maps:

$$[eqn]$$

where $[eqn]$ denotes the local standard deviation. Robust features are then extracted using the diagonal wavelet coefficients Wd1:

$$[eqn]$$

2.2.2 Geometric integrity.

Geometric fidelity is evaluated via contour detection under a biologically-inspired inhibition mechanism. A positive response image is first generated using a Difference of Gaussian (DoG) operation. After applying a Heaviside function $[eqn]$ , a normalized weight map is obtained:

$$[eqn]$$

This is combined with the edge mask Ms(x,y) to compute the suppressed contour response:

$$[eqn]$$

A Generalized Gaussian Distribution (GGD) is then fitted to S(x,y):

$$[eqn]$$

with:

$$[eqn]$$

Additionally, the entropy of the contour image is calculated to quantify geometric complexity:

$$[eqn]$$

2.2.3 Detail preservation.

Detail preservation is modeled using the Gray-Level Co-occurrence Matrix (GLCM):

$$[eqn]$$

where d = 1 and $[eqn]$ . The function $[eqn]$ is a conditional function defined as

$$[eqn]$$

Then, texture entropy and correlation are computed as:

$$[eqn]$$ $$[eqn]$$

where N is the number of gray levels. $[eqn]$ and $[eqn]$ are the mean values of the ith and jth gray levels, respectively. $[eqn]$ and $[eqn]$ represent the respective standard deviations of images.

The correlation value corresponding to the direction with the maximum texture entropy is selected as the detail feature.

2.2.4 Cleanness level.

Cleanness reflects the degree of noise suppression in the image. A Gaussian filter FG is applied to obtain a residual map:

$$[eqn]$$

A GGD is fitted to the residual map to extract the shape parameter α and variance $[eqn]$ . The entropy of the residual distribution is then computed as:

$$[eqn]$$

2.2.5 Quality score regression.

The four attribute-specific feature vectors $[eqn]$ are concatenated into a compact 10-dimensional feature vector s. This is input to a Support Vector Regression (SVR) model to produce a continuous quality score:

$$[eqn]$$

where $[eqn]$ denotes the Radial Basis Function (RBF) kernel, $[eqn]$ is the ground-truth quality score of the i-th training sample, and si is its corresponding feature vector.

3 Experimental results

Table 1 presents the perceptual quality assessment results of different filtering methods on three typical underwater sonar target categories (Ship, Human, and Aircraft), evaluated using UASIP (Unified Quality Assessment method for Sonar Imaging and Processing). As a unified standard for assessing underwater image quality, UASIP comprehensively considers structural preservation, noise suppression capability, and target saliency. It effectively measures how well a filtering method supports downstream perception tasks such as detection and recognition.

Table 1: UASIP scores (%) of different filtering methods on three sonar target categories.

Experimental results show that the hybrid filtering method achieved the highest UASIP scores across all target categories—62.8821%, 54.5824%, and 56.2959% for Aircraft, Human, and Ship, respectively—representing improvements of 4.57%, 5.14%, and 3.44% over the unprocessed original images. This hybrid method combines median filtering and bilateral filtering in series: the median filter effectively suppresses impulsive high-frequency noise, enhancing local robustness, while the bilateral filter further smooths the image guided by both spatial proximity and pixel similarity, all while preserving edge structures. The organic integration of these two filters leverages their respective strengths, achieving a sound balance between denoising and structural information preservation. This results in outstanding structural perception performance and strong cross-category adaptability.

In comparison, the median filtering method also yields relatively high UASIP scores for the Human and Ship categories, at 53.4749% and 54.3685%, respectively, and outperforms both mean filtering and the original images. This suggests that the median filter excels at preserving edge details, especially when dealing with images that have high local contrast or well-defined object contours. However, for the Aircraft category, its UASIP score is only slightly higher than that of the original image (58.7307% vs. 58.3143%), indicating limited enhancement in handling large-scale structures or regions with weak textures.

While the mean filtering method is computationally efficient and simple to implement, it performs poorly in terms of structural preservation. Its UASIP scores for the three target categories are 56.8897%, 51.4314%, and 51.0448%, consistently lower than those of the median and hybrid filtering methods. Mean filtering smooths the image by computing the arithmetic mean of neighboring pixels, which can reduce noise to some extent. However, it also tends to blur edges and weaken details, ultimately degrading structural perception. This makes it unsuitable for tasks that are highly sensitive to edge and texture information. In particular, the comparison results of the three different filters are shown in Fig 1.

Filtering results comparison.

4 Conclusion

In this paper, a two-stage hybrid filtering method is proposed to suppress noise and preserve edge information in the SAS images. Moreover, we adopt a no-reference quality assessment to evaluate image quality from perceptual and structural perspectives. From the experimental results and filtering effect, it is found that the proposed hybrid filtering method can achieve higher UASIP score than other filtering method, and the filtering effect of the proposed method is also better than the counterparts. The filtering method and quality assessment method are all important for SAS imaging, and we will further investigate these two parts to promote the SAS imaging technology in the future.