A Gray Level Indicator-Based Regularized Telegraph Diffusion Equation Applied to Image Despeckling
Sudeb Majee, Rajendra K Ray, Ananta K Majee

TL;DR
This paper introduces a novel non-linear telegraph diffusion model incorporating gray level indicators for effective image despeckling, combining diffusion and wave equations to better preserve textures and oscillations.
Contribution
The paper presents a new diffusion model that integrates gray level information and wave effects, improving noise removal while maintaining image details.
Findings
Model outperforms recent methods on gray level images with speckle noise.
The diffusion coefficient depends on both image gradient and gray level.
Well-posedness of the model is theoretically proven.
Abstract
In this work, a gray level indicator based non-linear telegraph diffusion model is presented for multiplicative noise removal problem. Most of the researchers focus only on diffusion equation-based model for multiplicative noise removal problem. The suggested model uses the benefit of the combined effect of diffusion equation as well as the wave equation. Wave nature of the model preserves the high oscillatory and texture pattern in an image. In this model, the diffusion coefficient depends not only on the image gradient but also on the gray level of the image, which controls the diffusion process better than only gradient-based diffusion models. Moreover, we prove the well-posedness of the present model using Schauder fixed point theorem. Furthermore, we show the superiority of the proposed model over a recently developed method on a set of gray level test images which are corrupted by…
|
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage and Signal Denoising Methods · Advanced Image Processing Techniques · Advanced Image Fusion Techniques
A Gray Level Indicator-Based Regularized Telegraph Diffusion Equation Applied to Image Despeckling
Sudeb Majee
School of Basic Sciences
Indian Institute of Technology Mandi
PIN 175005, INDIA
&Rajendra K. Ray
School of Basic Sciences
Indian Institute of Technology Mandi
PIN 175005, INDIA
&Ananta K. Majee
Department of Mathematics
Indian Institute of Technology Delhi
PIN 110016, INDIA
Abstract
In this work, a gray level indicator based non-linear telegraph diffusion model is presented for multiplicative noise removal problem. Most of the researchers focus only on diffusion equation-based model for multiplicative noise removal problem. The suggested model uses the benefit of the combined effect of diffusion equation as well as the wave equation. Wave nature of the model preserves the high oscillatory and texture pattern in an image. In this model, the diffusion coefficient depends not only on the image gradient but also on the gray level of the image, which controls the diffusion process better than only gradient-based diffusion models. Moreover, we prove the well-posedness of the present model using Schauder fixed point theorem. Furthermore, we show the superiority of the proposed model over a recently developed method on a set of gray level test images which are corrupted by speckle noise.
K****eywords Speckle noise Despeckling Telegraph diffusion equation Gray level indicator Weak solution Schauder fixed point theorem.
1 Introduction
In the real scenario, images are often corrupted by different types of noises, e.g., additive, multiplicative, or mixed nature. Hence the noise removal process is a very initial stage for high-level image analysis. In this work, we focus our interest only on multiplicative speckle noise removal process. Purity of the edge/texture information in the synthetic aperture radar(SAR) images, ultrasound images, and laser images are usually diminished by speckle noise [10, 37, 41]. Due to the contamination by speckle noise, it is challenging to distinguish the hidden details in the images. Therefore the development of an advance speckle noise removal algorithm is always an essential aspect for the image processing society. A Mathematical representation is still required to develop an efficient noise removal algorithm so that we can express each pixel of an image as a function of the speckle noise. The popularly used model for the noise image can be express as a product of the original signal and the speckle noise [17]
[TABLE]
where indicates the noisy image, is the noise-free image, and signifies the speckle-noise process.
In general, the probability density function of the multiplicative speckle noise process follows the Gamma Law as,
[TABLE]
where signifies the number of looks which correspond to the noise level in the corrupted images [7, 22, 35] and denotes the Gamma function.
A large number of study reports the fundamentals and the statistical attributes of the speckle noise [1, 7, 19, 32, 33, 41]. Futuristic despeckling approaches include Bayesian methods in spatial domain [19, 32, 33], Bayesian methods in transformed domain [4, 21, 39], order-statistics and morphological filters [6, 5, 14, 41], simulated annealing despeckling [50], nonlocal filtering [9, 13, 15, 48], wavelet-based approaches [1, 46], nonlinear diffusion in Laplacian pyramid domain [53], anisotropic diffusion based methods [25, 27, 29, 44, 52, 55, 56], and variational methods [8, 16, 23, 28, 30, 31, 36, 43, 45].
From the initiation of PM model [40], the partial differential equations(PDEs) are extensively used to develop noise removal algorithms, among different types of PDE based models, the total variational (TV) based algorithms are achieved remarkable results. First variational based strategy to deal with multiplicative noise is proposed by Rudin et al. [43], with the principles,
[TABLE]
where represents the variance of the noise . Due to the non-convexity of their proposed energy function, the model may not give a globally unique solution. To succeed over this shortcoming, several authors suggested various convex functional with different data fidelity terms [8, 23, 31, 36]. Recently, Dong et al. [16] suggest a convex total variation model for multiplicative speckle-noise reduction with the following form:
[TABLE]
They choose the gray level indicator function , as
[TABLE]
with , where , , “" is the convolution operator, is the two dimensional Gaussian kernel and is a given parameter, see [16]. Later, based on a gray level indicator function, Zhou et al. proposed a diffusion model (DDD model)[55] for multiplicative noise removal problem. Their model takes the form:
[TABLE]
where is the domain of original image and the observed noise image , div and represents the divergence and gradient operator respectively. They choose the diffusion coefficient as
[TABLE]
where and . In this case, the gray level indicator and edge detector function are and respectively. However because of the degeneracy of the edge detector function, i.e., as , it is challenging to establish the well-posedness of their model. Recently Shan et al. [44] proposed a regularized version of the above-discussed model [55]. In [44], the model takes of the form
[TABLE]
They choose the diffusion coefficient as
[TABLE]
where , , is the initial image, and and are positive constants. Due to the introduction of the Gaussian kernel in the diffusion coefficient, which avoids the degeneracy in the model, the authors able to study the wellposedness of the underlying problem.
To the best of our knowledge, most of the researcher concentrated their interest only on parabolic PDE based models, which are developed either from the variational bases approach or diffusion based approach, for the speckle-noise removal process. The hyperbolic PDEs could upgrade the quality of the detected edges and improve the image better than parabolic PDEs [2]. In the existing literature, the first hyperbolic model for image denoising is telegraph-diffusion model [42], where the image was viewed as an elastic sheet placed in a damping environment, which interpolates between the diffusion equation and the wave equation. The telegraph-diffusion model takes the form,
[TABLE]
where is an edge-controlled diffusion function which preserves the important features and smoothen the unwanted signals, and is the damping parameter. It is quite interesting to note that for a very higher value of and , this telegraph-diffusion equation (TDE model) converges to the original PM model [40] in a long time scenario. Although the TDE model performs better, it is challenging to confirm the well-posedness of their model. To overcome the ill-posedness issue in the TDE model [42], Cao et al. suggest a regularized TDE model [11]. They replace the gradient by in the edge-controlled function in the TDE model [42] and establish the well-posedness of their proposed model. Even though the TDE model can effectively preserve the sharp edges but failed to produce satisfactory smoothing in the presence of a large level of noise. To overcome this issue, several non-linear telegraph diffusion-based method have been proposed [11, 24, 47, 51, 54]. However, in spite of their impressive applications in the additive noise removal process, hyperbolic PDE based approaches have not successfully used for speckle noise removal process.
Recently Sudeb et al. suggest a fuzzy edge detector based telegraph total variation model [38] for the speckle noise removal problem. To the best of our knowledge, this is the first hyperbolic PDE based model in the existing literature applied to speckle noise removal process. The model [38] takes the form,
[TABLE]
where is the fuzzy edge detector function [12], is a positive parameter and is the weight parameter.
Further continuing to demonstrate the importance of hyperbolic PDE based model for image despeckling, the present work suggests a gray level indicator based telegraph diffusion model for multiplicative speckle noise removal. In this model, we choose a different diffusivity function from our previous model [38]. Also, instead of total variation framework [38], we designed the present model in an anisotropic diffusion-based fashion as discussed in [55]. Furthermore, we study the well-posedness of the suggested model in an appropriate function space. We opt an explicit numerical method to solve the present model. Our numerical implementation allows computing despeckled results on some standard test images. Quality of the despeckled images using the suggested model compare with the recently developed model [44]. We compare the quantitative and qualitative results at different noise levels. The experiment results confirm that the proposed model performs better as compared to the model considered for the comparison.
The rest of the paper is organized as follows. Section 2 describes the proposed telegraph diffusion method for image despeckling. In section 3, we study the wellposedness of weak solution of the proposed model. Section 4 describes the numerical discretization of the present model. The simulated despeckling results obtained by the proposed approach are compared with other discussed diffusion methods in Section 5. We conclude the paper in Section 6 with a scope on future work.
2 Telegraph Diffusion Model for Speckle Noise Removal
Inspired by the ideas of [38] and [55] initially we developed the model
[TABLE]
The function is defined as
[TABLE]
where, are constants, , and is the source term which comes due to the fidelity control term in the energy functional as discussed in [38]. Although the presence of fidelity term in the equation keeps the restored image close to the original image, the noise may not be removed sufficiently. Therefore we would like to choose Also, because of the degeneracy in the diffusion coefficient 2.4, the suggested model (2.1)-(2.3) may not be a well-posed problem[44]. To overcome these issues, we invoke the ideas of [11] and [44], and finally designe the following model in the anisotropic diffusion-based framework:
[TABLE]
where the diffusion function as given by
[TABLE]
In the above, , Moreover the gray level indicator function
[TABLE]
can be transformed into , where
The use of Gaussian convolution in the proposed model has a lot of advantages, not only the robustness in denoising viewpoint but also the well-posedness in the theoretical perspective. There are two key advantages of this proposed approach:
- i)
it provides the sharp and true edges during noise removal process than other non-telegraph based algorithms as the model (2.5)-(2.7) consists of telegraph diffusion model [42]
- ii)
it controls the diffusion process very well along with the gradient based edge detector coefficient specially for the speckle noise removal process [16] as the gray level indicator function in the proposed model is incorporated into the telegraph diffusion framework.
3 Wellposedness of weak solution
In this section, we prove the existence and uniqueness of weak solution of the proposed model (2.5)-(2.7). Since the problem (2.5)-(2.7) is nonlinear, we first consider the linearized problem, and then use Schauder’s fixed-point theorem [18] to show the existence of a weak solution. Without loss of generality, we assume in (2.5).
3.1 Technical framework statement of the main result
Throughout this section, denotes a generic positive constant. For , we denote by the standard spaces of -th order integrable functions on . For , we write for usual Sobolev spaces on , and for the dual space of . We introduce the solution space for the problem (2.5)-(2.7), where
[TABLE]
Note that the space is a Hilbert space for the graph norm, see [34].
Definition 3.1** (Weak solution)**
A function is called a weak solution of (2.5)-(2.7) if
- a)
* and (2.7) holds.*
- b)
For all and a.e , there hold
[TABLE]
As we mentioned, our aim is to establish wellposedness of weak solutions of the underlying problem (2.5)-(2.7), and we will do so under the following assumption:
- A.1
The initial data is an -valued function such that
[TABLE]
Theorem 3.1
Let the assumption A.1 be true. Then the problem (2.5)-(2.7) admits a unique weak solution in the sense of Definition 3.1.
3.2 Linearized problem existence of weak solution:
For any positive constant , define
[TABLE]
For any , consider the linearized problem:
[TABLE]
with the initial condition (2.7), where the function is given by
[TABLE]
Claim 3.1
There exist positive constants , depending only on and , such that
[TABLE]
Proof: Proof of : Since , by convolution property, we have
[TABLE]
and hence
[TABLE]
Again by Young’s convolution inequality, we observe that
[TABLE]
Now follows from (3.3)-(3.4) for \kappa=\frac{\big{(}\alpha\|G_{\xi}\|_{L^{1}}\big{)}^{\nu}}{2\,\big{(}M_{1}C_{\xi}\|I_{0}\|_{H^{1}}\big{)}^{\nu}}\cdot\dfrac{1}{1+\left(\frac{C_{\xi}M_{1}\left\|I_{0}\right\|_{H^{1}}}{K}\right)^{2}}.
Proof of Observe that, since , we have
[TABLE]
Thus holds. This finishes the proof of claim. Thanks to Claim 3.1, one can apply classical Galerkin method [18] to show that there exists a unique weak solution of the linearized problem (3.1) with the initial condition (2.7).
Lemma 3.2
The unique solution of the linearized problem (3.1) with the initial condition (2.7) satisfies the following: there exists a constant , depending only on such that
- a)
*, *
- b)
*. *
Proof: Proof of : Note that . Taking in (3.1), integrating by parts and using the inequality , which follows from integration by parts formula and (3.2), and the fact
[TABLE]
we obtain
[TABLE]
An application of Gronwall’s lemma along with (3.5) gives: for a.e.
[TABLE]
Since , thanks to Young’s inequality and (3.6), we have and hence
[TABLE]
Proof of : Choose with in (3.1), and use Cauchy-Schwarz inequality along with , Lemma 3.2 to obtain \big{|}\langle I_{tt},\phi\rangle\big{|}\leq C\,\|I_{0}\|_{H^{1}}\|\phi\|_{H^{1}} and hence
[TABLE]
Therefore follows once we take square both side of the above inequality and then integrate over .
3.3 Proof of Theorem 3.1
In this section, we prove wellposedness of weak solution of the underlying problem via Schauder’s fixed-point theorem. To proceed further, we introduce the subspace of defined by
[TABLE]
Moreover, one can prove that is a non-empty, convex and weakly compact subset of . Consider a mapping
[TABLE]
In order to use Schauder’s fixed-point theorem on , we need to prove only that the mapping is weakly continuous from into . Let be a sequence that converges weakly to some in and let . We have to show that converges weakly to .
Thanks to Lemma 3.2, one can use classical results of compact inclusion in Sobolev spaces [3], to extract subsequences of and of such that for some , the following hold as
[TABLE]
The above convergence allow us to pass to the limit in the problem (3.1) and obtain . Moreover, since the solution of (3.1) is unique, the whole sequence converges weakly in to . Hence is weakly continuous. Consequently, thanks to the Schauder fixed point theorem, there exists such that . Thus, the function solves the problem (2.5)-(2.7).
Uniqueness of weak solution: Following the idea as in [18], we prove the uniqueness of weak solutions of the underlying problem (2.5)-(2.7). Let and be two weak solutions of (2.5)-(2.7). Then, we have
[TABLE]
where . It suffices to show that . To verify this, fix , and set for ,
[TABLE]
Note that, for ,
[TABLE]
Set . Then . Multiplying (3.7) by , integrating over along with the integration by parts formula, (3.10), Cauchy-Schwarz inequality and the equality
[TABLE]
we obtain
[TABLE]
As seen in the proof of Claim 3.1, there exist positive constants such that
[TABLE]
Moreover, one can use property of convolution along the fact that solution has positive lower bound to show that
[TABLE]
Thus, using the above estimates in (3.3), we have for
[TABLE]
Since , we have
[TABLE]
Set
[TABLE]
Observe that
[TABLE]
Hence (3.12) reduces to
[TABLE]
Choose sufficiently small such that . Then, for we have, from (3.3)
[TABLE]
Consequently, an application of Gronwall’s lemma then implies on . Finally, we utilize a similar logic on the intervals , step by step, and eventually deduce that on . This finishes the proof of Theorem 3.1.
Lemma 3.3
Let be a weak solution of the problem (2.5)-(2.7), and . Then
[TABLE]
Proof: Integrating the equation (2.5) w.r.to time variable and using (2.7), we get that
[TABLE]
Note that, , where is the truncated function defined as . Multiplying the PDE (3.16) by and then integrating over to have
[TABLE]
Observe that, and . Thus, we have . Again, since , we obtain for a.e. . Therefore, for a.e. .
Similarly, multiplying the equation (3.16) with and then integrating over to conclude that for a.e. , where is the truncated function defined as . Hence (3.15) holds true. This completes the proof.
4 Numerical Implementation
To solve the present model numerically, we choose an explicit finite difference scheme, which is the most straightforward option for solving a hyperbolic PDE.
(a). Discretize the time domain using a step and the space domain using a step Denote where where is the number of iterations and is the size of the image.
(b). Boundary conditions are given as:
(c). The approximation of derivative terms are given as follows:
\begin{array}[]{lll}\displaystyle\frac{\partial I_{i,j}^{n}}{\partial t}&\approx&\displaystyle\frac{I_{i,j}^{n+1}-I_{i,j}^{n}}{\tau},\displaystyle\frac{\partial^{2}I_{i,j}^{n}}{\partial t^{2}}\approx\displaystyle\frac{I_{i,j}^{n+1}-2I_{i,j}^{n}+I_{i,j}^{n-1}}{\tau^{2}},\\[22.76228pt] \nabla_{x}I_{i,j}^{n}&\approx&\displaystyle\frac{I_{i+h,j}^{n}-I_{i-h,j}^{n}}{2h},\nabla_{y}I_{i,j}^{n}\approx\displaystyle\frac{I_{i,j+h}^{n}-I_{i,j-h}^{n}}{2h},\\[22.76228pt] |\nabla I_{i,j}^{n}|&\approx&\sqrt{(\nabla_{x}I_{i,j}^{n})^{2}+(\nabla_{y}I_{i,j}^{n})^{2}}.\end{array}
(d). The discrete form of the proposed model (2.5) could be written as follows:
[TABLE]
where
[TABLE]
with the conditions,
[TABLE]
Apart from the discretization of (2.5)-(2.7), we need to specify a stopping criterion for the convergence of the numerical simulation process. For this, we start the simulation with the initial value and utilize the system (2.5) repeatedly, resulting in a family of smoother images , which represents filtered versions of . And then we stop the noise elimination process after getting the best PSNR value of the restored image.
5 Experiment Results and Discussion
This section displayed the performance of the present model in terms of visual quality and quantitative results. We compare the despeckling result of the proposed model using three standard test images corrupted by the multiplicative speckle noise with a different number of looks (). We have artificially added multiplicative speckle noise level by using our MATLAB program. All the numerical tests are performed under windows and MATLAB version running on a desktop with an Intel Core dual-core CPU at GHz with GB of memory. Image denoising using the present model has been compared with the Shan model [44]. In this process, the considered existing model is discretized using the same explicit numerical scheme as in the proposed model. We choose an uniform time step size and for each models. Details of the other parameter values for the numerical computation are given in the right-hand of Table 1.
5.1 Image quality measurement
Since the proposed model is claimed to be an improvement over the existing diffusion models, our main aim is to compare the edge detection and denoising results, in terms of both qualitative and quantitative measures. For each experiment, we compute the values of the two standard parameters peak signal to noise ratio (PSNR)[20] and Structural similarity index (SSIM)[49] for the quantitative comparison with the other existing model. A higher numerical value of PSNR and SSIM suggests that the reconstructed image is closer to the noise-free image. The considered parameters are defined as follows:
(a). PSNR can measure the match between the clean and denoised data,
[TABLE]
Here denotes the clean image of size and max() is the maximum possible pixel value of and denotes the denoised image at a certain time
(b). SSIM is used to calculate the similarity between structure of clean and reconstructed image and can be given as,
[TABLE]
Here are the average, variance and covariance of and , respectively. and are the variables to stabilize the division with weak denominator.
(c). Other typical qualitative measures have also been computed in terms of the ratio image, which can be defined as the point-by-point ratio between the degraded and the despeckled image [7]. Apart from the ratio image, we also compute the 2D contour plot, 3D surface plot for the better visualization of the computational result for the proposed model as well as for the other discussed models.
5.2 Computational Results & Discussion
In figure 1, we represent the restored results of a Boat image (Natural Image) which is contaminated by multiplicative speckle noise with . From the visual quality of the restored images, it is easy to perceive that Shan model leaves some spikes in the restored images but the results computed by the present model is more apparent than the results of Shan model.
In figures 2-3, we describe the reconstructed results of a Brick image (Texture Image) which is corrupted by speckle noise with . From the figures, it is easy to see that the result computed by the present model is more apparent as well as less blurry than the Shan model.
To check the more reconstruction capability of the present model in figures 4- 9 illustrate the qualitative results of a Circle image (Synthetic Image) which is corrupted by speckle noise with . In the images 4- 6 we demonstrate the despeckling images by the present model and Shan model when the image is corrupted by the noise level . From these figures, we easily visualize the performance of the present model.
In figure 7, we represent the restored image along with their ratio image for a better comparison of the qualitative result. From the figures 7(c)-7(d) it can be easily concluded that the present model gives promising results in terms of image despeckling than the Shan model. Figure 7(e) represent the ratio image for the clear circle image 7(a).Figure 7(e) indicates that ratio image for the clear image has no background information. From the figures 7(f)- 7(g) we can see that ratio image corresponding to the present model has very less background information. Which confirms that the present model works better in terms of edge preservation than the Shan model.
To more visualize the noise removal ability in figures 8-9 we illustrate the contour maps and 3D surface plots corresponding to the images 7(a)-7(d). One can easily observe that from the contour maps, and 3D surface plots, Shan model left some speckles in the homogeneous regions, but the present model produces fewer artifacts with better edge preservation.
Along with the qualitative comparison, the quantitative results in terms of PSNR and SSIM values are displayed in Table 1. The highest values of PSNR and SSIM for each noise level clearly shows that the suggested model is better than the Shan model.
6 Conclusion
This work suggests an efficient telegraph diffusion-based multiplicative speckle noise removal model. Such a new method intends to preserve the image edges during the noise removal process. To overcome the limitations of gradient-based despeckling models as well as parabolic PDE based models, we considered a hybrid approach. Here we combine a gray level indicator function with gradient-based diffusion in a telegraph diffusion framework for image restoration. To the best of our knowledge, the gray level indicator based telegraph diffusion model has not been used before for speckle noise suppression. Also, we established the existence and uniqueness of a weak solution to the suggested model using Schauder’s fixed point theorem. Moreover, we prove the boundedness of the weak solution. Numerical experiments have been conducted to highlight the efficiency of the proposed model for despeckling using different types of test images. Computational result of the present model compares with a recently developed model. From the experiment results of the proposed model, we can conclude that the images are suitably recovered without introducing undesired artifacts. A potential direction that the telegraph diffusion model can be extended to handle texture preservation issues in various real-life images, which are degraded by mixed noises. Another significant step might be the study of the advanced numerical solver to enhance the convergence speed of the proposed model.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Achim, A., Bezerianos, A., Tsakalides, P.: Novel bayesian multiscale method for speckle removal in medical ultrasound images. IEEE transactions on medical imaging 20(8), 772-783 (2001)
- 2[2] A. Averbuch, B. Epstein, N. Rabin, E. Turkel, Edge-enhancement postprocessing using artificial dissipation, IEEE transactions on image processing 15 (6) (2006) 1486-1498.
- 3[3] R. Adam, Sobolev spaces, in: Pure and Applied Mathematics Series of Monographs and Textbooks, Vol. 65, Academic Press, Inc., New York, San Francisco, London,, 1975.
- 4[4] Aiazzi, B., Alparone, L., Baronti, S.: Multiresolution local-statistics speckle filtering based on a ratio laplacian pyramid. IEEE Transactions on Geoscience and Remote Sensing 36(5), 1466-1476 (1998)
- 5[5] Alparone, L., Baronti, S., Carla, R.: Two-dimensional rank-conditioned median filter. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing 42(2), 130-132 (1995)
- 6[6] Alparone, L., Garzelli, A.: Decimated geometric filter for edge-preserving smoothing of non-white image noise. Pattern recognition letters 19(1), 89-96 (1998)
- 7[7] Argenti, F., Lapini, A., Bianchi, T., Alparone, L.: A tutorial on speckle reduction in synthetic aperture radar images. IEEE Geoscience and remote sensing magazine 1(3), 6-35 (2013)
- 8[8] Aubert, G., Aujol, J.F.: A variational approach to removing multiplicative noise. SIAM Journal on Applied Mathe- matics 68(4), 925-946 (2008)
