A remark on the denoising of greyscale images using energy densities with varying growth rates
Martin Fuchs, Jan Mueller

TL;DR
This paper proves the solvability of a class of variational problems with variable growth energy densities, extending the TV-model for greyscale image denoising to more general functional forms.
Contribution
It introduces a generalized framework for denoising models with energy densities of varying growth rates, broadening the applicability of TV-based methods.
Findings
Proves existence of solutions in Sobolev spaces for the generalized models.
Extends the TV-model to include energy densities with (1, p)-growth.
Provides a mathematical foundation for more flexible denoising functionals.
Abstract
We prove the solvability in Sobolev spaces for a class of variational problems related to the TV-model proposed by Rudin, Osher and Fatemi in [1] for the denoising of greyscale images. In contrast to their approach we discuss energy densities with variable growth rates depending on in a rather general form including functionals of -growth.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
A remark on the denoising of greyscale images using energy densities with varying growth rates
M. Fuchs
J. Müller
Abstract
We prove the solvability in Sobolev spaces for a class of variational problems related to the TV-model proposed by Rudin, Osher and Fatemi in [1] for the denoising of greyscale images. In contrast to their approach we discuss energy densities with variable growth rates depending on in a rather general form including functionals of -growth.
AMS-classification: 49N60, 49J45, 49Q20
Keywords: variational problems with nonstandard growth, TV-regularization, denoising and inpainting of images
1 Introduction
In 1992 Rudin, Osher and Fatemi proposed (compare [1]) to study the variational problem
[TABLE]
as a model for the restoration of a noisy greyscale image . In this setting (and throughout our paper) is a bounded Lipschitz region in , the function represents the noisy data, for which we assume
[TABLE]
and denotes a parameter being under our disposal. As a matter of fact, problem (1.1) has to be discussed in the space of functions with finite total variation (see, e.g., [2] or [3] for a definition and further properties of this class) admitting a unique solution which in addition satisfies (1.2). From the analytical point of view, the functional from (1.1) does not behave very nicely: the energy density is neither differentiable nor strictly convex (“elliptic”) so that no additional information on the minimizer are available. One common alternative used in the variational approach towards the denoising of images is to replace (1.1) by
[TABLE]
for some power , where the choice already occurs in the work of Arsenin and Tikhonov [4], we refer to the monograph [5] for more information on the subject including references. The natural space for problem (1.3) is the Sobolev class (compare [6] for details), and from nowadays standard results on nonlinear elliptic equations (see the references stated in Chapter 3.2 of [7]) going back to e.g. Uralt’seva, Uhlenbeck, Evans, Di Benedetto and many other prominent authors it follows that the unique solution of problem (1.3) is at least of class on the interior of the domain . However, from the point of view of applications, a high degree of regularity of the minimizer is not always favourable (“effect of oversmoothing”), which means that in certain cases one should discuss a linear growth model but with better ellipticity properties in comparison to the functional . This is the subject of the papers [8, 9, 10], in which we studied the problem
[TABLE]
(including even inpainting) with density
[TABLE]
the function being defined through
[TABLE]
with explicit formula
[TABLE]
In the case the density is of linear growth in the sense that
[TABLE]
with constants . Formally we can also consider values , but then (1.4) reduces to (1.3) for the choice . The density is of class satisfying in case the condition of -ellipticity, i.e.
[TABLE]
with and for all . From (1.7) it follows
[TABLE]
and (1.9) together with (1.10) shows that “” is a reasonable approximation of the TV-density “” occurring in problem (1.1). Moreover, it turns out that the degree of regularity of the solution of problem (1.4) can be controlled in terms of the parameter . Precisely it holds
THEOREM 1.1**.**
Let satisfy (1.2), fix and define according to (1.5), (1.6).
- a)
If , then the solution of (1.4) belongs to the Sobolev space and is of class in the interior of . 2. b)
In case there are simple examples of data for which .
For part a) we refer to [8, 9, 10, 11, 12], a discussion of b) even for the one-dimensional case can be found in [13]. Up to now, all our energy functionals are of uniform power growth in the sense that the regularizing part involving can be estimated from above and below by the quantity for some power , and the purpose of the present paper is to introduce - at least to some extend - energy functionals and densities , which allow some flexibility of the growth rate, which means that the growth rate of can be prescribed in terms of . To be precise, we consider a density of class satisfying and . For numbers and for exponents
[TABLE]
we assume the validity of
[TABLE]
and in Lemma 2.1 we will show that (1.12) yields the growth estimate
[TABLE]
The reader should note that (1.12) implies (1.9), if we allow the choice . An example of a density with (1.12) is given by
[TABLE]
for a continuous and decreasing function
[TABLE]
A discussion of (1.14) together with further examples can be found in Section 5. Assuming (1.12) we then look at the variational problem
[TABLE]
where is a measurable subset of such that
[TABLE]
i.e. we study an inpainting problem combined with simultaneous denoising, where is the inpainting region and the choice corresponds to the case of pure denoising. We have the following results:
THEOREM 1.2**.**
Let (1.2), (1.11) and (1.12) hold together with (1.16). Assume in addition that
[TABLE]
Then the variational problem
[TABLE]
with defined in (1.15) admits a unique solution . This solution additionally satisfies a.e. on as well as for any finite .
REMARK 1.1**.**
Once having established the local higher integrability result , we think that actually , , can be deduced along similar lines as in [11], where densities satisfying (1.9) for some exponent are considered.
REMARK 1.2**.**
Energy densities , for which
[TABLE]
holds or for which an appropriate variant of (1.12) is true, have been extensively discussed for instance in the papers [14, 15, 16, 17, 18, 19, 20, 21, 22] dealing even with the higher-dimensional case including vector-valued functions. Roughly speaking it is shown in the above mentioned papers and the references quoted therein, that (1.19) provides some additional regularity of (local) minimizers, provided and is not too far away from , we refer to [23] for a survey. Recalling that (1.12) implies (1.13), Theorem 1.2 covers the case “”, and (1.17) expresses the fact that the upper bound satisfies “”. Note that the latter requirement turns out to be a sufficient condition for the regularity of minimizers in the setting of [21].
REMARK 1.3**.**
Variational problems of mixed linear/superlinear growth are the subject of Section 6 in [23]. Here the density is of splitting form in the sense that
[TABLE]
with growing linearly in , whereas behaves as with power . From the point of view of image restoration condition (1.20) seems to be unnatural, however, if satisfies (1.9) with and if , then regularity results are available, thus our hypothesis (1.17) naturally occurs in the splitting case (1.20).
Next let denote a function of class being strictly increasing and strictly convex, e.g. , and let
[TABLE]
which means that we consider more general data terms.
THEOREM 1.3**.**
With from above let , and satisfy (1.2), (1.12) and (1.16), respectively, and assume in addition that for some . Moreover, let
[TABLE]
Then the variational problem
[TABLE]
with from (1.21) has a unique solution . It holds a.e. on , moreover, is in for any finite . If the density is balanced in the sense that
[TABLE]
holds for some constant, then (1.23) can be replaced by the requirement (compare (1.17)).
REMARK 1.4**.**
We conjecture that in the balanced case (1.25) the results of Theorem 1.2 and 1.3 extend to any exponent , we refer to Remark 3.1.
Our paper is organized as follows: in Section 2 we collect some preliminary material and discuss regularized problems approximating (1.18) and (1.24). Section 3 is devoted to the proof of Theorem 1.2, and Theorem 1.3 is established in Section 4. Finally, in Section 5 we present some examples of densities satisfying (1.12) including the model from (1.14).
2 Some preliminary results and discussion of regularized problems
We start with a growth estimate for densities satisfying (1.12).
Lemma 2.1**.**
Suppose that we have the ellipticity condition (1.12) for with exponents according to (1.11). Then is of -growth in the sense of inequality (1.13).
Proof. We just consider the case . For the following arguments can be easily adjusted. We recall that should satisfy , , thus we obtain from Taylor’s theorem (applied to )
[TABLE]
Applying (1.12) to the r.h.s. of (2.1) we find
[TABLE]
and from (in case ) we immediately deduce the second inequality in (1.13). If , then the first inequality in (1.13) is obvious by an appropriate choice of . In case we observe for the l.h.s. of (2.2)
[TABLE]
thus the first inequality of (1.13) extends to the case after adjusting . ∎
REMARK 2.1**.**
The requirement is essential for deducing the lower bound on stated in (1.13) from the condition of -ellipticity, i.e. from the first inequality in (1.12).
Lemma 2.2**.**
Under the conditions on the data stated in Theorem 1.2 and 1.3, respectively, but for arbitrary choices of , the variational problems (1.18) and (1.24) admit at most one solution . We have
[TABLE]
Proof. From “strict convexity” (for the density this property follows from the first inequality in (1.12)) we get
[TABLE]
for minimizers . But then is a consequence of (1.16). Replacing by and we see by an elementary calculation (compare, e.g., [9]) that (2.3) holds for the minimizer , since otherwise we could decrease the energy. ∎
During the proofs of Theorem 1.2 and 1.3 we will essentially benefit from
Lemma 2.3**.**
Suppose that we are in the situation of Theorem 1.2 or 1.3, where here we allow in both cases exponents and . For let denote the solution of either
[TABLE]
or
[TABLE]
with and from (1.15) and (1.21), respectively. It holds:
- i)
* a.e. on .* 2. ii)
The functions are of class . 3. iii)
We have the uniform bound . 4. iv)
Suppose that we can find an exponent such that for each subdomain
[TABLE]
Then in as for a function , and solves the variational problem (1.18), respectively (1.24).
Proof. i) follows as inequality (2.3) in Lemma 2.2, ii) is immediate from elliptic regularity theory, and iii) is a consequence of the first inequality in (1.13). Let us discuss iv): from i), iii) and assumption (2.4) we deduce the existence of such that
[TABLE]
(at least for a subsequence) as . From De Giorgi’s theorem on lower semicontinuity (see, e.g., [24] Theorem 2.3, p.18) we see that (2.5) and (2.6) yield
[TABLE]
if we are in the situation of Theorem 1.2, whereas
[TABLE]
in the setting of Theorem 1.3. Since for it holds
[TABLE]
we obtain from (2.7) (recall the definition of in )
[TABLE]
and by approximation in , inequality (2.9) extends to . If the are the solutions of problem , then by the same arguments it follows
[TABLE]
Consider . In case , i.e.
[TABLE]
there is nothing to prove. In the other case, due to the growth of at infinity and by (1.2), we see that is in the space and according to [25], Lemma 2.1, we find a sequence such that
[TABLE]
as , hence , and since by (2.10), we finally have shown that solves (1.24). ∎
3 Proof of Theorem 1.2
In this section we assume that all the hypotheses of Theorem 1.2 are valid and define as in Lemma 2.3 as the unique solution of problem . Let . For with we have (by passing to the differentiated version of the Euler equation associated to and by quoting Lemma 2.3 ii))
[TABLE]
where here and it what follows the sum in taken w.r.t. . It holds
[TABLE]
[TABLE]
where we have used (1.2) as well as Lemma 2.3 i), denoting a positive constant independent of . Recalling in addition Lemma 2.3 iii) we get from (3.1)
[TABLE]
Applying the Cauchy-Schwarz inequality to the bilinear form and using Young’s inequality, the estimate (3) yields
[TABLE]
hence using (1.12) for (dropping the -term on the l.h.s.)
[TABLE]
We remark the validity of and assume w.l.g. . Then we obtain
[TABLE]
On the r.h.s. of (3) we use Young’s inequality twice recalling (1.17) and (1.11):
[TABLE]
Inserting these estimates into (3), choosing such that on outside , we obtain after appropriate choice of and
[TABLE]
where for the moment we just neglect and denotes a suitable positive number. Applying Lemma 3.1, p.161, from [24] to estimate (3.4) we find that (2.4) from Lemma 2.3 holds with the choice , and we can quote iv) of Lemma 2.3 yielding a unique - solution of (1.18).
Going back to (3), recalling the estimates stated after (3) and applying our bound (2.4) valid for , it follows
[TABLE]
for any , thus ()
[TABLE]
which by Sobolev’s theorem implies
[TABLE]
for any . This proves the last claim of Theorem 1.2. ∎
REMARK 3.1**.**
Suppose that satisfies the condition (1.25). In this case we estimate
[TABLE]
and observe . Thus we can replace in (3) through a constant ending up with
[TABLE]
hence we obtain (3.5) just assuming . Thus the bound (1.17) imposed on at this stage does not enter, however during our proof we work with the quadratic regularization , which requires . In other words: under the assumption (1.25) the claims of Theorem 1.2 extend to exponents (keeping the bound ) and a proof can be carried out by working with the regularization
[TABLE]
for some exponent . We leave the details to the reader.
4 Proof of Theorem 1.3
Let the assumptions of Theorem 1.3 hold. In place of equation (3.1) we have
[TABLE]
where is the solution of problem (see Lemma 2.3). From (1.2) and Lemma 2.3 i) it follows
[TABLE]
and clearly (recall Lemma 2.3 iii))
[TABLE]
where we use the symbol to denote constants proportional to for some positive exponent . Applying Young’s inequality to the integral on the r.h.s. of (4.2) and discussing the l.h.s. of (4) as done after (3) we find
[TABLE]
We specify as in Section 3 and let
[TABLE]
Then (4) shows (with suitable )
[TABLE]
Next we observe (quoting Sobolev’s inequality)
[TABLE]
where we have used that on account of Lemma 2.3 iii). We discuss the remaining integral on the r.h.s. of (4.5) observing that and using Hölder’s inequality:
[TABLE]
We have
[TABLE]
with exponent , which follows from (1.22). Quoting Lemma 2.3 iii) one more time, another application of Hölder’s inequality gives (for some )
[TABLE]
We insert (4.6) into (4.5) giving the bound
[TABLE]
With (4.7) we return to (4.4) and assume that the radius is sufficiently small, thus
[TABLE]
Up to now we have not used our hypothesis (1.23), which enters next:
[TABLE]
where in the last estimate we applied Hölder’s inequality and use the smallness of to get the factor . As outlined after (3.4) we deduce (2.4) with value . Moreover, using this information in (4.4), we see
[TABLE]
for any subdomain , thus (3.5) holds, and we get all the results of Theorem 1.3 as described in Section 3, where for the balancing case we refer to Remark 3.1. ∎
5 Examples
In this section we focus on energy densities depending on the modulus of , a situation for which the following observations are helpful.
Proposition 5.1**.**
Let denote a -function for which . Then
[TABLE]
is a convex function of class for which , and
[TABLE]
Proof. We just note that (5.2) follows from the formula
[TABLE]
∎
If is a non-negative function of class , we recall the balancing condition (see (1.25)):
[TABLE]
Proposition 5.2**.**
Let satisfy the assumptions of Proposition 5.1. Assume further that
[TABLE]
Then from (5.1) satisfies (5.3).
Proof. This is an immediate consequence of (5.2) and (5.4). ∎
Proposition 5.3**.**
If is a function as in Proposition 5.1 such that
[TABLE]
and if satisfies the -condition, i.e.
[TABLE]
then inequality (5.4) holds. Thus , , is balanced in the sense of (5.3).
Proof. We have (recalling as well as )
[TABLE]
where the last inequality follows from the fact that is increasing on account of our hypothesis . Thus we get
[TABLE]
(see (5.6)), and together with (5.5) we arrive at (5.4). ∎
All our energy densities “” discussed below are of the principal form (compare (1.6) and (1.14))
[TABLE]
for a continuous function such that for . Note that is strictly increasing and strictly convex implying the strict convexity of on .
Example 5.1**.**
Consider a continuous function and define according to (5.7) with the choice
[TABLE]
for exponents .
Proposition 5.4**.**
The density satisfies (1.12).
Proof. It holds on account of and for any
[TABLE]
In case we observe , thus , whereas in case we use
[TABLE]
for some , hence
[TABLE]
and the second inequality in (5.2) gives the upper bound
[TABLE]
With analogous calculations we obtain a lower bound:
[TABLE]
Case 1: sufficiently large). Then we have after appropriate choice of
[TABLE]
Case 2: . Here we observe
[TABLE]
for a suitable , hence
[TABLE]
Recalling (5.9) and (5.2), the above estimates imply (1.12) for our density . ∎
REMARK 5.1**.**
An equivalent form of (5.8) is given by
[TABLE]
for a continuous function such that .
In fact, if is given, let
[TABLE]
and if we start from we obtain (5.8) by defining
[TABLE]
The density defined in (5.7) with as in (5.8) in general does not satisfy the balancing condition (5.3): consider as indicated in the picture below:
Here denotes a suitable sequence going to zero, we let on each interval with linear interpolation on such that for each . Then it holds for
[TABLE]
and at the same time (after appropriate choice of )
[TABLE]
for sufficiently large, hence (5.4) is violated. We discuss (5.10): it holds
[TABLE]
For simplicity let us assume . Then , hence(compare (1.5) - (1.8))
[TABLE]
and we obtain (5.10) from the requirement that . In the case a slight modification is necessary still leading to (5.10). In addition, we can choose different functions to get for a given number .
REMARK 5.2**.**
As a matter of fact our previous considerations extend to densities
[TABLE]
with positive numbers and with weight-function as in (5.8).
Example 5.2**.**
We let
[TABLE]
with and for a continuous and decreasing function
[TABLE]
with exponents . Note that (5.11), (5.12) can be seen as an approximation of the density where decreases from to as ranges from [math] to , introduced by Blomgren, Chan and Mulet [26] for .
Proposition 5.5**.**
The density from (5.11) with defined in (5.12) satisfies the ellipticity condition (1.12), moreover, the balancing inequality (5.3) holds.
Proof. W.l.o.g. we let and observe for any
[TABLE]
moreover, it holds
[TABLE]
we refer to the proof of Proposition 5.4. Thus (1.12) follows from Proposition 5.1. Next we discuss (5.4) for by referring to Proposition 5.3: we have
[TABLE]
In case we get by the properties of
[TABLE]
(note: ), hence
[TABLE]
If the value of is arbitrary, we write
[TABLE]
and use the fact that
[TABLE]
thus , and by recalling we obtain as before inequality (5.6) with a suitable constant. It remains to check (5.5): we have
[TABLE]
since decreases. Writing
[TABLE]
and observing that
[TABLE]
we see that and (5.5) is established. ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] L. I. Rudin, S. Osher, and E. Fatemi. Nonlinear total variation based noise removal algorithms. Physica D , 60:259 – 268, 1992.
- 2[2] E. Giusti. Minimal surfaces and functions of bounded variation , volume 80 of Monographs in Mathematics . Birkhäuser, Basel, 1984.
- 3[3] L. Ambrosio, N. Fusco, and D. Pallara. Functions of bounded variation and free discontinuity problems . Clarendon Press, Oxford, 2000.
- 4[4] A. Tikhonov and V. Arsenin. Solutions of ill-posed problems. Translated from the Russian. Preface by translation editor Fritz John. Scripta Series in Mathematics. V. H. Winston & Sons, Washington, D.C.: John Wiley & Sons, New York-Toronto, Ont.-London, 1977.
- 5[5] J. Weickert. Anisotropic Diffusion in Image Processing . ECMI Series. Teubner, Stuttgart, 1998.
- 6[6] R. A. Adams. Sobolev spaces , volume 65 of Pure and Applied Mathematics . Academic Press, New-York-London, 1975.
- 7[7] J. Malỳ and W.P. Ziemer. Fine Regularity of Solutions of Elliptic Partial Differential Equations . Mathematical surveys and monographs. American Mathematical Society, 1997.
- 8[8] M. Bildhauer and M. Fuchs. A variational approach to the denoising of images based on different variants of the TV-regularization. Appl. Math. Optim. , 66(3):331 – 361, 2012.
