A new metastable convergence criterion and an application in the theory of uniformly convex Banach spaces
Thomas Powell

TL;DR
This paper introduces a generalized convergence criterion called metastable rate of asymptotic decreasingness, applies it to fixed point theory in uniformly convex Banach spaces, and provides quantitative convergence rates for Picard iterates.
Contribution
It develops a new metastable convergence criterion and applies it to derive explicit rates of convergence in fixed point theory within Banach spaces.
Findings
Established a quantitative metastability rate for Picard iterates.
Applied the criterion to fixed point convergence in uniformly convex Banach spaces.
Provided explicit bounds for convergence in the context of Kirk and Sims' proof.
Abstract
We study a convergence criterion which generalises the notion of being monotonically decreasing, and introduce a quantitative version of this criterion, a so called metastable rate of asymptotic decreasingness. We then present a concrete application in the fixed point theory of uniformly convex Banach spaces, in which we carry out a quantitative analysis of a convergence proof of Kirk and Sims. More precisely, we produce a rate of metastability (in the sense of Tao) for the Picard iterates of mappings T which satisfy a variant of the convergence criterion, and whose fixed point set has nonempty interior.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
A new metastable convergence criterion and an application in the theory of uniformly convex Banach spaces
Thomas Powell
Abstract
We study a convergence criterion which generalises the notion of being monotonically decreasing, and introduce a quantitative version of this criterion, a so called metastable rate of asymptotic decreasingness. We then present a concrete application in the fixed point theory of uniformly convex Banach spaces, in which we carry out a quantitative analysis of a convergence proof of Kirk and Sims. More precisely, we produce a rate of metastability (in the sense of Tao) for the Picard iterates of mappings which satisfy a variant of the convergence criterion, and whose fixed point set has nonempty interior.
1 Introduction
Let be a mapping on some closed subset of a complete metric space . It is well known that whenever is a contraction, the sequence of Picard iterates converges to a fixed point of , and that this result no longer holds in general when is nonexpansive. A natural question then arises: under what additional conditions can we guarantee convergence of the Picard iterates for nonexpansive ?
For a Banach space, it turns out that a combination of uniform convexity of together with nonemptyness of the interior of the fixed point set suffices for this - an observation originally due to Beauzamy. In [5], Kirk and Sims provide a proof of this fact and observe that the result holds under much broader conditions on , namely that (or one of its iterates) is continuous and
[TABLE]
for all . In particular, the above conditions hold whenever is asymptotically nonexpansive [4], in other words when there exists a sequence with such that for all :
[TABLE]
In this paper, we study the result of Kirk and Sims in the context of the proof mining program. The novelty of the work lies in the fact that we carry out an abstract quantitative analysis of the notion of ‘convergence to the infimum’, and that the subsequent application constitutes one of the first proof theoretic studies of a nonempty interior condition in the theory of uniformly convex Banach spaces.
Proof mining is a branch of applied proof theory focused on the extraction of numerical information from nonconstructive proofs in mathematics. Developed in the 1990s by U. Kohlenbach, it has already achieved considerable success in functional analysis, where a corresponding body of so-called logical metatheorems have now been established [3, 7] which guarantee the extraction of highly uniform bounds from a large class of proofs. For a broader overview of the proof mining program, the reader is encouraged to consult the standard text [8].
The techniques of proof mining are often applied to proofs of convergence theorems, in which case we first have to specify what kind of numerical information we expect to be able to extract. Typically, this depends on the logical structure of the theorem at hand. Convergence in general, when formulated as a Cauchy property, is a statement
[TABLE]
and it is a well-known phenomenon that we cannot in general produce computable witnesses for theorems of this form. In the case of convergence this is witnessed by so-called Specker sequences [15] - simple computable sequences that do not have a computable rate of convergence i.e. a computable function satisfying
[TABLE]
That this is not possible in our specific setting, where denotes a sequence of Picard iterates , follows from [9, Theorem 4.4 (2)] which in turn adapts a construction of [13]: Already for it is shown that there exists a nonexpansive map (which can be easily extended to one with ) such that the sequence has no computable rate of convergence.
In these situations, we consider instead the metastable version of (2):
[TABLE]
The statement (3) is known in logic as the Herbrand normal form of (2), and though the two are completely equivalent, (3) is computationally tractable in the sense that under very general conditions we can produce a computable rate of metastability for the , that is a functional satisfying
[TABLE]
Note that the existence of a computable rate of metastability does not contradict the impossibility of finding a computable rate of convergence, because the route from (3) to (2) requires proof by contradiction and is thus nonconstrutive.
Recently, metastable convergence theorems in the sense of (3) have been made popular by T. Tao [17] where they have found direct applications in ergodic theory. The extraction of effective rates of metastability is a standard result in proof mining, and has been accomplished in numerous different settings (see e.g. [6, 10, 11]).
The main result of this paper (Theorem 5.6) is a highly uniform rate of metastability for the Picard iterates for mappings which satisfy (1), where and is uniformly convex111Note that in the special case that is a Hilbert space and nonexpansive, convergence of the Picard iterates when is an instance of a general convergence property for Fejér monotone sequences in Hilbert spaces [1, Proposition 5.10], and a rate of metastability for the Picard iterates in this case already follows from the analysis of this property given by Sipoş [14, Proposition 4.2.3].. In order to achieve this, we need to provide quantitative analogues for each of our assumptions. In particular,
- •
uniform convexity of is represented by a modulus of uniform convexity;
- •
the property is represented by a metastable rate of asymptotic decreasingness.
While moduli of uniform convexity are well known and have been widely applied in proof mining, metastable rates of asymptotic decreasingness are introduced and studied for the first time in this paper, and arise from a general analysis of convergence which we carry out in Section 2.
Rates of metastability are powerful in part because they enable us to produce direct witnesses for theorems. Generally speaking, if (2) is used as a lemma in the proof of some theorem , a rate of metastability can be used to construct a computable function which satisfies (see [8, Chapter 1] for a more detailed discussion).
An illustration of this phenomenon can be given in our setting. For the special case where is nonexpansive, asymptotic regularity of the Picard iterates i.e.
[TABLE]
follows directly from the fact that the iterates themselves converge. Since the sequence is monotonically decreasing, asymptotic regularity is actually equivalent to the statement
[TABLE]
As a result, we are able to adapt our aforementioned rate of metastability to produce a direct rate of asymptotic regularity for the Picard iterates, and in Theorem 6.1 we provide a concrete instance of this rate in the case where is an space. This result forms yet another illustration of how methods from proof theory can be used to extract simple numerical bounds of low polynomial complexity from proofs which are prima-facie nonconstructive.
2 Convergence to the infimum
We begin by studying the notion that a sequence of nonnegative real numbers converges to their infimum:
[TABLE]
This holds whenever is decreasing, but conversely not all sequences converging to their infimum are decreasing. It turns out, however, that the following Cauchy property, which in some sense approximates decreasingness, is necessary and sufficient for convergence to the infimum:
[TABLE]
We refer to any sequence satisfying (5) as asymptotically decreasing. Note that in the case where is just decreasing we would set , although in general can also depend on . The following fact is trivial, but we isolate it since it will be separately analysed below.
Lemma 2.1**.**
Let be a nonnegative sequence of real numbers. Then it satisfies
[TABLE]
Proof.
Let . Then for any there exists some with and thus for all . ∎
Theorem 2.2**.**
A sequence of nonnegative reals is asymptotically decreasing if and only if it converges to its infimum.
Proof.
Let . If then for any there is some such that , and since for any we have and hence , it follows easily that is asymptotically decreasing.
In the other direction, if is asymptotically decreasing then we first claim that it is Cauchy. To see this, fixing we apply Lemma 2.1 by which there is some such that for all . In addition, by (5) there is some such that for all , and combining these we have for all and thus for all .
This proves the claim, and thus converges to some limit . Suppose that and let . Then there is some such that , and by (5) some such that for all , contradicting . Therefore . ∎
In general, there are sequences of nonnegative reals which have no computable metastable rate of asymptotic decreasingness, by which we mean a procedure which returns some satisfying (5). A trivial example would be to take any decreasing Specker sequence which converges to some non-computable infimum , and define by and . Then would be a computable rate of convergence for the Specker sequence, which is impossible by definition222A. Sipoş asks if we could strengthen this by choosing be to computable, since in our example, is a noncomputable real. We conjecture that this is indeed possible, but a more detailed discussion at this point would take us too far afield..
Thus we are interested in the metastable version of asymptotic decreasingness, namely the reformulation of (5) analogous to metastability in the usual sense as given in (3), which in this case is
[TABLE]
Analogous to (4), we call a metastable rate of asymptotic decreasingness if it satisfies
[TABLE]
We now carry out a quantitative analysis of Theorem 2.2 and show how to obtain a rate of metastability for in terms of some satisfying (6). Our first step is a quantitative version of Lemma 2.1, for which we need some notation which we will also make use of in later sections.
Notation 2.3**.**
- •
Given a function we define by . Note that and for all , and moreover whenever .
- •
Similarly, given a functional we define
[TABLE]
and observe that it satisfies analogous monotonicity properties.
- •
We denote by the -times iteration of .
Lemma 2.4**.**
Let be a sequence of nonnegative real numbers with . Then
[TABLE]
Proof.
Suppose that (7) is false for some and i.e.
[TABLE]
We show that for all there exists some such that . For this follows by setting in (8) and noting that for some . For the induction step, assuming that for we have found some with , we set . Since we can apply (8), by which there exists some with .
This completes the induction, so for there exists some such that , a contradiction. ∎
Theorem 2.5**.**
Let be a sequence of nonnegative numbers with , and suppose that satisfies (6). Then the function
[TABLE]
for is a rate of metastability for in the sense of (4).
Proof.
Fix some parameters and . It is easy to show that and implies , and thus . Therefore by Lemma 2.4 there exists some such that
[TABLE]
But by definition of there is some
[TABLE]
satisfying , and since
[TABLE]
we have in addition and thus for all , from which the result follows. ∎
In the special case where is decreasing, (6) would be realised by the function and the rate of metastability obtained from Theorem 2.5 would be for , which is (essentially) the standard rate of metastability for monotone sequences.
3 Asymptotically nonexpansive mappings in uniformly convex spaces
We now move on to an application of our metastable formulation of asymptotically decreasing sequences in the fixed point theory of nonexpansive mappings. More specifically, we will analyse the following result, which is adapted from Kirk and Sims [5]:
Theorem 3.1**.**
Let be a subset of a uniformly convex Banach space and a mapping with . Pick some and suppose that satisfies the following condition:
[TABLE]
Then the sequence is Cauchy.
The condition (9) simply says that the sequence is asymptotically decreasing for any . It is trivially satisfied when is quasi-nonexpansive, and also more generally when is asymptotically nonexpansive:
Lemma 3.2**.**
Suppose that is asymptotically nonexpansive w.r.t. some sequence . Then satisfies (9) for any .
Proof.
Fixing parameters , , and and assuming w.l.o.g. that , there exists some such that
[TABLE]
for all . Then for we have for some and thus
[TABLE]
∎
As an immediate consequence we obtain the following, which is given as Theorem 5.2 of [5].
Corollary 3.3** (Kirk/Sims [5]).**
Suppose that is a closed subset of a uniformly convex Banach space and is asymptotically nonexpansive with . Then for each the sequence converges to a fixed point of .
Proof.
By Lemma 3.2, satisfies (9) for any , and thus by Theorem 3.1 is Cauchy, and thus converges to a limit which lies in the closed set . Since is also continuous, this limit must be a fixed point. ∎
It is already observed in [5] that Corollary 3.3 holds more generally for arbitrary satisfying
[TABLE]
for all , provided or one of its iterates is continuous. In fact, only (10) is required to establish convergence of the Picard iterates, and by Theorem 2.2 this can be weakened to the Cauchy property (9). For all these results, uniform convexity of the underlying Banach space is used in the following form, due independently to Edelstein [2] and Steckin [16].
Notation 3.4**.**
We denote by resp. the closed resp. open ball of radius centered at , and by the line segment from to .
Lemma 3.5**.**
Suppose that is a uniformly convex Banach space. Then for any and satisfying where we have
[TABLE]
Moreover, the convergence is uniform in .
Note that later we analyse the proof of Lemma 3.5 given in [18] (cf. Lemma 1.1).
We now give a proof of Theorem 3.1, which is an adaptation of the proof of Theorem 5.2 in [5]. Crucially, we use separately the existence of for some (which is of course trivial and has nothing to do with any properties of ), and later a single instance of (9) for some .
Proof of Theorem 3.1.
Since there is some and such that . Let . If then the result follows trivially, so we assume .
Pick some such that and thus . By Lemma 3.5, fixing any there is some such that
[TABLE]
for any with . Now, for each choose so that it satisfies
[TABLE]
Then we have for all and , and so in particular there exists some such that
[TABLE]
Applying (9) on , and there exists some such that for all we have
[TABLE]
In other words, for all . But and thus we also have for all , and since it follows by (11) that
[TABLE]
for all . Since was arbitrary, we have shown that the Picard iterates form a Cauchy sequence. ∎
We now carry out a quantitative analysis of the above proof. To begin with, we first need to consider the role played by uniform convexity in Lemma 3.5.
4 A reformulation of uniform convexity
Uniform convexity of a Banach space can be given a quantitative form via the so-called modulus of uniform convexity defined by
[TABLE]
where is the closed unit ball. In applications of proof theory to uniformly convex spaces, rather than the unique modulus of uniform convexity one traditionally works with ‘a’ modulus of uniform convexity for , which is defined to be any function satisfying
[TABLE]
In our analysis of Theorem 3.1, we do not use such a modulus directly, but require instead a reformulation of it which reflects the way in which uniform convexity is applied via Lemma 3.5. The following is a quantitative analysis of the proof of Lemma 3.5 given in [18].
Lemma 4.1**.**
Suppose that is a modulus of uniform convexity for , and define by
[TABLE]
Then satisfies
[TABLE]
Proof.
Fix parameters and satisfying the premise of (13) and set and . Note that by definition, and since we have and thus . Therefore in fact , and observing that we have and thus . It follows that
[TABLE]
which, using that , results in
[TABLE]
Since and we can apply (12) to obtain . Observing that
[TABLE]
we have
[TABLE]
which completes the proof. ∎
5 A quantitative analysis of Theorem 3.1
We now present the main result of the second part of this paper: A quantitative formulation of Theorem 3.1. Our goal is a rate of metastability for the Picard iterates . However, we will need to take as input quantitative versions of the assumptions of Theorem 3.1.
For the remainder of the section, we fix our underlying Banach space , together with for some and . In addition, we assume we have all of the following, which form quantitative versions of our assumptions that (a) is uniformly convex, (b) and (c) satisfies (9) w.r.t , respectively:
- (a)
A function as in Lemma 4.1 satisfying (13), defined in terms of a modulus of uniform convexity for ; 2. (b)
Some and such that , together some satisfying ; 3. (c)
A metastable rate of asymptotic decreasingness for which is uniform in and depends only on and i.e. a function satisfying
[TABLE]
whenever .
As we will see in Section 6, the additional uniformity conditions on - which simplify the analysis considerably - are naturally satisfied in the case of asymptotically nonexpansive mappings, and as such we consider them reasonable. Note that for nonexpansive, we can just set , since for any and we trivially have
[TABLE]
Our main result in Theorem 5.6 will be a rate of metastability for , which in addition to the functions witnessing uniform convexity and metastable asymptotic decreasingness as above, depends only on sparse numerical data about and , namely the radius of and an upper bound for .
For the remainder of the section, in addition to and , we fix and satisfying (a)-(c), together with parameters and . Our aim is to find a bound on some satisfying
[TABLE]
which will be accomplished by a careful analysis of the proof of Theorem 3.1 given in Section 3. The first step is to eliminate the simple case in which for some .
Lemma 5.1**.**
If for some then we have .
Proof.
implies that and thus for any . ∎
Just as in the proof of Theorem 3.1, the main part of the analysis deals with the case for all . From now on, it will be helpful to use the following abbreviations:
[TABLE]
Note that is well defined since we can assume that is small enough that . The following very simple lemma helps organise the way uniform convexity is applied.
Lemma 5.2**.**
Suppose that and satisfy
- (a)
** 2. (b)
** 3. (c)
** 4. (d)
.
Then .
Proof.
Dividing the inequality (d) through by we have
[TABLE]
Since, in addition, we have and , we can apply (13) to obtain
[TABLE]
where for the last step we use . ∎
We now deal with the main non-constructive step in the proof, namely the combination of use of in conjunction with asymptotic decreasingness of for all . This step corresponds closely to the abstract result already established in Theorem 2.5.
Lemma 5.3**.**
Take some and define the function by
[TABLE]
where and are defined as in Section 2 (where now has two additional fixed parameters ). Then there exists some
[TABLE]
together with some
[TABLE]
satisfying
- (i)
** 2. (ii)
**
Proof.
First of all, just as in the proof of Theorem 2.5, we note that . Therefore applying Lemma 2.4 to the sequence and noting that , there exists some such that
[TABLE]
Now, by the defining property of (14), there exists some
[TABLE]
satisfying
[TABLE]
for all . This establishes (ii). But
[TABLE]
and thus (i) follows from (16). ∎
We now tie together the previous two lemmas.
Lemma 5.4**.**
Suppose that and are as in Lemma 5.3 for
[TABLE]
and that
[TABLE]
Define together with as follows:
[TABLE]
Then for any we have
[TABLE]
Proof.
First, from our assumption (17) we have
[TABLE]
where the last step follows from . This will be used in two places in the proof. We now fix some and define . We will show that and satisfy each of the conditions from Lemma 5.2.
For (a), follows from (18), and using Lemma 5.3 (i) we have in particular
[TABLE]
Condition (b) holds by definition, while for (c) we use Lemma 5.3 (i) again: Since we have
[TABLE]
The final condition (d) is a little more involved. First let us define . Since
[TABLE]
here using that and , we thus have , and so now appealing to Lemma 5.3 (ii) we have
[TABLE]
where the last step uses (18). Since the hypotheses of Lemma 5.2 are now all satisfied, we can infer
[TABLE]
and we are done. ∎
Corollary 5.5**.**
Suppose that and are defined as in Lemma 5.3 for and that . Then we have .
Proof.
Note that for as defined in (15). Defining and as in Lemma 5.4 it follows that for we have . ∎
The main theorem now follows by combining the above corollary with Lemma 5.1 and expanding all of our definitions.
Theorem 5.6**.**
Let be a Banach space, a mapping such that for some and . Suppose that and for some . Finally, suppose that is a modulus of uniform convexity for in the sense of (12) and a rate of asymptotic decreasingness for uniform for as in (14). Then
[TABLE]
where is defined as follows:
- •
;
- •
;
- •
;
- •
.
Proof.
There are two possibilities: If for some then by Lemma 5.1 we would have for all , and since the result follows.
On the other hand, suppose that this is not the case, and and are as in Lemma 5.3. In particular, since we must have , and so for all by Corollary 5.5, and by Lemma 5.3. ∎
Note that as a simple corollary to our main theorem, we are able to locate approximate fixed points of , where is an approximate, or -fixed point if
[TABLE]
Corollary 5.7**.**
Under the conditions of Theorem 5.6, for any and , there exists some where such that is an -fixed point of .
Proof.
By Theorem 5.6, there exists some such that for all , so in particular for we have . ∎
6 Special cases
We conclude by considering concrete properties on the mapping which guarantee that there is some metastable rate of asymptotic decreasingness satisfying (14).
6.1 Nonexpansive mappings
As we have already mentioned, in the case where is nonexpansive, the function forms a metastable rate of asymptotic decreasingness. In this case, a rate of metastability for the Picard iterates is given by
[TABLE]
for and defined as in Theorem 5.6. In fact, one can even show that the same bound works with , but we do not give the details here. Moreover, in the case of nonexpansive maps, Corollary 5.7 even gives us a direct rate of asymptotic regularity as a byproduct. Recall that a mapping is asymptotically regular if
[TABLE]
Now by Corollary 5.7, setting in (19) and noting that in this case , it follows that there exists some such that . But since is nonexpansive, for any we have , and so is a rate of asymptotic regularity for . Simple, concrete instantiations of this can be given in particular spaces, for example:
Theorem 6.1**.**
Let be a nonexpansive mapping in for , and suppose that for some and . Suppose that and . Then
[TABLE]
where
[TABLE]
Proof.
For a modulus of uniform convexity of is given by (see [12, p. 63]). The result follows by the observations above and unwinding the definitions of Theorem 5.6. ∎
6.2 Asymptotically nonexpansive mappings
The case where is asymptotically nonexpansive w.r.t. some is slightly more interesting, as in general will now depend on information about the convergence of . The following is essentially a quantitative version of Lemma 3.2.
Lemma 6.2**.**
Suppose that is asymptotically nonexpansive w.r.t. with and is such that . Suppose in addition that is bounded above by some and has a rate of metastability which satisfies
[TABLE]
Then the function given by
[TABLE]
where , is a metastable rate of asymptotic decreasingness satisfying (14), uniformly for .
Proof.
Fixing some and , we first note that there exists some such that
[TABLE]
Setting , for any we have for some , and therefore
[TABLE]
where
[TABLE]
and thus we’ve shown . ∎
Therefore instantiating Theorem 5.6 with as defined in Lemma 6.2 would result in a rate of metastability for the Picard iterates in the case where is asymptotically nonexpansive w.r.t. , in terms of the usual data plus an upper bound and rate of metastability for .
Note that it is far more common for asymptotically nonexpansive maps to be defined w.r.t. some decreasing , in which case convergence is actually a formula
[TABLE]
and from a proof of the above we would generally expect to be able to produce an explicit rate of convergence for satisfying
[TABLE]
In this case, a simplification of the proof of Lemma 6.2 would result in a rate of asymptotic decreasingness given by
[TABLE]
where now we only require that . One can easily show that in this case , and therefore in this case, by Theorem 5.6, a rate of metastability for the Picard iterates would be given by
[TABLE]
where and , and is again defined as in Theorem 5.6.
Acknowledgements. I am grateful to Ulrich Kohlenbach for proposing the study of [5], and to both Ulrich Kohlenbach and Andrei Sipoş for numerous helpful comments and suggestions on earlier drafts of this paper. I would also like to thank the anonymous referee for their corrections. This work was supported by the German Science Foundation (DFG Project KO 1737/6-1).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] H. Bauschke and P. Combettes. Convex Analysis and Monotone Operator Theory in Hilbert Spaces . Springer, 2010.
- 2[2] M. Edelstein. Farthest points of sets in uniformly convex Banach spaces. Israel J. Math. , 4:171–176, 1966.
- 3[3] P. Gerhardy and U. Kohlenbach. General logical metatheorems for functional analysis. Trans. Amer. Math. Soc. , 360:2605–2660, 2008.
- 4[4] K. Goebel and W. A. Kirk. A fixed point theorem for asymptotically nonexpansive mappings. Proc. Amer. Math. Soc. , 35:171–174, 1972.
- 5[5] W. A. Kirk and B. Sims. Convergence of Picard iterates of nonexpansive mappings. Bulletin of the Polish Academy of Sciences , (47):147–155, 1999.
- 6[6] U. Kohlenbach. Some computational aspects of metric fixed point theory. Nonlinear Analysis , 61(5):823–837, 2005.
- 7[7] U. Kohlenbach. Some logical metatheorems with applications in functional analysis. Trans. Amer. Math. Soc. , 357:89–128, 2005.
- 8[8] U. Kohlenbach. Applied Proof Theory: Proof Interpretations and their Use in Mathematics . Monographs in Mathematics. Springer, 2008.
