A note on strong convergence to common fixed points of nonexpansive mappings in Hilbert spaces
Jean-Philippe Chancelier (CERMICS)

TL;DR
This paper explores the strong convergence properties of algorithms for finding common fixed points of nonexpansive mappings in Hilbert spaces, linking various iterative methods and extending existing theorems.
Contribution
It establishes new connections between ${ m T}_C$-class algorithms, CQ Algorithm, and shrinking projection methods, extending convergence results for nonexpansive mappings.
Findings
Strong convergence of algorithms is related to coherent ${ m T}_C$-class sequences.
Examples demonstrate applicability to nonexpansive finite sets and semigroups.
Extensions of existing theorems on fixed point convergence.
Abstract
The aim of this paper is to investigate the links between -class algorithms, CQ Algorithm and shrinking projection methods. We show that strong convergence of these algorithms are related to coherent -class sequences of mapping. Some examples dealing with nonexpansive finite set of mappings and nonexpansive semigroups are given. They extend some existing theorems.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsOptimization and Variational Analysis · Advanced Optimization Algorithms Research · Fixed Point Theorems Analysis
A note on strong convergence to common fixed points of nonexpansive mappings
in Hilbert spaces
Jean-Philippe Chancelier Université Paris-Est, CERMICS, École des Ponts, 6 & 8 av. B. Pascal, 77455 Marne-la-Vallée, France.
Résumé
The aim of this paper is to investigate the links between -class algorithms [1], CQ Algorithm [6, 8] and shrinking projection methods [9]. We show that strong convergence of these algorithms are related to coherent -class sequences of mapping. Some examples dealing with nonexpansive finite set of mappings and nonexpansive semigroups are given. They extend some existing theorems in [1, 6, 9, 7].
1 Introduction
Let be a closed convex subset of a Hilbert space . A mapping of into itself is called nonexpansive if
[TABLE]
We denote by the set of fixed points of . That is
[TABLE]
There are many iterative methods for approximation of common fixed points of a family of nonexpansive mapping in a Hilbert space. In Section 2 we recall the CQ Algorithm [6, 8] (Algorithm 2) associated to a sequence of mappings of into itself. The CQ Algorithm when applied to a sequence of mappings of into itself is the same as a Haugazeau method [4] studied in [1, Algorithm 3.1] and applied to -class mappings.
We straighforwardly generalize, in Section 2, the -class to take into account mappings of into itself. We denote this new class by the -class. Using this extension, the CQ Algorithm (Algorithm 2) coincides with the Haugazeau method (Algorithm 1) and a strong convergence theorem can be obtained by following results from [1]. Note that the convergence theorem is obtained for -class sequences which are coherent (Definition 5).
In [9] another algorithm called the shrinking projection method is also studied. One of our aims in this article is to prove that, rephrased in the context of -class algorithm, the convergence results of this new algorithm (Algorithm 3) is also related to coherent sequences of -class mappings. We give in Theorem 6 a strong convergence result of Algorithm 3 for -class coherent sequence of mappings. Section 4 is devoted to the proof. The strong convergence of Algorithm 3 is also proved in [9, Theorem 3.3] for sequence of nonexpansive mappings satisfying the NST-condition(I) (Definition 9). It is easy to prove that if is a nonexpansive mapping of into itself then belongs to the -class and that a sequence of nonexpansive mappings satisfying the NST-condition(I) is coherent. Thus Theorem 6 extends [9, Theorem 3.3 and Theorem 3.4].
In Section 3 we show that specific sequences of mappings are coherent. Combined with Theorem 6 it can be considered as an extension to some existing theorems in [6, 9, 7].
2 The -class iterative algorithms, CQ algorithm and the shrinking projection method
We first recall here the -class iterative algorithms as defined by H. Bauschke and P. L. Combettes [1].
For and a subset of , we define the mapping as follows:
[TABLE]
We also define the mapping by . Note that and for , is a closed affine half space. For a nonempty closed convex , we denote by the projection, when it exists, of onto and the projection when , that is . As an intersection of two closed affine half spaces and a closed convex, is a possibly empty closed convex.
It is easy to check, from the definition of , that is the projection of onto and we therefore have . Where is the metric projection from onto . Moreover, if then we also have that is the projection of onto which gives .
The algorithm studied in [1] is the following
Algorithm 1
Given and a sequence of mappings , we consider the sequence generated by the following algorithm:
[TABLE]
A very similar algorithm exists under the name of CQ algorithm [6, 8]:
Algorithm 2
Given , we consider the sequence generated by the following algorithm:
[TABLE]
The link between the two algorithms is described by the following lemma.
Lemma 1
The sequence generated by Algorithm 2 coincides with the sequence given by with .
Proof: Following [1], the proof easily follows from the equality
[TABLE]
The convergence of Algorithm 1 and therefore of Algorithm 2 when is studied in [1]. It relies on two requested properties of the sequence . First, the sequence must belong the -class which means that for all we must have where is defined as follows:
Definition 2
A mapping belongs to the -class if it is an element of the set :
[TABLE]
When , we use the notation . Second, the sequence must be coherent as defined below.
Definition 3
[1]** A sequence such that is coherent if for every bounded sequence the following holds:
[TABLE]
where is the set of weak cluster points of the sequence .
Theorem 4
[1, Theorem 4.2]** Suppose that and the -class sequence is coherent. Then, for an arbitrary orbit of Algorithm 1, exactly one of the following alternatives holds:
- (a)
* and ;* 2. (b)
* and ;* 3. (c)
* and the algorithm terminates,*
where the set is defined by .
Remark 5
In the previous proof, it is supposed that . If is a nonempty closed convex subset of , Theorem 4 remains valid.
In [9] another iterative algorithm called the shrinking projection method is studied. Using our notation it can be rephrased as follows:
Algorithm 3
Given and , we consider the sequence (when it exists) generated by the following algorithm:
[TABLE]
The previous algorithm is stopped once . One of the results of this paper is the proof that the convergence of Algorithm 3 is governed by the same rules as for the convergence of Algorithm 1.
Theorem 6
Suppose that the -class sequence is coherent and let
[TABLE]
Then, if the sequence produced by Algorithm 3 and Algorithm 1 converges to .
Proof: As pointed out in the introduction the case of Algorithm 1 when is proved in Theorem 4. The extension to the case of a closed nonempty subset of is straightforward and we will not give an explicit proof. The proof of the case of Algorithm 3 is postponed to Section 4.
Remark 7
The first condition for the convergence is the fact that the sequence must belong to the -class. Note that by [1, Proposition 2.3] iff the mapping is quasi nonexpansive and . The equivalence remains true for -class if is replaced by .
Thus, if , a necessary and sufficient condition for the sequence to belong to the -class is that the sequence is a sequence of quasi nonexpansive mappings.
Remark 8
Moreover, it is a well known fact [3, Theorem 12.1] that is nonexpansive iff is firmly nonexpansive. Thus, a sufficient condition for the mapping to belong to the -class is that is a firmly nonexpansive mapping, i.e:
[TABLE]
or equivalently
[TABLE]
We recall here the definition of the NST-condition (I) [5]. Let and be two families of nonexpansive mappings of into itself such that
[TABLE]
where is the set of all common fixed points of mappings from the family .
Definition 9
The sequence of mappings is said to satisfy the NST-condition (I) with if, for each bounded sequence , we have that implies that for all .
Remark 10
Suppose that is a family of nonexpansive mappings. It is easy to see that a sequence of mappings satisfying a NST-condition (I) with is coherent. Indeed, from a demi-closed principle or using [9, Lemma 3.1] if for all then .
3 Coherent sequences of mappings
We consider here Algorithms 1 and 3 for a sequence of mappings built by level iterations. Our aim is to give conditions under which the sequence or equivalently is coherent111By [1, Proposition 4.5] if and with and . Then is coherent iff is coherent. and apply Theorem 6 to get convergence results.
Let and for be a finite set of sequences of nonexpansive mappings. Given also a family of sequences of real parameters for , we define new sequences by the recursive equations:
[TABLE]
: We will assume that the sequences of real parameters satisfy the following condition: for and for all we have with and .
Using the sequence of mappings in Algorithms 1 and 3 gives level algorithms. We will consider the following specific examples:
Each sequence is constant, i.e for and is nonempty.
The sequences for are given by , where is a finite set of given semigrougs and is a sequence of real numbers such that , and . We assume that is nonempty.
The sequences for are given by
[TABLE]
where is a finite set of given semigrougs and is a positive divergent sequence of real numbers. We assume that is nonempty.
Theorem 11
Given a finite set of nonexpansive sequences satisfying , , or . The sequence produced by Algorithm 1 and Algorithm 3 with and converges to . The mappings being defined by equation (8) with parameters satisfying .
Proof: The proof is obtained by showing that the sequence of mappings is coherent in each given case and by applying Theorem 6 to conclude. The coherence is proved in the sequel in Proposition 15 for the case , in Proposition 17 for the case and in Proposition 19 for the case .
We start here by a set of lemmata which are common to all cases.
Lemma 12
Let be a -quasi nonexpansive mapping and for the mapping . For and all we have :
[TABLE]
Proof: For and all we have :
[TABLE]
We thus obtain
[TABLE]
Lemma 13
Let a -quasi nonexpansive mapping. For we define the mapping . For , all and a -quasi nonexpansive mapping, we have :
[TABLE]
If moreover is nonexpansive we also have :
[TABLE]
Proof: For and all we have :
[TABLE]
We thus have which combined with Lemma 10 gives equation (11).
Now if is nonexpansive,
[TABLE]
Lemma 14
*Suppose that is not empty suppose that for a bounded sequence and a fixed value of we have
. Moreover, suppose that for and all we have with . Then for all we have .*
Proof: Note first that the sequences and are composed of nonexpansive mappings. Indeed the composition of nonexpansive mappings is nonexpansive and for is nonexpansive when is nonexpansive. The sequences are also -quasi nonexpansive since it is straightforward that for all and and if is nonexpansive it is also -quasi nonexpansive.
The proof then follows by backward induction on . Assume that the result is true for then we will prove that it is true for . Using the definition of and using equation (11) for , , and (we thus have ) we obtain :
[TABLE]
We thus obtain that and by induction hypothesis we obtain for . Now using equation (12) with , and we get:
[TABLE]
and the result follows for .
3.1 The case
Proposition 15
*In the case , the sequence , defined by with parameters satisfying , satisfy the NST-condition(I) with
and the sequence is a -class and coherent sequence.*
Proof: We have . Thus, if for each bounded sequence we also have since is bounded from zero. Using Lemma 14 we have for which gives use the NST-condition(I) with . Now we consider the sequence . The sequence belongs to the -class since is nonexpansive and thus quasi nonexpansive. Now if we also have and thus using the NST-condition(I) we have for . Since the are nonexpansive they are also demi-closed [2, Lemma 4] and thus we must have . The sequence is thus in the -class and coherent.
Remark 16
For we recover [9, Theorem 1.1] and [9, Theorem 4.1].
3.2 The case
Let be a family of mappings from a subset of into itself. We call it a nonexpansive semigroup on if the following conditions are satisfied:
- (i)
for all ;
- (ii)
for all ;
- (iii)
for each the mapping is continuous;
- (iv)
for all and .
Proposition 17
*In the case , the sequence , defined by with parameters satisfying , satisfy the NST-condition(I) with
and the sequence is a -class and coherent sequence.*
Proof: As in the proof of Proposition 15 we obtain that for each bounded sequence such that we also have for . Now it is easy to prove that the weak cluster points of the sequence are in . The proof for each fixed is the same as in [7, Theorem 2.2, page 6]. We thus obtain the coherence of the sequence .
Remark 18
For we recover [7, Theorem 2.1] for Algorithm 3 and [7, Theorem 2.2] for Algorithm 1.
3.3 The case
Proposition 19
*In the case , the sequence , defined by with parameters satisfying , satisfy the NST-condition(I) with
and the sequence is a -class and coherent sequence.*
Proof: As in the proof of Proposition 15 we obtain that for each bounded sequence such that we also have for . Now it is easy to prove that the weak cluster points of the sequence are in . The proof for each fixed is the same as in [6, Theorem 4.1]. For each fixed , it is a consequence of the inequality [6, Equation (8)]:
[TABLE]
for every and with and the fact that the right hand side of the above inequality goes to zero as goes to infinity for a bounded sequence using [6, Lemma 2.1]. We thus obtain the coherence of the sequence .
Remark 20
For we recover [6, Theorem 4.1] for Algorithm 1 and [9, Theorem 4.4] for Algorithm 3.
4 Proof of Theorem 6
We prove here the strong convergence of Algorithm 3 for a -class sequence of coherent mappings. The proof follows the same steps as the proof of the convergence of Algorithm 1 in [1], we therefore give references to the original propositions.
The proof results from the next proposition and theorem in the following way. Let be an arbitrary orbit of Algorithm 3 and let . If , then by Proposition 21 the sequence is defined. By Theorem 22 the sequence is bounded. Thus is fulfilled and by the coherence property we have . Then, by Theorem 22 , the sequence strongly converges to .
Proposition 21
[1, Proposition 3.4]** Let be an arbitrary orbit of Algorithm 3. Then:
If is defined then .
If is defined then .
If is defined then is increasing.
* is defined if .*
Proof: : If is defined we have and thus and since we have . : The fist equivalence follows from . The second one is proved by induction. Note first that is such that . Now for , we obtain also that . for , we have and thus . Now assume that the equivalence if fulfilled for . We have
[TABLE]
follows from . : The algorithm is defined if for all . Thus it is enough to prove that . By definition of the class we have and the result follows.
Theorem 22
([1, Theorem 3.5]) Let be an arbitrary orbit of Algorithm 3 and let . Then
If is defined then: is bounded converges.
If , then is bounded and .
*If , then converges and *
.
If , then: .
If is defined and bounded then and .
Proof: follows from Proposition 21 . : If then by Proposition 21 the sequence is defined. We have and thus . Now, from and we obtain and follows. follows from , and the previous inequality. : The forward implication is trivial. For the reverse implication, the proof exactly follows of [1, Theorem 3.5] since it does not involve . : From and we obtain:
[TABLE]
We thus have :
[TABLE]
Hence since is bounded. For all we have , which implies,
[TABLE]
and we therefore obtain .
Références
- [1]
H. H. Bauschke, P. L. Combettes, A weak-to-strong convergence principle for fejér-monotone methods in hilbert spaces, Mathematics of Operations Research 26 (2) (2001) 248–264.
- [2]
F. Browder, Convergence theorems for sequences of nonlinear operators in banch spaces, Math. Z. 100 (1967) 201–225.
- [3]
K. Goebel, W. Kirk, Topics in Metric Fixed Point Theory, Cambridge Studies in Advanced Mathematics, Cambridge University Press ed., 1990.
- [4]
Y. Haugazeau, Sur les inéquations variationnelles et la minimisation de fonctionnelles convexes, Ph.D. thesis, Université de Paris, Paris (1968).
- [5]
K. Nakajo, K. Shimoji, W. Takahashi, Strong convergence to common fixed points of families of nonexpansive mappings in banach spaces, J. Nonlinear Convex Anal. 8 (2007) 11–34.
- [6]
K. Nakajo, W. Takahashi, Strong convergence theorems for nonexpansive mappings and nonexpansive semigroups, J. Math. Anal. Appl. 279 (2003) 372–379.
- [7]
S. Saejung, Strong convergence theorems for nonexpansive semigroups without bochner integrals, Fixed Points Theory Appl.doi:10.1155/2008/745010.
- [8]
M. Solodov, B. Svaiter, Forcing strong convergence of proximal point iterations in a hilbert space, Math. Program. Ser. A (87) (2000) 189–202.
- [9]
W. Takahashi, Y. Takeuchi, R. Kubota, Strong convergence theorems by hybrid methods for families of nonexpansive mappings in hilbert spaces, Journal of Mathematical Analysis and Applications 341 (1) (2008) 276–286.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] H. H. Bauschke, P. L. Combettes, A weak-to-strong convergence principle for fejér-monotone methods in hilbert spaces, Mathematics of Operations Research 26 (2) (2001) 248–264.
- 2[2] F. Browder, Convergence theorems for sequences of nonlinear operators in banch spaces, Math. Z. 100 (1967) 201–225.
- 3[3] K. Goebel, W. Kirk, Topics in Metric Fixed Point Theory, Cambridge Studies in Advanced Mathematics, Cambridge University Press ed., 1990.
- 4[4] Y. Haugazeau, Sur les inéquations variationnelles et la minimisation de fonctionnelles convexes, Ph.D. thesis, Université de Paris, Paris (1968).
- 5[5] K. Nakajo, K. Shimoji, W. Takahashi, Strong convergence to common fixed points of families of nonexpansive mappings in banach spaces, J. Nonlinear Convex Anal. 8 (2007) 11–34.
- 6[6] K. Nakajo, W. Takahashi, Strong convergence theorems for nonexpansive mappings and nonexpansive semigroups, J. Math. Anal. Appl. 279 (2003) 372–379.
- 7[7] S. Saejung, Strong convergence theorems for nonexpansive semigroups without bochner integrals, Fixed Points Theory Appl. doi:10.1155/2008/745010 .
- 8[8] M. Solodov, B. Svaiter, Forcing strong convergence of proximal point iterations in a hilbert space, Math. Program. Ser. A (87) (2000) 189–202.
