- Open Access
Ergodicity of the implicit midpoint rule for nonexpansive mappings
Journal of Inequalities and Applications volume 2015, Article number: 4 (2015)
We prove a mean ergodic theorem for the implicit midpoint rule for nonexpansivemappings in a Hilbert space. We obtain weak convergence for the general case andstrong convergence for certain special cases.
MSC: 47J25, 47N20, 34G20, 65J15.
The first mean ergodic theorem for nonlinear noncompact operators was proved byBaillon . Let C be a closed convex subset of a Hilbert space Hand let be a nonexpansive mapping (i.e., for all ) with fixed points. Then, for each, the Cesàro means
converge weakly to a fixed point of T. This mean ergodic theorem wasextended by Bruck  to the setting of Banach spaces that are uniformly convex and have aFréchet differentiable norm. Baillon and Clement  also investigated ergodicity of the nonlinear Volterra integral equationsin Hilbert spaces.
It is quite natural to consider ergodic convergence of iterative algorithms in thecase where the sequences generated by the algorithms either are not guaranteed toconverge or not convergent at all. For instance, the double-backward method ofPassty  generates a sequence in the recursive manner:
where A and B are maximal monotone operators in a Hilbert spacesuch that is also maximal monotone and the inclusion is solvable, and and are the resolvents of A and B,respectively, that is, and . It is well known  that the sequence generated by the double-backward method (1.1) failsto converge weakly, in general. However, Passty  showed that if the sequence of parameters, , is in , then the averages
converge weakly to a solution to the inclusion .
The implicit midpoint rule (IMR) for nonexpansive mappings in a Hilbert spaceH, inspired by the IMR for ordinary differential equations [6–12], was introduced in . This rule generates a sequence via the semi-implicit procedure:
where the initial guess is arbitrarily chosen, for all n, and is a nonexpansive mapping with fixed points.
The IMR (1.3) is proved to converge weakly  in the Hilbert space setting provided the sequence satisfies the two conditions:
(C1) for all and some , and
However, this algorithm may fail to converge weakly without the assumption (C2). Wetherefore turn our attention to the ergodic convergence of the algorithm. We willshow that for any sequence in the interval , the mean averages as defined by (1.2) will always converge weakly to afixed point of T as long as is an approximate fixed point of T(i.e., ). We will also show that under certain additionalconditions the means can converge in norm to a fixed point of T.This paper is organized as follows. In the next section we introduce the concept ofnearest point projections and properties of nonexpansive mappings. The main resultsof this paper (i.e., weak and strong ergodicity of the IMR (1.3)) arepresented in Section 3.
Let C be a nonempty closed convex subset of a Hilbert space H.Recall that the nearest point projection from H to C,, is defined by
We need the following characterization of projections.
Lemma 2.1LetCbe a nonempty closed convex subset of a Hilbert spaceH. Givenand, thenif and only if any one of the following properties is satisfied:
Recall that a mapping is said to be nonexpansive if
A point such that is said to be a fixed point of T. The set ofall fixed points of T is denoted by , namely,
In the rest of this paper we always assume .
We need the demiclosedness principle of nonexpansive mappings as described below.
LetCbe a closed convex subset of a Hilbert spaceHand letbe a nonexpansive mapping. Then the mappingis demiclosed in the sense that, for any sequenceofC, the following implication holds:
Next we need the following lemma (not hard to prove).
For each integer, such that, points, and any nonexpansive mapping, we have
Recall also that the implicit midpoint rule (IMR)  generates a sequence by the recursion process
where for all n, and is a nonexpansive mapping.
The following properties of the IMR (2.3) are proved in .
Lemma 2.4Letbe any sequence inand letbe the sequence generated by the IMR (2.3). Then
for alland. In particular, is bounded, and moreover, we have(2.4)
The convergence of the IMR (2.3) is proved in .
Theorem 2.5LetCbe a nonempty closed convex subset of a Hilbert spaceHandbe a nonexpansive mapping with. Assumeis generated by the IMR (2.3) where the sequenceof parameters satisfies the conditions (C1) and (C2) in theIntroduction. Thenconverges weakly to a fixed point ofT.
In this section we discuss the ergodic convergence of the sequence generated by the IMR (2.3), that is, the convergenceof the means
where is a sequence of positive numbers such that
Set and let be the nearest point projection from H toF.
Lemma 3.1The sequenceis convergent in norm.
Proof First observe that
As a matter of fact, we get for , by Lemma 2.1(i) and Lemma 2.4(i),
That is, is decreasing and (3.3) is proven.
Applying the inequality (Lemma 2.1(iii))
to the case where and (with ) together with Lemma 2.4(i), we get
The strong convergence of follows immediately from the fact(3.3). □
Remark 3.2 The limit of , which we denote by , can also be identified as the asymptotic center ofthe sequence with respect to the fixed point set F ofT. In other words,
As a matter of fact, by (3.4) we get, for any ,
Upon taking limsup we immediately obtain
Hence, (3.5) holds.
Theorem 3.3LetCbe a closed convex subset of a Hilbert spaceHand letbe a nonexpansive mapping such that. Assumeis any sequence of positive numbers in the unit intervaland letbe the sequence generated by the IMR (2.3). Define the meansby (3.1), where the weightsare all positive and satisfy the condition (3.2). Assume, inaddition, . Thenconverges weakly to a pointz, where (in norm).
Proof Let which is well defined by Lemma 3.1. ByLemma 2.1(ii), we have, for each k,
It turns out that, for ,
(Here M is a constant such that for all k.)
By multiplying by and then summing up from to n, we conclude
We now claim that
Consequently, by Lemma 2.2, each weak cluster point of falls in F.
To see (3.7), we will prove that
for all n big enough, where as . For the sake of simplicity, we may, due to theassumption , assume that
for all n.
Let for and let M be a constant such that. For each n, we put for and apply (2.2) to get
Combining (3.9) and (3.10), we derive that
It turns out that (3.8) with .
Now since in norm, we see that the means in norm, as well. Consequently, if is a subsequence weakly converging to some point, it follows from (3.6) that
This together with the fact that implies that . That is, z is the only weak cluster pointof the sequence and therefore, we must have weakly. □
Remark 3.4 In Theorem 3.3 we assumed that . This assumption is guaranteed if the sequence satisfies the condition (C2) in the Introduction,that is, . Indeed, by (C2) and Lemma 2.4(ii), we find
Since the definition of IMR (2.3) yields
we also have
Combining (3.13) and (3.14), we infer that
Remark 3.5 If we assume (3.9) holds for all , then we need some more delicate technicalitiesdealing with (3.10). We may proceed as follows. Decompose (for ) as
As , we may assume . Repeating the argument for (3.10) and (3.11), we get
Let . We finally obtain, for ,
Next we show that in some circumstances, the sequence can converge strongly.
Theorem 3.6Let the assumptions of Theorem 3.3 holds. Then thesequenceconverges in norm to the pointif, in addition, any one of the following conditions issatisfied:
The fixed point setFofThas nonempty interior.
Tis a contraction, that is,
whereis a constant. In this case, the sequencegenerated by the IMR (2.3) converges in norm to the unique fixed pointofT.
Tis compact, namely, Tmaps bounded sets to relatively norm-compact sets.
Proof (i) By assumption, we have and such that
for all such that .
Therefore, upon substituting for u in (3.6) we obtain
for all such that .
Taking the supremum in (3.15) over such that immediately yields
This verifies that in norm.
Since T is a contraction, T has a unique fixed point which is denoted by p. By (2.3) we deduce that (noticing )
It turns out that
Since , we must have . However, since the sequence is decreasing, we must have . Namely, in norm, and so in norm.
Since T is compact and since is weakly convergent, is relatively norm-compact. This together with (3.7) evidently implies that is relatively norm-compact. Therefore, must converge in norm to . □
Baillon J-B: Un théorème de type ergodique pour les contractions nonlinéaires dans un espace de Hilbert.C. R. Acad. Sci. Paris Sér. A-B 1975,280(22):A1511-A1514. (in French)
Bruck RE: A simple proof of the mean ergodic theorem for nonlinear contractions inBanach spaces.Isr. J. Math. 1979,32(2–3):107–116. 10.1007/BF02764907
Baillon J-B, Clement P: Ergodic theorems for nonlinear Volterra equations in Hilbert space.Nonlinear Anal. 1981,5(7):789–801. 10.1016/0362-546X(81)90053-5
Passty GB: Ergodic convergence to a zero of the sum of monotone operators in Hilbertspaces.J. Math. Anal. Appl. 1979, 72:383–390. 10.1016/0022-247X(79)90234-8
Lions PL, Mercier B: Splitting algorithms for the sum of two nonlinear operators.SIAM J. Numer. Anal. 1979, 16:964–979. 10.1137/0716071
Auzinger W, Frank R: Asymptotic error expansions for stiff equations: an analysis for the implicitmidpoint and trapezoidal rules in the strongly stiff case.Numer. Math. 1989, 56:469–499. 10.1007/BF01396649
Bader G, Deuflhard P: A semi-implicit mid-point rule for stiff systems of ordinary differentialequations.Numer. Math. 1983, 41:373–398. 10.1007/BF01418331
Deuflhard P: Recent progress in extrapolation methods for ordinary differentialequations.SIAM Rev. 1985,27(4):505–535. 10.1137/1027140
Edith, E: Numerical and approximative methods in some mathematical models.Ph.D. thesis, Babes-Bolyai University of Cluj-Napoca (2006)
Schneider C: Analysis of the linearly implicit mid-point rule for differential-algebraequations.Electron. Trans. Numer. Anal. 1993, 1:1–10.
Somalia S: Implicit midpoint rule to the nonlinear degenerate boundary valueproblems.Int. J. Comput. Math. 2002,79(3):327–332. 10.1080/00207160211930
Somalia S, Davulcua S: Implicit midpoint rule and extrapolation to singularly perturbed boundaryvalue problems.Int. J. Comput. Math. 2000,75(1):117–127. 10.1080/00207160008804969
Alghamdi MA, Alghamdi MA, Shahzad N, Xu HK: The implicit midpoint rule for nonexpansive mappings.Fixed Point Theory Appl. 2014., 2014: Article ID 96
Goebel K, Kirk WA Cambridge Studies in Advanced Mathematics 28. In Topics in Metric Fixed Point Theory. Cambridge University Press, Cambridge; 1990.
Zarantonello EH: Projections on convex sets in Hilbert space and spectral theory. In Contributions to Nonlinear Functional Analysis. Edited by: Zarantonello EH. Academic Press, New York; 1971:237–424.
The authors are grateful to the anonymous referees for their helpful comments andsuggestions, which improved the presentation of this manuscript. This projectwas funded by the Deanship of Scientific Research (DSR), King AbdulazizUniversity, under grant No. (49-130-35-HiCi). The authors, therefore,acknowledge technical and financial support of KAU.
The authors declare that they have no competing interests.
All authors contributed equally to the writing of this paper. All authors read andapproved the final manuscript.
About this article
Cite this article
Xu, H., Alghamdi, M.A. & Shahzad, N. Ergodicity of the implicit midpoint rule for nonexpansive mappings. J Inequal Appl 2015, 4 (2015) doi:10.1186/1029-242X-2015-4
- implicit midpoint rule
- nonexpansive mapping
- Hilbert space