# Convergence of a proximal point algorithm for maximal monotone operators in Hilbert spaces

## Abstract

In this article, we consider the proximal point algorithm for the problem of approximating zeros of maximal monotone mappings. Strong convergence theorems for zero points of maximal monotone mappings are established in the framework of Hilbert spaces.

2000 AMS Subject Classification: 47H05; 47H09; 47J25.

## 1. Introduction

The theory of maximal monotone operators has emerged as an effective and powerful tool for studying many real world problems arising in various branches of social, physical, engineering, pure and applied sciences in unified and general framework. Recently, much attention has been payed to develop efficient and implementable numerical methods including the projection method and its variant forms, auxiliary problem principle, proximal-point algorithm and descent framework for solving variational inequalities and related optimization problems (see  and the references therein). The proximal point algorithm, can be traced back to Martinet  in the context of convex minimization and Rockafellar  in the general setting of maximal monotone operators, has been extended and generalized in different directions by using novel and innovative techniques and ideas.

In this article, we investigate the problem of approximating a zero of the maximal monotone mapping based on a proximal point algorithm in the framework of Hilbert spaces. Strong convergence of the iterative algorithm is obtained.

## 2. Preliminaries

Throughout this article, we assume that H is a real Hilbert space, whose inner product and norm are denoted by 〈·,·〉 and ǀǀ · ǀǀ, respectively. Let T be a set-valued mapping.

1. (a)

The set D(T) defined by

$D\left(T\right)=\left\{u\in H:T\left(u\right)\ne \varnothing \right\}$

is called the effective domain of T.

1. (b)

The set R(T) defined by

$R\left(T\right)=\bigcup _{u\in H}T\left(u\right)$

is called the range of T.

1. (c)

The set G(T) defined by

$G\left(T\right)=\left\{\left(u,v\right)\in H×H:u\in D\left(T\right),v\in R\left(T\right)\right\}$

is said to be the graph of T.

Recall the following definitions.

1. (c)

T is said to be monotone if

$〈u-v,x-y〉\ge 0,\phantom{\rule{1em}{0ex}}\forall \left(u,x\right),\left(v,y\right)\in G\left(T\right).$
2. (d)

T is said to be maximal monotone if it is not properly contained in any other monotone operator.

For a maximal monotone T : D(T) → 2H, we can defined the resolvent of T by

${J}_{t}={\left(I+tT\right)}^{-1},\phantom{\rule{1em}{0ex}}t>0.$
(2.1)

It is well known that J t : HD(T) is nonexpansive, and F(J t ) = T-1(0), where F(J t ) denotes the set of fixed points of J t . The Yosida approximation T t is defined by

${T}_{t}=\frac{1}{t}\left(I-{J}_{t}\right),\phantom{\rule{1em}{0ex}}t>0.$

It is well known that T t x T J t x, x H and ǁT t x ǁ ≤ ǀTx ǀ, where

$ǀTxǀ=\text{inf}\left\{ǁyǁ:y\in Tx\right\},$

for all x D(T).

Let C be a nonempty, closed and convex subset of H. Next, we always assume that T: C → 2His a maximal monotone mapping with ${T}^{-1}\left(0\right)\ne \varnothing$, where T-1(0) denotes the set of zeros of T.

The class of monotone mappings is one of the most important classes of mappings among nonlinear mappings. Within the past several decades, many authors have been devoting to the studies on the existence and convergence of zero points for maximal monotone mappings. A classical method to solve the following set-valued equation

$0\in Tx,$
(2.2)

is the proximal point algorithm. To be more precise, start with any point x0 H, and update x n +1 iteratively conforming to the following recursion

${x}_{n}\in {x}_{n+1}+{\beta }_{n}T{x}_{n+1},\phantom{\rule{1em}{0ex}}n\ge 0,$
(2.3)

where {β n } [β, ∞), (β > 0) is a sequence of real numbers. However, as pointed in , the ideal form of the method is often impractical since, in many cases, to solve the problem (2.3) exactly is either impossible or the same difficult as the original problem (2.2). Therefore, one of the most interesting and important problems in the theory of maximal monotone operators is to find an efficient iterative algorithm to compute approximately zeroes of T.

In 1976, Rockafellar  gave an inexact variant of the method

${x}_{0}\in H,\phantom{\rule{1em}{0ex}}{x}_{n}+{e}_{n+1}\in {x}_{n+1}+{\lambda }_{n}T{x}_{n+1},\phantom{\rule{1em}{0ex}}n\ge 0,$
(2.4)

where {e n } is regarded as an error sequence. This is an inexact proximal point algorithm. It was shown that, if

$\sum _{n=0}^{\infty }ǁ{e}_{n}ǁ<\infty ,$
(A)

then the sequence {x n } defined by (1.4) converges weakly to a zero of T provided that ${T}^{-1}\left(0\right)\ne \varnothing$. In , Güller obtained an example to show that Rockafellar's proximal point algorithm (1.4) does not converge strongly, in general.

Recently, many authors studied the problems of modifying Rockafellar's proximal point algorithm so that strong convergence is guaranteed. Cho et al.  proved the following result.

Theorem CKZ. Let H be a real Hilbert space, Ω a nonempty closed convex subset of H, and T: Ω → 2Ha maximal monotone operator with${T}^{-1}\left(0\right)\ne \varnothing$. Let PΩbe the metric projection of H onto Ω. Suppose that, for any given x n H, β n > 0 and e n H, there exists${\stackrel{̄}{x}}_{n}\in \mathrm{\Omega }$conforming to the SVME (2.4), where {β n } (0, + ∞) with β n → ∞ as n → ∞ and

$\sum _{n=1}^{\infty }{ǁ{e}_{n}ǁ}^{2}<\infty .$
(B)

Let {α n } be a real sequence in [0, 1] such that

1. (i)

α n → 0 as n → ∞,

2. (ii)

${\sum }_{n=0}^{\infty }{\alpha }_{n}=\infty .$

for any fixed u Ω, define the sequence {x n } iteratively as follows:

${x}_{n+1}={\alpha }_{n}u+\left(1-{\alpha }_{n}\right){P}_{\Omega }\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right),\phantom{\rule{1em}{0ex}}n\ge 0.$

Then {x n } converges strongly to a fixed point z of T, where z = limt→ ∞J t u.

In this article, motivated by Theorem CKZ, we continue to consider the problem of approximating a zero of the maximal monotone mapping T. Strong convergence theorems are established under mild restrictions imposed on the error sequence {e n } comparing with the restriction (B). The results which include Cho et al.  as a special case also improve the corresponding results announced by many others.

In order to prove our main result, we need the following lemmas.

Lemma 2.1. (Bruck [, Lemma 1]). Let H be a Hilbert space and C a nonempty, closed and convex subset H. For all u C, limt→ ∞J t u exists and it is the point of T-1(0) nearest u.

Lemma 2.2 (Eckstein [, Lemma 2]). For any given x n C, λ n > 0, and e n H, there exists${\stackrel{̄}{x}}_{n}\in C$conforming to the following set-valued mapping equation (in short, SVME):

${x}_{n}+{e}_{n}\in {\stackrel{̄}{x}}_{n}+{\lambda }_{n}T{\stackrel{̄}{x}}_{n}.$
(2.5)

Furthermore, for any p T-1(0), we have

$〈{x}_{n}-{\stackrel{̄}{x}}_{n},{x}_{n}-{\stackrel{̄}{x}}_{n}+{e}_{n}〉\le 〈{x}_{n}-p,{x}_{n}-{\stackrel{̄}{x}}_{n}+{e}_{n}〉$

and

${ǁ{\stackrel{̄}{x}}_{n}-{e}_{n}-pǁ}^{2}\le {ǁ{x}_{n}-pǁ}^{2}-{ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ}^{2}+{ǁ{e}_{n}ǁ}^{2}.$

Lemma 2.3 (Liu ). Assume that {α n } is a sequence of nonnegative real numbers such that

${\alpha }_{n+1}\le \left(1-{\gamma }_{n}\right){\alpha }_{n}+{\delta }_{n},$

where n } is a sequence in (0,1) and {δ n } is a sequence such that

1. (i)

${\sum }_{n=1}^{\infty }{\gamma }_{n}=\infty$;

2. (ii)

lim supn→∞ δ n /γ n ≤ 0 or ${\sum }_{n=1}^{\infty }ǀ{\delta }_{n}ǀ<\infty$.

Then limn→∞α n = 0.

## 3. Main results

Theorem 3.1. Let H be a real Hilbert space, C a nonempty, closed and convex subset of H and T: C → 2Ha maximal monotone operator with${T}^{-1}\left(0\right)\ne \varnothing$. Let P C be a metric projection from H onto C. For any x n H and λ n > 0, find${\stackrel{̄}{x}}_{n}\in C$and e n H conforming to the SVME (2.5), where {λ n } (0, ∞) with λ n → ∞ as n → ∞ and

$ǁ{e}_{n}ǁ\le {\eta }_{n}ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ$
(C)

with sup n ≥0η n = η < 1. Let {α n } and {β n } be real sequences in [0, 1] satisfying α n + β n < 1 and the following control conditions:

$\underset{n\to \infty }{\text{lim}}{\alpha }_{n}=\underset{n\to \infty }{\text{lim}}{\beta }_{n}=0\phantom{\rule{2.77695pt}{0ex}}and\phantom{\rule{2.77695pt}{0ex}}\sum _{n=0}^{\infty }{\alpha }_{n}=\infty .$

Let {x n } be a sequence generated by the following manner:

${x}_{0}\in H,\phantom{\rule{1em}{0ex}}{x}_{n+1}={\alpha }_{n}u+{\beta }_{n}{x}_{n}+\left(1-{\alpha }_{n}-{\beta }_{n}\right){P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right).\phantom{\rule{1em}{0ex}}n\ge 0,$
(3.1)

where u C is a fixed element. Then the sequence {x n } generated by (3.1) strongly converges to a zero point z of T, where z = limt→∞J t u, if and only if e n → 0 as n → ∞.

Proof. First, show that the necessity. Assume that x n z as n → ∞, where z T-1(0). It follows from (2.5) that

$\begin{array}{ll}\hfill ǁ{\stackrel{̄}{x}}_{n}-zǁ& \le ǁ{x}_{n}-zǁ+ǁ{e}_{n}ǁ\phantom{\rule{2em}{0ex}}\\ \le ǁ{x}_{n}-zǁ+{\eta }_{n}ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ\phantom{\rule{2em}{0ex}}\\ \le \left(1+{\eta }_{n}\right)ǁ{x}_{n}-zǁ+{\eta }_{n}ǁ{\stackrel{̄}{x}}_{n}-zǁ.\phantom{\rule{2em}{0ex}}\end{array}$

This implies that

$ǁ{\stackrel{̄}{x}}_{n}-zǁ\le \frac{1+{\eta }_{n}}{1-{\eta }_{n}}ǁ{x}_{n}-zǁ.$

It follows that ${\stackrel{̄}{x}}_{n}\to z$ as n → ∞. Note that

$ǁ{e}_{n}ǁ\le {\eta }_{n}ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ\le {\eta }_{n}\left(ǁ{x}_{n}-zǁ+ǁz-{\stackrel{̄}{x}}_{n}ǁ\right).$

This shows that e n → 0 as n → ∞.

Next, we show the sufficiency. The proof is divided into three steps.

Step 1. Show that {x n } is bounded.

From the assumption (C), we see that

$ǁ{e}_{n}ǁ\le ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ.$

For any p T-1 (0), it follows from Lemma 2.2 that

$\begin{array}{ll}\hfill {ǁ{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-pǁ}^{2}& \le {ǁ{\stackrel{̄}{x}}_{n}-{e}_{n}-pǁ}^{2}\phantom{\rule{2em}{0ex}}\\ \le {ǁ{x}_{n}-pǁ}^{2}-{ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ}^{2}+{ǁ{e}_{n}ǁ}^{2}\phantom{\rule{2em}{0ex}}\\ \le {ǁ{x}_{n}-pǁ}^{2}.\phantom{\rule{2em}{0ex}}\end{array}$

That is,

$ǁ{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-pǁ\le ǁ{x}_{n}-pǁ.$
(3.2)

It follows from (3.2) that

$\begin{array}{ll}\hfill ǁ{x}_{n+1}-pǁ& =ǁ{\alpha }_{n}\left(u-p\right)+\left(1-{\alpha }_{n}\right)\left[{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-p\right]ǁ\phantom{\rule{2em}{0ex}}\\ \le {\alpha }_{n}ǁu-pǁ+\left(1-{\alpha }_{n}\right)ǁ{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-pǁ\phantom{\rule{2em}{0ex}}\\ \le {\alpha }_{n}ǁu-pǁ+\left(1-{\alpha }_{n}\right)ǁ{x}_{n}-pǁ.\phantom{\rule{2em}{0ex}}\end{array}$
(3.3)

Putting

$M=\text{max}\left\{ǁ{x}_{0}-pǁ,ǁu-pǁ\right\},$

we show that ǀǀx n ǀǀ ≤ M for all n ≥ 0. It is easy to see that the result holds for n = 0. Assume that the result holds for some n ≥ 0. That is, ǀǀx n - p ǀǀ ≤ M. Next, we prove that ǀǀx n +1 - p ǀǀ ≤ M. Indeed, we see from (3.3) that

$ǁ{x}_{n+1}-pǁ\le M.$

This shows that the sequence {x n } is bounded.

Step 2. Show that lim supn→∞u - z, x n +1 -z〉 ≤ 0, where z = limt→∞J t u.

From Lemma 2.1, we see that limt→∞J t u exists, which is the point of T-1(0) nearest to u. Since T is maximal monotone, T t u TJ t u and T λn x n TJ λn x n , we see

$\begin{array}{l}〈u-{J}_{t}u,{J}_{{\lambda }_{n}}{x}_{n}-{J}_{t}u〉\phantom{\rule{2em}{0ex}}\\ =-t〈{T}_{t}u,{J}_{t}u-{J}_{{\lambda }_{n}}{x}_{n}〉\phantom{\rule{2em}{0ex}}\\ =-t〈{T}_{t}u-{T}_{{\lambda }_{n}}{x}_{n},{J}_{t}u-{J}_{{\lambda }_{n}}{x}_{n}〉-t〈{T}_{{\lambda }_{n}}{x}_{n},{J}_{t}u-{J}_{{\lambda }_{n}}{x}_{n}〉\phantom{\rule{2em}{0ex}}\\ =-\frac{t}{{\lambda }_{n}}〈{x}_{n}-{J}_{{\lambda }_{n}}{x}_{n},{J}_{t}u-{J}_{{\lambda }_{n}}{x}_{n}〉.\phantom{\rule{2em}{0ex}}\end{array}$

Since λ n → ∞ as n → ∞, for any t > 0, we have

(3.4)

On the other hand, by the nonexpansivity of J λn , we obtain

$ǁ{J}_{{\lambda }_{n}}\left({x}_{n}+{e}_{n}\right)-{J}_{{\lambda }_{n}}{x}_{n}ǁ\le ǁ\left({x}_{n}+{e}_{n}\right)-{x}_{n}ǁ=ǁ{e}_{n}ǁ.$

From the assumption e n → 0 as n → ∞ and (3.4), we arrive at

(3.5)

From (2.5), we see that

$ǁ{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-{J}_{{\lambda }_{n}}\left({x}_{n}+{e}_{n}\right)ǁ\le ǁ\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-{J}_{{\lambda }_{n}}\left({x}_{n}+{e}_{n}\right)ǁ\le ǁ{e}_{n}ǁ.$

That is,

$\underset{n\to \infty }{\text{lim}}ǁ{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-{J}_{{\lambda }_{n}}\left({x}_{n}+{e}_{n}\right)ǁ=0.$
(2.6)

Combining (3.5) with (3.6), we arrive at

(3.7)

On the other hand, we see from the algorithm (3.1) that

${x}_{n+1}-{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)={\alpha }_{n}\left[u-{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)\right]+{\beta }_{n}\left[{x}_{n}-{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)\right].$

It follows from the condition limn→∞α n = limn→∞β n = 0 that

${x}_{n+1}-{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)\to 0\phantom{\rule{1em}{0ex}}\text{as}\phantom{\rule{2.77695pt}{0ex}}n\to \infty ,$

which combines with (3.7) yields that

(3.8)

From z = limt→∞J t u and (3.8), we arrive at

(3.9)

Step 3. Show that x n z as n → ∞.

It follows from (3.2) that

$\begin{array}{ll}\hfill {ǁ{x}_{n+1}-zǁ}^{2}& =〈{\alpha }_{n}u+{\beta }_{n}{x}_{n}+\left(1-{\alpha }_{n}-{\beta }_{n}\right){P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-z,{x}_{n+1}-z〉\phantom{\rule{2em}{0ex}}\\ \le {\alpha }_{n}〈u-z,{x}_{n+1}-z〉+{\beta }_{n}〈{x}_{n}-z,{x}_{n+1}-z〉\phantom{\rule{2em}{0ex}}\\ \phantom{\rule{1em}{0ex}}+\left(1-{\alpha }_{n}-{\beta }_{n}\right)〈{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-z,{x}_{n+1}-z〉\phantom{\rule{2em}{0ex}}\\ \le {\alpha }_{n}〈u-z,{x}_{n+1}-z〉+{\beta }_{n}ǁ{x}_{n}-zǁǁ{x}_{n+1}-zǁ\phantom{\rule{2em}{0ex}}\\ \phantom{\rule{1em}{0ex}}+\left(1-{\alpha }_{n}-{\beta }_{n}\right)ǁ{P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right)-zǁǁ{x}_{n+1}-zǁ\phantom{\rule{2em}{0ex}}\\ \le {\alpha }_{n}〈u-z,{x}_{n+1}-z〉+{\beta }_{n}ǁ{x}_{n}-zǁǁ{x}_{n+1}-zǁ\phantom{\rule{2em}{0ex}}\\ \phantom{\rule{1em}{0ex}}+\left(1-{\alpha }_{n}-{\beta }_{n}\right)ǁ{x}_{n}-zǁǁ{x}_{n+1}-zǁ\phantom{\rule{2em}{0ex}}\\ ={\alpha }_{n}〈u-z,{x}_{n+1}-z〉+\left(1-{\alpha }_{n}\right)ǁ{x}_{n}-zǁǁ{x}_{n+1}-zǁ\phantom{\rule{2em}{0ex}}\\ \le {\alpha }_{n}〈u-z,{x}_{n+1}-z〉+\frac{1-{\alpha }_{n}}{2}\left({ǁ{x}_{n}-zǁ}^{2}+{ǁ{x}_{n+1}-zǁ}^{2}\right).\phantom{\rule{2em}{0ex}}\end{array}$

This implies that

${ǁ{x}_{n+1}-zǁ}^{2}\le \left(1-{\alpha }_{n}\right){ǁ{x}_{n}-zǁ}^{2}+{\alpha }_{n}〈u-z,{x}_{n+1}-z〉.$
(3.10)

Applying Lemma 2.3 to (3.10), we obtain that x n z as n → ∞. This completes the proof.

As a corollary of Theorem 3.1, we have the following.

Corollary 3.2. Let H be a real Hilbert space, C a nonempty, closed and convex subset of H and T: C → 2Ha maximal monotone operator with${T}^{-1}\left(0\right)\ne \varnothing$. Let P C be a metric projection from H onto C. For any x n H and λ n > 0, find${\stackrel{̄}{x}}_{n}\in C$and e n H conforming to the SVME (2.5), where {λ n } (0, ∞) with λ n → ∞ as n → ∞ and

$ǁ{e}_{n}ǁ\le {\eta }_{n}ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ$

with sup n ≥0η n = η < 1. Let {α n } be a real sequence in (0,1) satisfying the following control conditions:

$\underset{n\to \infty }{\text{lim}}{\alpha }_{n}=0\phantom{\rule{2.77695pt}{0ex}}and\phantom{\rule{2.77695pt}{0ex}}\sum _{n=0}^{\infty }{\alpha }_{n}=\infty .$

Let {x n } be a sequence generated by the following manner:

${x}_{0}\in H,\phantom{\rule{1em}{0ex}}{x}_{n+1}={\alpha }_{n}u+\left(1-{\alpha }_{n}\right){P}_{C}\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right).\phantom{\rule{1em}{0ex}}n\ge 0,$

where u C is a fixed element. Then the sequence {x n } strongly converges to a zero point z of T, where z = limt→ ∞, J t u, if and only if e n → 0 as n → ∞.

Remark 3.3. Corollary 3.2 improves Theorem CKZ by relaxing the restriction imposed on the sequence {e n }. In , Rockafellar obtained a weak convergence by assuming that ${\sum }_{n=0}^{\infty }ǁ{e}_{n}ǁ<\infty$, see  for more details.

Next, as applications of Theorem 3.1, we consider the problem of finding a minimizer of a convex function.

Let H be a Hilbert space, and f: H → (-∞, +∞] be a proper convex lower semi-continuous function. Then the subdifferential ∂f of f is defined as follows:

$\partial f\left(x\right)=\left\{y\in H:f\left(z\right)\ge f\left(x\right)+〈z-x,y〉,\phantom{\rule{1em}{0ex}}z\in H\right\},\phantom{\rule{1em}{0ex}}\forall x\in H.$

Theorem 3.4. Let H be a real Hilbert space and f: H → (-∞, +∞] a proper convex lower semi-continuous function. Let {λ n } be a sequence in (0, +∞) with λ n → ∞ as n → ∞ and {e n } a sequence in H with e n → ∞ as n → ∞. Assume that

$ǁ{e}_{n}ǁ\le {\eta }_{n}ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ$

with sup n ≥0η n = η < 1. Let${\stackrel{̄}{x}}_{n}$be the solution of SVME (2.5) with T replacing byf. That is,

${x}_{n}+{e}_{n}\in {\stackrel{̄}{x}}_{n}+{\lambda }_{n}\partial f\left({\stackrel{̄}{x}}_{n}\right),\phantom{\rule{1em}{0ex}}\forall n\ge 0.$

Let {α n } and {β n } be real sequences in [0, 1] satisfying α n + β n < 1 and the following control conditions:

$\underset{n\to \infty }{\text{lim}}{\alpha }_{n}=\underset{n\to \infty }{\text{lim}}{\beta }_{n}=0\phantom{\rule{2.77695pt}{0ex}}and\phantom{\rule{2.77695pt}{0ex}}\sum _{n=0}^{\infty }{\alpha }_{n}=\infty .$

Let {x n } be a sequence generated by the following manner:

$\left\{\begin{array}{c}{x}_{0}\in H,\hfill \\ {\stackrel{̄}{x}}_{n}=argmi{n}_{x\in H}\left\{f\left(x\right)+\frac{1}{2{\lambda }_{n}}{ǁx-{x}_{n}-{e}_{n}ǁ}^{2}\right\},\hfill \\ {x}_{n+1}={\alpha }_{n}u+{\beta }_{n}{x}_{n}+\left(1-{\alpha }_{n}-{\beta }_{n}\right)\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right).\phantom{\rule{1em}{0ex}}n\ge 0,\hfill \end{array}\right\$

where u H is a fixed element. If$\partial f\left(0\right)\ne \varnothing$, the sequence {x n } converges strongly to a minimizer of f nearest to u.

Proof. Since f: H → (-∞, +∞] is a proper convex lower semi-continuous function, we have that the subdifferential ∂ f of f is maximal monotone by Theorem 1 of . Notice that

is equivalent to the following

$0\in \partial f\left({\stackrel{̄}{x}}_{n}\right)+\frac{1}{{\lambda }_{n}}\left({\stackrel{̄}{x}}_{n}-{x}_{n}-{e}_{n}\right).$

It follows that

${x}_{n}+{e}_{n}\in {\stackrel{̄}{x}}_{n}+{\lambda }_{n}\partial f\left({\stackrel{̄}{x}}_{n}\right),\phantom{\rule{1em}{0ex}}\forall n\ge 0.$

By Theorem 3.1, we can obtain the desired conclusion immediately.

As a corollary of Theorem 3.4, we have the following.

Corollary 3.5. Let H be a real Hilbert space and f: H → (-∞, +∞] a proper convex lower semi-continuous function. Let {λ n } be a sequence in (0, +∞) with λ n → ∞ as n → ∞ and {e n } a sequence in H with e n → ∞ as n → ∞. Assume that

$ǁ{e}_{n}ǁ\le {\eta }_{n}ǁ{x}_{n}-{\stackrel{̄}{x}}_{n}ǁ$

with sup n ≥0η n = η < 1. Let${\stackrel{̄}{x}}_{n}$be the solution of SVME (2.5) with T replacing byf. That is,

${x}_{n}+{e}_{n}\in {\stackrel{̄}{x}}_{n}+{\lambda }_{n}\partial f\left({\stackrel{̄}{x}}_{n}\right),\phantom{\rule{1em}{0ex}}\forall n\ge 0.$

Let {α n } be a real sequence in [0, 1] ssatisfying the following control conditions:

$\underset{n\to \infty }{\text{lim}}{\alpha }_{n}=0\phantom{\rule{2.77695pt}{0ex}}and\phantom{\rule{2.77695pt}{0ex}}\sum _{n=0}^{\infty }{\alpha }_{n}=\infty .$

Let {x n } be a sequence generated by the following manner:

$\left\{\begin{array}{c}{x}_{0}\in H,\hfill \\ {\stackrel{̄}{x}}_{n}=\text{arg}{\text{min}}_{x\in H}\left\{f\left(x\right)+\frac{1}{2{\lambda }_{n}}{ǁx-{x}_{n}-{e}_{n}ǁ}^{2}\right\},\hfill \\ {x}_{n+1}={\alpha }_{n}u+\left(1-{\alpha }_{n}\right)\left({\stackrel{̄}{x}}_{n}-{e}_{n}\right).\phantom{\rule{1em}{0ex}}n\ge 0,\hfill \end{array}\right\$

where u H is a fixed element. If$\partial f\left(0\right)\ne \varnothing$, the sequence {x n } converges strongly to a minimizer of f nearest to u.

## References

1. Kang SM, Cho SY, Liu Z: Convergence of iterative sequences for generalized equilibrium problems involving inverse-strongly monotone mappings. J Inequal Appl 2010, 2010: 827082.

2. Kim JK, Cho SY, Qin X: Hybrid projection algorithms for generalized equilibrium problems and strictly pseudocontractive mappings. J Inequal Appl 2010, 2010: 18. (Article ID 312602)

3. Lin LJ, Huang YJ: Generalized vector quasi-equilibrium problems with applications to common fixed point theorems and optimization problems. Nonlinear Anal TMA 2007, 66: 1275–1289. 10.1016/j.na.2006.01.025

4. Husain S, Gupta S: A resolvent operator technique for solving generalized system of nonlinear relaxed cocoercive mixed variational inequalities. Adv Fixed Point Theory 2012, 2: 18–28.

5. Qin X, Cho YJ, Kang SM: Convergence theorems of common elements for equilibrium problems and fixed point problems in Banach spaces. J Comput Appl Math 2009, 225: 20–30. 10.1016/j.cam.2008.06.011

6. Kim JK: Strong convergence theorems by hybrid projection methods for equilibrium problems and fixed point problems of the asymptotically quasi- ϕ -nonexpansive mappings. Fixed Point Theory Appl 2011., 2011:

7. Cho SY, Kang SM: Approximation of common solutions of variational inequalities via strict pseudocontraction. Acta Mathematica Scientia 2012, 32: 1607–1618.

8. Chang SS, Lee HWJ, Chan CK: A new method for solving equilibrium problem fixed point problem and variational inequality problem with application to optimization. Nonlinear Anal 2009, 70: 3307–3319. 10.1016/j.na.2008.04.035

9. Mahato NK, Nahak C: Equilibrium problem under various types of convexities in Banach space. J Math Comput Sci 2011, 1: 77–88.

10. Qin X, Cho SY, Kang SM: Strong convergence of shrinking projection methods for quasi- ϕ -nonexpansive mappings and equilibrium problems. J Comput Appl Math 2010, 234: 750–760. 10.1016/j.cam.2010.01.015

11. Qin X, Cho SY, Kang SM: Convergence of an iterative algorithm for systems of variational inequalities and nonexpansive mappings. J Comput Appl Math 2009, 233: 231–240. 10.1016/j.cam.2009.07.018

12. Mathato NK, Nahak C: Equilibrium problem under various types of convexities in Banach space. J Math Comput Sci 2011, 1: 77–88.

13. Cho YJ, Kang SM, Zhou H: Approximate proximal point algorithms for finding zeroes of maximal monotone operators in Hilbert spaces. J Inequal Appl 2008, 2008: 10. (Article ID 598191)

14. Qin X, Kang SM, Cho YJ: Approximation zeros of monotone operators by proximal point algorithms. J Global Optim 2010, 46: 75–87. 10.1007/s10898-009-9410-6

15. Eckstein J: Approximate iterations in Bregman-function-based proximal algorithms. Math Program 1998, 83: 113–123.

16. Güller O: On the convergence of the proximal point algorithmfor convex minimization. SIAM J Control Optim 1991, 29: 403–419. 10.1137/0329022

17. Tossings P: The perturbed proximal point algorithm and some of its applications. Appl Math Optim 1994, 29: 125–159. 10.1007/BF01204180

18. Tikhonov AN: Solution of incorrectly formulated problems and a regularization method. Soviet Math Doklady 1963, 4: 1035–1038.

19. Qin X, Su Y: Approximation of a zero point of accretive operator in Banach spaces. J Math Anal Appl 2007, 329: 415–424. 10.1016/j.jmaa.2006.06.067

20. Minty GJ: On the maximal domain of a monotone function. Michigan Math J 1961, 8: 135–137.

21. Sahu DR, Yao JC: The prox-Tikhonov regularization method for the proximal point algorithm in Banach spaces. J Optim Theory Appl 2011, 151: 641–655.

22. Verma RU: Rockafellar's celebrated theorem based on A-maximal monotonicity design. Appl Math Lett 2008, 21: 355–360. 10.1016/j.aml.2007.05.004

23. Agarwa RP, Verma RU: Inexact a-proximal point algorithm and applications to nonlinear varia-tional inclusion problems. J Optim Theory Appl 2010, 144: 431–444. 10.1007/s10957-009-9615-3

24. Qin X, Su Y: Strong convergence theorems for relatively nonexpansive mappings in a Banach space. Nonlinear Anal 2007, 67: 1958–1965. 10.1016/j.na.2006.08.021

25. Burachik BS, Scheimberg S, Svaiter BF: Robustness of the hybrid extragradient proximal-point algorithm. J Optim Theory Appl 2001, 111: 117–136. 10.1023/A:1017523331361

26. Noor MA: Splitting algorithms for general pseudomonotone mixed variational inequalities. J Global Optim 2000, 18: 75–89. 10.1023/A:1008322118873

27. Anh PN, Muu LD, Nguyen VH, Srodiot JJ: Using the Banach contraction principe to implement the proximal point method for multivalued monotone variational inequalities. J Optim Theory Appl 2005, 124: 285–306. 10.1007/s10957-004-0926-0

28. Cho SY, Kang SM: Approximation of fixed points of pseudocontraction semigroups based on a viscosity iterative process. Appl Math Lett 2011, 24: 224–228. 10.1016/j.aml.2010.09.008

29. Shehu Y: A new iterative scheme for a countable family of relatively nonexpansive mappings and an equilibrium problem in Banach spaces. J Global Optim 2011.

30. Kamimura S, Kohsaka F, Takahashi W: Weak and strong convergence theorems for maximal monotone operators in a Banach space. Set-valed Anal 2004, 12: 417–429. 10.1007/s11228-004-8196-4

31. Moudafi A: On the regularization of the sum of two maximal monotone operators. Nonlinear Anal 2000, 42: 1203–1208. 10.1016/S0362-546X(99)00136-4

32. Qin X, Cho YJ, Kang SM: Viscosity approximation methods for generalized equilibrium problems and fixed point problems with applications. Nonlinear Anal 2010, 72: 99–112. 10.1016/j.na.2009.06.042

33. Martinet B: Algorithmes pour la Resolution des Problemes d'Optimisation et de Minmax. These d'etat Universite de Grenoble, France; 1972.

34. Rockafellar RT: Monotone operators and the proximal point algorithm. SIAM J Control Optim 1976, 14: 877–898. 10.1137/0314056

35. Bruck RE: A strongly convergent iterative method for the solution of 0 Ux for a maximal monotone operator U in Hilbert space. J Math Appl Anal 1974, 48: 114–126. 10.1016/0022-247X(74)90219-4

36. Liu L: Ishikawa-type and Mann-type iterative processes with errors for constructing solutions of nonlinear equations involving m -accretive operators in Banach spaces. Nonlinear Anal 1998, 34: 307–317. 10.1016/S0362-546X(97)00579-8

## Acknowledgements

The authors are grateful to the referees for their valuable comments and suggestions which improve the contents of the article.

## Author information

Authors

### Corresponding author

Correspondence to Guohong Shi.

### Competing interests

The authors declare that they have no competing interests.

### Authors' contributions

All authors contributed equally to this paper. All authors read and approved the final manuscript.

## Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

Wei, Z., Shi, G. Convergence of a proximal point algorithm for maximal monotone operators in Hilbert spaces. J Inequal Appl 2012, 137 (2012). https://doi.org/10.1186/1029-242X-2012-137

• Accepted:

• Published:

• DOI: https://doi.org/10.1186/1029-242X-2012-137

### Keywords

• fixed point
• nonexpansive mapping
• maximal monotone mapping
• zero 