- Research
- Open Access
- Published:

# An algorithm for solving a multi-valued variational inequality

*Journal of Inequalities and Applications*
**volume 2013**, Article number: 218 (2013)

## Abstract

We propose a new extragradient method for solving a multi-valued variational inequality. It is showed that the method converges globally to a solution of the multi-valued variational inequality, provided the multi-valued mapping is continuous with nonempty compact convex values. Preliminary computational experience is also reported.

**MSC:** 47H04, 47H10, 47J20, 47J25.

## 1 Introduction

We consider the following multi-valued variational inequality, denoted by MVI(F,C): to find {x}^{\ast}\in C and \xi \in F({x}^{\ast}) such that

where *C* is a nonempty closed convex set in {\mathbb{R}}^{n}, *F* is a multi-valued mapping from *C* into {\mathbb{R}}^{n} with nonempty values, and \u3008\cdot ,\cdot \u3009 and \parallel \cdot \parallel denote the inner product and the norm in {\mathbb{R}}^{n}, respectively.

Extragradient-type algorithms have been extensively studied in the literature; see [1–3]. Various algorithms for solving the multi-valued variational inequality have been extensively studied in the literature [4–15]. The well-known proximal point algorithm [12] requires the multi-valued mapping *F* to be monotone. [11] proposes a projection algorithm for solving the multi-valued variational inequality with a pseudomonotone mapping. In [11], choosing {u}_{i}\in F({x}_{i}) needs solving a single-valued variational inequality; see the expression (2.1) in [11]. [6] presents a double projection algorithm, which is an improvement of [11], so that {u}_{i}\in F({x}_{i}) can be taken arbitrarily. In [6], however, choosing the hyperplane needs computing the supremum and hence is computationally expensive. To overcome this difficulty, [7] introduces an extragradient algorithm for solving the multi-valued variational inequality in which computing the supremum is avoided. In this paper, we present a new extragradient method for solving the multi-valued variational inequality. In our method, {u}_{i}\in F({x}_{i}) can be taken arbitrarily. Moreover, the main difference of our method from those of [6, 7, 11] is the procedure of Armijo-type linesearch. We also present numerical tests to compare our Algorithm 2.2 with those in [6, 11].

This paper is organized as follows. In Section 2, we present the algorithm details. We prove the preliminary results for convergence analysis in Section 3. Numerical results are reported in the last section.

## 2 Algorithms

Let us recall the definition of a continuous multi-valued mapping. *F* is said to be upper semicontinuous at x\in C if for every open set *V* containing F(x), there is an open set *U* containing *x* such that F(y)\subset V for all y\in C\cap U. F is said to be lower semicontinuous at x\in C if given any sequence {x}_{k} converging to *x* and any y\in F(x), there exists a sequence {y}_{k}\in F({x}_{k}) that converges to *y*. *F* is said to be continuous at x\in C if it is both upper semicontinuous and lower semicontinuous at *x*. If *F* is single-valued, then both upper semicontinuity and lower semicontinuity reduce to the continuity of *F*.

*F* is called pseudomonotone on *C* in the sense of Karamardian [16] if for any x,y\in C,

Let *S* be the solution set of (1.1), that is, those points {x}^{\ast}\in C satisfying (1.1). Throughout this paper, we assume that the solution set *S* of problem (1.1) is nonempty and *F* is continuous on *C* with nonempty compact convex values satisfying the following property:

The property (2.2) holds if *F* is pseudomonotone on *C*.

Let {P}_{C} denote the projector onto *C*, and let \mu >0 be a parameter.

**Proposition 2.1** x\in C *and* \xi \in F(x) *solve problem* (1.1) *if and only if*

**Algorithm 2.2** Choose {x}_{0}\in C and two parameters \gamma ,\sigma \in (0,1). Set i=0.

Step 1. Choose {u}_{i}\in F({x}_{i}) and let {k}_{i} be the smallest nonnegative integer satisfying

Set {\eta}_{i}={\gamma}^{{k}_{i}}. If {r}_{{\eta}_{i}}({x}_{i},{u}_{i})=0, stop.

Step 2. Compute {x}_{i+1}:={P}_{C}({x}_{i}-{\alpha}_{i}{d}_{i}), where

Let i:=i+1 and go to Step 1.

**Remark 2.3** Let us compare the above algorithm with those in [6, 7, 11]. First, Aimijo-type linesearch procedures in the four algorithms are different. [6, 7, 11] use different procedures which replace (2.4) by the following ones:

where *μ* is required to be strictly less than 1 or 1/\sigma, and {v}_{i}\in F({x}_{i}-{\gamma}^{{k}_{i}}{r}_{\mu}({x}_{i},{u}_{i})). In our algorithm, *μ* can change according to the value of {\eta}_{i} in each iteration and {v}_{i}\in F({P}_{C}({x}_{i}-{\gamma}^{{k}_{i}}{u}_{i})). Secondly, the way to generate the next iterate is different. In [6, 11], the next iterate is a projection of the current iterate onto the intersection of the feasible set *C* and a hyperplane, while in our algorithm as well as in [7] the next iterate is a projection onto the feasible set *C*. In addition, the searching directions in [7] and our algorithm are also different.

**Lemma 2.4** *Let* *C* *be a closed convex subset of* {\mathbb{R}}^{n}. *For any* x,y\in {\mathbb{R}}^{n} *and* z\in C, *the following statements hold*.

(i) \u3008x-{P}_{C}(x),z-{P}_{C}(x)\u3009\le 0.

(ii) {\parallel {P}_{C}(x)-{P}_{C}(y)\parallel}^{2}\le {\parallel x-y\parallel}^{2}-{\parallel {P}_{C}(x)-x+y-{P}_{C}(y)\parallel}^{2}.

*Proof* See [17]. □

The proof of the following lemma is easy and we omit it (see Lemma 3.1 in [18] for example).

**Lemma 2.5** *For any* x\in {\mathbb{R}}^{n}, \xi \in F(x) *and* \mu >0,

We first show that Algorithm 2.2 is well defined.

**Proposition 2.6** *If* {x}_{i} *is not a solution of problem* (1.1), *then there exists a nonnegative integer* {k}_{i} *satisfying* (2.3) *and* (2.4).

*Proof* Suppose that for all *k* and all v\in F({P}_{C}({x}_{i}-{\gamma}^{k}{u}_{i})), we have

and hence,

Therefore,

where the second inequality follows from Lemma 2.5 and the equality follows from \gamma \in (0,1) and k\ge 0. Since {P}_{C}(\cdot ) is continuous and {x}_{i}\in C, {P}_{C}({x}_{i}-{\gamma}^{k}{u}_{i})\to {x}_{i}(k\to \mathrm{\infty}). Since *F* is lower semicontinuous, {u}_{i}\in F({x}_{i}) and {P}_{C}({x}_{i}-{\gamma}^{k}{u}_{i})\to {x}_{i}(k\to \mathrm{\infty}), there is {v}_{k}\in F({P}_{C}({x}_{i}-{\gamma}^{k}{u}_{i})) such that {v}_{k}\to {u}_{i}(k\to \mathrm{\infty}). Therefore,

Let k\to \mathrm{\infty} in (2.8), we have

This contradiction completes the proof. □

## 3 Main results

Now we obtain the following auxiliary result that will be used for proving the convergence of Algorithm 2.2.

**Theorem 3.1** *If the assumption* (2.2) *holds and* {x}_{i}\notin S, *then for any* {x}^{\ast}\in S,

*Proof* Let {x}^{\ast}\in S. Since {u}_{i}\in F({x}_{i}) and {\eta}_{i}>0, it follows from (2.2) that

Similarly, we have

because {v}_{i}\in F({P}_{C}({x}_{i}-{\eta}_{i}{u}_{i})). Since {x}^{\ast}\in C, from Lemma 2.4(i) we have

It follows from (3.2), (3.3) and (3.4) that

Therefore,

where the second inequality follows from (2.4). This completes the proof. □

**Theorem 3.2** *If* F:C\to {2}^{{\mathbb{R}}^{n}} *is continuous with nonempty compact convex values on* *C* *and the assumption* (2.2) *holds*, *then the sequence* \{{x}_{i}\} *generated by Algorithm * 2.2 *converges to a solution* \overline{x} *of* (1.1).

*Proof* Let {x}^{\ast}\in S. It follows from Lemma 2.4(ii), Lemma 2.5, (2.5), (2.6) and (3.6) that

It follows that the sequence \{{\parallel {x}_{i+1}-{x}^{\ast}\parallel}^{2}\} is nonincreasing, and hence is a convergent sequence. Therefore, \{{x}_{i}\} is bounded. Since *F* is continuous with compact values, Proposition 3.11 in [19] implies that \{F({x}_{i}):i\in N\} is a bounded set, and so are \{{u}_{i}\}, \{{r}_{{\eta}_{i}}({x}_{i},{u}_{i})\} and \{{v}_{i}\}. Thus, \{{r}_{{\eta}_{i}}({x}_{i},{u}_{i})+{\eta}_{i}{v}_{i}\} is bounded. Then there exists a positive number *M* such that

It follows from (3.7) that

Therefore,

By the boundedness of \{{x}_{i}\}, there exists a convergent subsequence \{{x}_{{i}_{j}}\} converging to \overline{x}.

If \overline{x} is a solution of problem (1.1), we show next that the whole sequence \{{x}_{i}\} converges to \overline{x}. Replacing {x}^{\ast} by \overline{x} in the preceding argument, we obtain that the sequence \{\parallel {x}_{i}-\overline{x}\parallel \} is nonincreasing and hence converges. Since \overline{x} is an accumulation point of \{{x}_{i}\}, some subsequence of \{\parallel {x}_{i}-\overline{x}\parallel \} converges to zero. This shows that the whole sequence \{\parallel {x}_{i}-\overline{x}\parallel \} converges to zero, hence {lim}_{i\to \mathrm{\infty}}{x}_{i}=\overline{x}.

Suppose now that \overline{x} is not a solution of problem (1.1). We show first that {k}_{i} in Algorithm 2.2 cannot tend to ∞. Since *F* is continuous with compact values, Proposition 3.11 in [19] implies that \{F({x}_{i}):i\in N\} is a bounded set, and so the sequence \{{u}_{i}\} is bounded. Therefore, there exists a subsequence \{{u}_{{i}_{j}}\} converging to \overline{u}. Since *F* is upper semicontinuous with compact values, Proposition 3.7 in [19] implies that *F* is closed, and so \overline{u}\in F(\overline{x}). By the definition of {k}_{i}, we have

and hence

Therefore,

where the second inequality follows from Lemma 2.5 and the equality follows from \gamma \in (0,1).

If {k}_{{i}_{j}}\to \mathrm{\infty}, then {P}_{C}({x}_{{i}_{j}}-{\gamma}^{{k}_{{i}_{j}}-1}{u}_{{i}_{j}})\to \overline{x}. The lower continuity of *F*, in turn, implies the existence of {\overline{u}}_{{i}_{j}}\in F({P}_{C}({x}_{{i}_{j}}-{\gamma}^{{k}_{{i}_{j}}-1}{u}_{{i}_{j}})) such that {\overline{u}}_{{i}_{j}} converges to \overline{u}. Therefore,

Letting j\to \mathrm{\infty}, we obtain the contradiction

being {r}_{1}(\cdot ,\cdot ) continuous. Therefore, \{{k}_{i}\} is bounded and so is \{{\eta}_{i}\}.

By the boundedness of \{{\eta}_{i}\}, it follows from (3.9) that {lim}_{i\to \mathrm{\infty}}\parallel {r}_{1}({x}_{i},{u}_{i})\parallel =0. Since {r}_{1}(\cdot ,\cdot ) is continuous and the sequences \{{x}_{i}\} and \{{u}_{i}\} are bounded, there exists an accumulation point (\overline{x},\overline{u}) of \{({x}_{i},{u}_{i})\} such that {r}_{1}(\overline{x},\overline{u})=0. This implies that \overline{x} solves the variational inequality (1.1). Similar to the preceding proof, we obtain that {lim}_{i\to \mathrm{\infty}}{x}_{i}=\overline{x}.

Now we provide a result on the convergence rate of the iterative sequence generated by Algorithm 2.2. To establish this result, we need a certain error bound to hold locally (see (3.15) below). The research on an error bound is a large topic in mathematical programming. One can refer to the survey [20] for the roles played by error bounds in the convergence analysis of iterative algorithms; more recent developments on this topic are included in Chapter 6 in [21]. A condition similar to (3.15) has also been used in [22] (see expression (10) therein) to analyze the convergence rate in a very general framework.

For any \delta >0, define

We say that *F* is Lipschitz continuous on *C* if there exists a constant L>0 such that, for all x,y\in C, H(F(x),F(y))\le L\parallel x-y\parallel, where *H* denotes the Hausdorff metric. □

**Theorem 3.3** *In addition to the assumptions in Theorem * 3.2, *if* *F* *is Lipschitz continuous with modulus* L>0 *and if there exist positive constants* *c* *and* *δ* *such that*

*then there is a constant* \alpha >0 *such that for sufficiently large* *i*,

*Proof* Put \eta :=min\{1/2,{L}^{-1}\gamma \sigma \}. We first prove that {\eta}_{i}>\eta for all *i*. By the construction of {\eta}_{i}, we have {\eta}_{i}\in (0,1]. If {\eta}_{i}=1, then clearly {\eta}_{i}>\frac{1}{2}\ge \eta. Now we assume that {\eta}_{i}<1. Since {\eta}_{i}={\gamma}^{{k}_{i}}, it follows that the nonnegative integer {k}_{i}\ge 1. Thus the construction of {k}_{i} implies that

and hence, as {k}_{i}\ge 1,

Since {u}_{i}\in F({x}_{i}) and *F* is compact-valued, the definition of the Hausdorff metric implies the existence of {v}_{i}\in F({P}_{C}({x}_{i}-{\gamma}^{{k}_{i}-1}{u}_{i})) such that

Therefore {\eta}_{i}>{L}^{-1}\gamma \sigma \ge \eta.

Let {x}^{\ast}\in {P}_{S}({x}_{i}). By (3.8) and (3.15), we obtain that for sufficiently large *i*,

where the second inequality follows from {\eta}_{i}>\eta.

Write *α* for {(1-\sigma )}^{2}{M}^{-2}{\eta}^{4}{c}^{-4}. Applying Lemma 6 in Chapter 2 of [23], we have

This completes the proof. □

## 4 Numerical experiments

In this section, we present some numerical experiments for the proposed algorithm. The MATLAB codes are run on a PC (with CPU Intel P-T2390) under MATLAB Version 7.0.1.24704(R14) Service Pack 1. We compare the performance of our Algorithm 2.2, [6], Algorithm 1] and [11], Algorithm 1]. In Tables 1 and 2, ‘It.’ denotes the number of iteration and ‘CPU’ denotes the CPU time in seconds. The tolerance *ε* means when \parallel {r}_{\mu}(x,\xi )\parallel \le \epsilon, the procedure stops.

**Example 4.1** *Let* n=3,

*and*
F:C\to {2}^{{\mathbb{R}}^{n}}
*be defined by*

*Then the set* *C* *and the mapping* *F* *satisfy the assumptions of Theorem * 3.2 *and* (0,0,1) *is a solution of the multi*-*valued variational inequality*. *Example * 4.1 *is tested in* [6, 11]. *We choose* \sigma =0.5, \gamma =0.9 *for our algorithm*; \sigma =0.1, \gamma =0.8, \mu =1 *for Algorithm * 1 *in* [6]; \sigma =0.9, \gamma =0.4, \mu =1 *for Algorithm * 1 *in* [11]. *We use* {x}_{0}=(0,0.5,0.5) *as the initial point* (*Table *1 *and Table *2).

## References

Iusem AN, Svaiter BF:

**A variant of Korpelevich’ method for variational inequalities with a new search strategy.***Optimization*1997, 42: 309–321. doi:10.1080/02331939708844365Korpelevich GM:

**The extragradient method for finding saddle points and other problems.***Èkon. Mat. Metody*1976, 12: 747–756.Wang YJ, Xiu NH, Zhang JZ:

**Modified extragradient method for variational inequalities and verification of solution existence.***J. Optim. Theory Appl.*2003, 119(1):167–183. doi:10.1023/B:JOTA.0000005047.30026.b8Auslender A, Teboulle M:

**Lagrangian duality and related multiplier methods for variational inequality problems.***SIAM J. Optim.*2000, 10(4):1097–1115. doi:10.1137/S1052623499352656Bao TQ, Khanh PQ:

**A projection-type algorithm for pseudomonotone nonlipschitzian multivalued variational inequalities.**In*Generalized Convexity, Generalized Monotonicity and Applications*. Springer, New York; 2005:113–129.Fang CJ, He YR:

**A double projection algorithm for multi-valued variational inequalities and a unified framework of the method.***Appl. Math. Comput.*2011, 217: 9543–9551. doi:10.1016/j.amc.2011.04.009Fang CJ, He YR:

**An extragradient method for generalized variational inequality.***Pac. J. Optim.*2013, 9(1):47–59.Fang SC, Peterson EL:

**Generalized variational inequalities.***J. Optim. Theory Appl.*1982, 38(3):363–383. doi:10.1007/BF00935344Fukushima M:

**The primal Douglas-Rachford splitting algorithm for a class of monotone mappings with application to the traffic equilibrium problem.***Math. Program.*1996, 72(1, Ser. A):1–15. doi:10.1007/BF02592328Konnov IV:

*Combined Relaxation Methods for Variational Inequalities*. Springer, Berlin; 2001.Li FL, He YR:

**An algorithm for generalized variational inequality with pseudomonotone mapping.***J. Comput. Appl. Math.*2009, 228: 212–218. doi:10.1016/j.cam.2008.09.014Rockafellar RT:

**Monotone operators and the proximal point algorithm.***SIAM J. Control Optim.*1976, 14(5):877–898. doi:10.1137/0314056Saigal R:

**Extension of the generalized complementarity problem.***Math. Oper. Res.*1976, 1(3):260–266. doi:10.1287/moor.1.3.260Salmon G, Strodiot JJ, Nguyen VH:

**A bundle method for solving variational inequalities.***SIAM J. Optim.*2003, 14(3):869–893. doi:10.1137/S1052623401384096Xia FQ, Huang NJ:

**A projection-proximal point algorithm for solving generalized variational inequalities.***J. Optim. Theory Appl.*2011, 150: 98–117. doi:10.1007/s10957–011–9825–3Karamardian S:

**Complementarity problems over cones with monotone and pseudomonotone maps.***J. Optim. Theory Appl.*1976, 18(4):445–454. doi:10.1007/BF00932654Zarantonello EH:

**Projections on convex sets in Hilbert space and spectral theory.**In*Contributions to Nonlinear Functional Analysis*. Academic Press, New York; 1971.Bnouhachem A:

**A self-adaptive method for solving general mixed variational inequalities.***J. Math. Anal. Appl.*2005, 309: 136–150. doi:10.1016/j.jmaa.2004.12.023Aubin JP, Ekeland I:

*Applied Nonlinear Analysis*. Wiley, New York; 1984.Pang JS:

**Error bounds in mathematical programming.***Math. Program.*1997, 79: 299–332. doi:10.1007/BF02614322Facchinei F, Pang JS:

*Finite-Dimensional Variational Inequalities and Complementary Problems*. Springer, New York; 2003.Solodov MV:

**Convergence rate analysis of iterative algorithms for solving variational inequality problems.***Math. Program.*2003, 96: 513–528. doi:10.1007/s10107–002–0369-zPolyak BT:

*Introduction to Optimization*. Optimization Software Inc., Publications Division, New York; 1987.

## Acknowledgements

This work is partially supported by Natural Science Foundation Project of CQ CSTC (No. 2010BB9401), Science and Technology Project of Chongqing Municipal Education Committee of China (Nos. KJ110509 and KJ100513) and Foundation of Chongqing University of Posts and Telecommunications for the Scholars with Doctorate (No. A2012-04).

## Author information

### Authors and Affiliations

### Corresponding author

## Additional information

### Competing interests

The authors declare that they have no competing interests.

### Authors’ contributions

All the authors contributed equally to the writing of the present article. And they also read and approved the final manuscript.

## Rights and permissions

**Open Access** This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

## About this article

### Cite this article

Fang, C., Chen, S. & Yang, C. An algorithm for solving a multi-valued variational inequality.
*J Inequal Appl* **2013**, 218 (2013). https://doi.org/10.1186/1029-242X-2013-218

Received:

Accepted:

Published:

DOI: https://doi.org/10.1186/1029-242X-2013-218

### Keywords

- variational inequality
- multi-valued mapping
- extragradient method