A variational inequality method for computing a normalized equilibrium in the generalized Nash game
- Jian Hou^{1}Email author,
- Zong-Chuan Wen^{2} and
- Zhu Wen^{2}
https://doi.org/10.1186/1029-242X-2012-60
© Hou et al; licensee Springer. 2012
Received: 12 October 2011
Accepted: 9 March 2012
Published: 9 March 2012
Abstract
The generalized Nash equilibrium problem is a generalization of the standard Nash equilibrium problem, in which both the utility function and the strategy space of each player may depend on the strategies chosen by all other players. This problem has been used to model various problems in applications but convergent solution algorithms are extremely scare in the literature. In this article, we show that a generalized Nash equilibrium can be calculated by solving a variational inequality (VI). Moreover, conditions for the local superlinear convergence of a semismooth Newton method being applied to the VI are also given. Some numerical results are presented to illustrate the performance of the method.
Keywords
1 Introduction
In this article, We consider the generalized Nash equilibrium problem (GNEP). To this end, we first recall the definition of the Nash equilibrium problem (NEP). There are N players, each player ν ∈ {1,...,N} controls the variables ${x}^{\nu}\in {\Re}^{{n}_{\nu}}$. All players' strategies are collectively denoted by a vector $x={\left({x}^{1},...,{x}^{N}\right)}^{T}\in {\Re}^{n}$, where n = n_{1} + ⋯ + n_{ N }. To emphasize the ν th player's variables within the vector x, we sometimes write x = (x^{ ν }, x^{-ν})^{ T }, where ${x}^{-\nu}\in {\Re}^{{n}_{-\nu}}$ subsumes all the other players' variables.
Such a vector x* is called a generalized Nash equilibrium or, more simply a solution of the GNEP.
for some function $g:{\Re}^{n}\to {\Re}^{m}$. Additional equality constraints are also allowed, but for notational simplicity, we prefer not to include them explicitly. In many cases, a player ν might have some additional constraints depending on his decision variables only. However, these additional constraints can be viewed as part of the joint constraints g(x) ≤ 0, so, we include these latter constraints in the former ones.
Throughout this article, we make the following blanket assumptions.
Assumption 1.1 (i) The utility functions θ^{ ν }are twice continuously differentiable and as a function of x^{ ν }along, convex.
(ii) The function g is twice continuously differentiable, its components g _{ i } are convex (in x), and the corresponding strategy space X defined by (1.2) is nonempty.
The convexity assumptions are standard in the context of GNEPs. The smoothness assumptions are also very natural since our aim is to develop locally fast convergent methods for the solution of GNEPs.
The GNEP was formally introduced by Debreu [1] as early as 1952, but it is only from the mid-1990s that the GNEP attracted much attention because of its capability of modeling a number of interesting problems in economy computer science, telecommunications, and deregulated markets (e.g., see [2–4]). Another approach for solving the GNEP is based on the Nikaido-Isoda function. Relaxation methods and proximal-like methods using the Nikaido-Isoda function are investigated in [5–7]. A regularized version of the Nikaido-Isoda function was first introduced in [8] for standard NEPs then further investigated by Heusinger and Kanzow [9], they reformulated the GNEP as a constrained optimization problem with continuously differentiable objective function.
Motivated by the fact that a standard NEP can be reformulated as a variational inequality problem (VI for short), see, for example, [10, 11], Harker [12] characterized the GNEP as a quasi-variational inequality(QVI). But unlike VI, there are few efficient methods for solving QVI, and therefore such a reformulation is not used widely in designing implementable algorithms. On the other hand, it was noted in [13], for example, that certain solutions of the GNEP (the normalized Nash equilibria, to be defined later) can be found by solving a suitable standard VI associated to the GNEP.
Here, we further investigate the properties of the normalized Nash equilibria. The rest of the article is organized as follows. Section 2 gives some preliminaries. In Section 3, we use the fact that the normalized Nash equilibria can be found by solving a suitable VI, we reformulate the VI associated to the GNEP as a semismooth system of equations and the nonsingularity of the B-subdifferential for the system is explored. Finally, in Section 4, we implement a semismooth Newton method to some examples of the GNEP.
We use the following notations throughout the article. A function $G:{\Re}^{n}\to {\Re}^{t}$ is called a C^{ k }-function if it is k times continuously differentiable. For a differentiable function $g:{\Re}^{n}\to {\Re}^{m}$, the Jacobian of g at $x\in {\Re}^{n}$ is denoted by $\mathcal{J}g\left(x\right)$, and its transposed by ∇g(x). Given a differentiable function $\Psi :{\Re}^{n}\to \Re $, the symbol ${\nabla}_{{x}^{\nu}}\Psi \left(x\right)$ denotes the partial gradient with respect to x^{ ν }-part only, and ${\nabla}_{{x}^{\nu}{x}^{\mu}}^{2}\Psi \left(x\right)$ denotes the second-order partial derivative with respect to x^{ ν }-part and x^{ μ }-part. For a function $f:{\Re}^{n}\times {\Re}^{n}\to \Re ,\phantom{\rule{1em}{0ex}}f\left(x,\cdot \right):{\Re}^{n}\to \Re $ denotes the function with x being fixed. For vectors $x,y\in {\Re}^{n},\u27e8x,y\u27e9$ denotes the inner product defined by ⟨x,y⟩ := x^{ T }y and x ⊥ y means ⟨x,y⟩ = 0.
2 Preliminaries
is Clarke's generalized Jacobian of F at x (see [15]).
Based on this notation, we next recall the definition of a semismooth function. This concept was firstly introduced by Mifflin [16] for real-valued mappings and extended by Qi and Sun [17] to vector-valued mappings.
- (i)
Φ is directionally differentiable at x; and
- (ii)for any Δx ∈ X and V ∈ ∂Φ(x + Δx) with Δx → 0,$\Phi \left(x+\Delta x\right)-\Phi \left(x\right)-V\left(\Delta x\right)=\text{o}\left(\u2225\Delta x\u2225\right).$
In the study of algorithms for locally Lipschitzian systems of equations, the following regularity condition plays a role similar to that of the nonsingularity of the Jacobian in the study of algorithms for smooth systems of equations.
Definition 2.2 Let$G:{\Re}^{n}\to {\Re}^{n}$be Lipschitzian around x, G is said to be BD-regular at x if all the elements in ∂_{ B }G(x) are nonsingular. If$\stackrel{\u0304}{x}$is a solution of the system G(x) = 0 and G is BD-regular at$\stackrel{\u0304}{x}$, then$\stackrel{\u0304}{x}$is called a BD-regular solution of this system.
we state a result due to [13] which will be used later.
Lemma 2.1 Suppose that the GNEP satisfies Assumption 1.1 and assume further that the sets X_{ ν }(x^{-ν}) are defined by (1.1) with X closed and convex. Then, every solution of the VI(F, X) is a solution of the GNEP.
3 The nonsmooth equation reformulation and nonsingularity conditions
Consider the GNEP from Section 1 with utility functions θ^{ ν }and a strategy set X satisfying the requirements from Assumption 1.1. In this section, our aim is to show that the GNEP can be reformulated as a nonsmooth equation and then we present several conditions guaranteeing the BD-regularity condition of the equation.
are satisfied.
The next lemma from [13] relates the normalized Nash equilibria to the KKT conditions (3.3).
Lemma 3.1 (i) Let x be a solution of VI(F,X) at which the KKT conditions (3.3) hold. Then x is a solution of the GNEP (normalized Nash equilibria) at which the KKT conditions (3.1) hold with λ^{1} = λ^{2} = ⋯ = λ^{ N }= λ.
(ii) Viceversa, let x be a solution of the GNEP at which KKT conditions (3.1) hold with λ^{1} = λ^{2} = ⋯ = λ^{ N }. Then x is a solution of VI(F, X).
From Assumption 1.1, we know that Φ is semismooth.
In the following, our aim is to present several conditions guaranteeing that all elements in the generalized Jacobian ∂Φ(ω) (and hence in the B-subdifferential ∂_{ B }Φ(ω)) are nonsingular. Our first result gives a description of the structure of the matrices in the generalized Jacobian ∂Φ(ω).
for any μ_{ i }∈ [0,1].
This gives the representation of H ∈ ∂Φ(ω)^{ T }.
Our next aim is to establish conditions guaranteeing that all elements in the generalized Jacobian ∂Φ(ω) at a point ω = (x,λ) satisfying Φ(ω) = 0 are nonsingular.
- (a)
The strong second-order sufficient condition and the linear independence constraint qualification (LICQ) for VI(F,X) holds at x*.
- (b)
Any element in ∂Φ(ω*) is nonsingular.
It holds that (a) ⇒ (b).
This together with Δx_{1} = 0 shows that the matrix (3.6) is nonsingular, and then, H is nonsingular.
Now, we are able to apply Theorem 3.1 to some classes of GNEPs.
where${f}^{\nu}:{\Re}^{{n}_{\nu}}\to \Re $is stongly convex and${h}^{\nu}:{\Re}^{n-{n}_{\nu}}\to \Re $. Assume that LICQ holds at x*. Then all elements H ∈ ∂Φ(ω*) are nonsingular.
By the strong convexity of f^{ ν }, we can conclude that ∇F(x*) is positive definite.
is positive definite. Thus, the strong second-order sufficient condition for the VI(F, X) holds at x*. From Theorem 3.1, we obtain any element in ∂Φ(ω*) is nonsingular.
is positive definite. Then all the elements in the generalized Jacobian ∂Φ(ω*) are nonsingular.
is positive semidefinite. Hence, we obtain that ∇_{ x }L(ω*) is positive definite. The statement therefore follows from Theorem 3.1.
4 Numerical illustrations
A simple Armijo-type line search is used in the algorithm and we switch to the steepest direction whenever the generalized Newton direction is not computable or does not satisfy a sufficient decrease condition.
Algorithm 4.1
Step 0 Choose ${\omega}^{0}=\left({x}^{0},{\lambda}^{0}\right)\in {\Re}^{n+m},\rho >0,\kappa >2,\sigma \in \left(0,\frac{1}{2}\right),\beta \in \left(0,1\right),\epsilon \ge 0$, and set k = 0.
Step 1 If ∥∇Ψ(ω^{ k })∥ ≤ ε, stop.
Step 4 Set ω^{k+1}= ω^{ k }+ t^{ k }d^{ k }, k = k + 1 and go to step 1.
The following result about the convergence property of Algorithm 4.1 comes from [18] directly.
Theorem 4.1 Assume that Algorithm 4.1 does not terminate within a finite number of iterations, let {ω^{ k }} be generated by Algorithm 4.1 having an accumulation point ω*, then ω* is a stationary point of Ψ. Moreover, if ω* is a BD-regular solution of the system Φ(ω) = 0, then {ω^{ k }} convergence to ω* Q-superlinearly.
Numerical results for Example 4.1
k | ${x}_{1}^{k}$ | ${x}_{2}^{k}$ | ${x}_{3}^{k}$ | Stepsize |
---|---|---|---|---|
0 | 0.100000 | 0.100000 | 0.100000 | 0 |
1 | 0.086298 | 0.086298 | 0.086298 | 0.015224 |
2 | 0.095471 | 0.095471 | 0.095471 | 0.015224 |
3 | 0.087856 | 0.087856 | 0.087856 | 0.015224 |
4 | 0.093390 | 0.093390 | 0.093390 | 0.015224 |
5 | 0.088716 | 0.088716 | 0.088716 | 0.015224 |
⋮ | ⋮ | ⋮ | ⋮ | ⋮ |
10 | 0.091365 | 0.091365 | 0.091365 | 0.015224 |
⋮ | ⋮ | ⋮ | ⋮ | ⋮ |
20 | 0.089952 | 0.089952 | 0.089952 | 0.302500 |
21 | 0.089968 | 0.089968 | 0.089968 | 0.008373 |
Numerical results for Example 4.2
k | ${x}_{1}^{k}$ | ${x}_{2}^{k}$ | ${x}_{3}^{k}$ | Stepsize |
---|---|---|---|---|
0 | 0.000000 | 0.000000 | 0.000000 | 0.0000 |
1 | 9.208951 | 2.481282 | 8.931660 | 0.166375 |
2 | 11.531188 | 3.106991 | 11.183971 | 0.050328 |
3 | 12.744136 | 3.433811 | 12.360396 | 0.027680 |
4 | 13.100896 | 3.529937 | 12.706414 | 0.008373 |
5 | 13.159756 | 3.545796 | 12.763501 | 0.001393 |
6 | 13.177536 | 3.550587 | 12.780746 | 0.000421 |
7 | 13.182912 | 3.552036 | 12.785960 | 0.000127 |
8 | 21.175468 | 16.026854 | 2.771656 | 1 |
9 | 21.149274 | 16.027708 | 2.732634 | 1 |
10 | 21.144948 | 16.027849 | 2.726189 | 1 |
11 | 21.144796 | 16.027853 | 2.725963 | 1 |
Numerical results for Example 4.3
Dim | CPU time (s) | Iter. | Func. | Res0. | Res*. |
---|---|---|---|---|---|
10 | 0.0470 | 6 | 15 | 5.227683e+004 | 1.028557e-009 |
50 | 0.0520 | 7 | 20 | 1.529682e+008 | 1.752247e-010 |
100 | 0.3250 | 7 | 24 | 5.052647e+009 | 6.559316e-013 |
300 | 0.6340 | 9 | 33 | 1.230922e+012 | 2.016572e-010 |
500 | 2.6720 | 11 | 43 | 1.581871e+013 | 1.446427e-012 |
1000 | 13.2189 | 9 | 38 | 5.002778e+014 | 1.458512e-009 |
1500 | 39.4220 | 9 | 34 | 3.800590e+015 | 3.468333e-013 |
2000 | 1.0953e+002 | 11 | 50 | 1.601577e+016 | 2.619540e-014 |
2500 | 2.2250e+002 | 12 | 50 | 4.889072e+016 | 3.492963e-014 |
3000 | 3.4442e+002 | 11 | 47 | 1.216867e+017 | 1.782483e-013 |
with constraints x^{ v }≥ 0.01, ν = 1,..., N and${\sum}_{\nu =1}^{N}{x}^{\nu}\le B$. According to[20], we also set N = 10, B = 1 and use the starting point${x}^{0}={\left(0.1,0.1,0.1,...,\right)}^{T}\in {\Re}^{10}$. The exact solution of this problem is x* = (0.09,0.09,..., 0.09)^{ T }. We only state the first three components of the iteration vectors in Table1.
Numerical results for Example 4.1
playerν | c _{1,ν} | c _{2,ν} | e _{ v } | μ _{v,1} | μ _{v,2} |
---|---|---|---|---|---|
1 | 0.10 | 0.01 | 0.50 | 6.5 | 4.583 |
2 | 0.12 | 0.05 | 0.25 | 5.0 | 6.250 |
3 | 0.15 | 0.01 | 0.75 | 5.5 | 3.750 |
be positive definite, The strategy space X is defined by some linear constraints. For convenience, we set the elements of x^{0} all 1. The elements of λ^{0} all 0. We set other parameters in the algorithm as ρ = 10^{-8}, κ = 2.1, σ = 10^{-4}, β = 0.55. Our numerical results are reported in Table 3, where Iter., Func, Res0. and Res*. stand for, respectively, the number of iterations, the number of function evaluations, the residual ∥∇Ψ(·)∥ at the starting point and the residual ∥∇Ψ(·)∥ at the final iterate of implementation.
The numerical experiments show that the method proposed in this article is imple-mentable and effective.
Declarations
Acknowledgements
The research was supported by the Fundamental Innovation Methods Funds under Project No. 2010IM020300 and the Technology Research of Inner Mongolia under Project No. 20100915.
Authors’ Affiliations
References
- Debreu G: A social equilibrium existence theorem. Proc Natl Acad Sci USA 1952, 38: 886–893. 10.1073/pnas.38.10.886MathSciNetView ArticleGoogle Scholar
- Altman E, Wynter L: Equilibrium, games, and pricing in transportation and telecommunication networks. Netw Spat Econ 2004, 4: 7–21.View ArticleGoogle Scholar
- Hu X, Ralph D: Using EPECs to model bilevel games in restructured electricity markets with locational prices. Oper Res 2007, 55: 809–827. 10.1287/opre.1070.0431MathSciNetView ArticleGoogle Scholar
- Krawczyk JB: Coupled constraint Nash equilibria in enviromental games. Resour Energy Econ 2005, 27: 157–181. 10.1016/j.reseneeco.2004.08.001View ArticleGoogle Scholar
- Krawczyk JB, Uryasev S: Relaxation algorithms to find Nash equilibria with economic applications. Environ Model Assess 2000, 5: 63–73. 10.1023/A:1019097208499View ArticleGoogle Scholar
- Uryasev S, Rubinstein RY: On relaxation algorithms in computation of noncoopera-tive equilibria. IEEE Trans Autom Control 1994, 39: 1263–1267. 10.1109/9.293193MathSciNetView ArticleGoogle Scholar
- Flam SD, Ruszczynski A: Noncooperative convex games: computing equilibrium by partial regulalization. IIASA Working Paper Austria 1994, 94–142.Google Scholar
- Gürkan G, Pang JS: Approximations of Nash equilibria. Math Program 2009, 117: 223–253. 10.1007/s10107-007-0156-yMathSciNetView ArticleGoogle Scholar
- Heusinger AV, Kanzow C: Optimization reformulations of the generalized Nash equilibrium problem using Nikaido-Isoda-type functions. Comput Optim Appl 2009, 43: 353–377. 10.1007/s10589-007-9145-6MathSciNetView ArticleGoogle Scholar
- Facchinei F, Pang JS: Finite-dimensional variational inequalities and complementarity problems. 2003, I: Springer, New York.Google Scholar
- Facchinei F, Pang JS: Finite-dimensional variational inequalities and complementarity problems. Volume II. Springer, New York; 2003.Google Scholar
- Harker PT: Generalized Nash games and quasi-variational inequalities. Eur J Oper Res 1991, 54: 81–94. 10.1016/0377-2217(91)90325-PView ArticleGoogle Scholar
- Facchinei F, Fisher A, Piccialli V: On generalized Nash games and variational inequalities. Oper Res Lett 2007, 35: 159–164. 10.1016/j.orl.2006.03.004MathSciNetView ArticleGoogle Scholar
- Qi L: Convergence analysis of some algorithms for solving nonsmooth equations. Math Oper Res 1993, 18: 227–244. 10.1287/moor.18.1.227MathSciNetView ArticleGoogle Scholar
- Clarke FH: Optimization and Nonsmooth Analysis. John Wiley, New York; 1983.Google Scholar
- Mifflin R: Semismooth and semiconvex functions in constrained optimization. SIAM J Control Optim 1977, 15: 959–972. 10.1137/0315061MathSciNetView ArticleGoogle Scholar
- Qi L, Sun J: A nonsmooth version of Newton's method. Math Program 1993, 58: 353–368. 10.1007/BF01581275MathSciNetView ArticleGoogle Scholar
- Luca TD, Facchinei F, Kanzow C: A semismooth equation approach to the solution of nonlinear complementarity problems. Math Program 1996, 75: 407–439.Google Scholar
- Facchinei F, Fisher A, Piccialli V: Generalized Nash equilibrium problems and Newton methods. Math Program 2009, 117: 163–194. 10.1007/s10107-007-0160-2MathSciNetView ArticleGoogle Scholar
- Heusinger AV, Kanzow C: Relaxation methods for generalized Nash equilibrium problems with inexact line search. J Optim Theory Appl 2009, 143: 159–183. 10.1007/s10957-009-9553-0MathSciNetView ArticleGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.