- Research
- Open access
- Published:
Robust solutions to box-constrained stochastic linear variational inequality problem
Journal of Inequalities and Applications volume 2017, Article number: 253 (2017)
Abstract
We present a new method for solving the box-constrained stochastic linear variational inequality problem with three special types of uncertainty sets. Most previous methods, such as the expected value and expected residual minimization, need the probability distribution information of the stochastic variables. In contrast, we give the robust reformulation and reformulate the problem as a quadratically constrained quadratic program or convex program with a conic quadratic inequality quadratic program, which is tractable in optimization theory.
1 Introduction
Variational inequality theory is an important branch in operations research. Recall that the variational inequality problem, denoted by \(\operatorname{VI}(X,F)\), is to find a vector \(x^{\ast}\in X\) such that
where \(X\subseteq R^{n}\) is a non-empty closed convex set, \(F:X \rightarrow R^{n}\) is a given function. A particularly important class of \(\operatorname{VI}(X,F)\) is the box-constrained variational inequality problem (see [1]), denoted by \(\operatorname{VI}(l,u,F)\), where \(X=D=\{x\in R^{n} \mid l\leq x\leq u\}\), \(l:=(l_{1},\ldots,l_{n})^{T}, u:=(u_{1},\ldots,u_{n})^{T}\), along with the lower bounds \(l_{i}\in R \cup\{-\infty\}\), the upper bounds \(u_{i}\in R \cup\{+\infty\}\) and \(l_{i}< u_{i}\) for all \(i=1,\ldots,n\). To obtain the solutions of VI(\(l,u,F\)), many methods are presented based on the KKT system, which is given as follows:
Note that this KKT system is a complementarity problem in fact.
The box-constrained variational inequality problem has many applications ranging from operations research to economic equilibrium and engineering problems [2]. However, some elements may involve uncertain data in practice. For example, the demands are generally difficult to be determined in supply chain network, because they vary with the change of income level [3, 4]. Moreover, in traffic equilibrium problems, the selfish users’ attempt to minimize travel cost leads the equilibrium (or steady-state) flows to uncertainty [5–8].
For the existence of stochastic elements, the solutions of stochastic variational inequality problem would change with stochastic elements respectively. In order to meet the needs in practice, many researchers begin to consider the following stochastic variational inequality problem, denoted by \(\operatorname{SVI}(X,F)\), which requires an \(x^{\ast}\) such that
where \(\omega\in\Omega\subseteq R^{\tau}\) is a stochastic vector and \(a.s\). is the abbreviation for ‘almost surely’ under the given probability measure. Particularly, if \(F(x,\omega):=M(\omega)x+q(\omega )\) and \(X=D=\{x\in R^{n},l\leq x\leq u\}\) is a non-empty set, where \(M(\omega):\Omega\rightarrow R^{n\times n}\) and \(q(\omega):\Omega \rightarrow R^{n}\) are mappings with respect to ω, we then call problem (3) box-constrained stochastic linear variational inequality problem, denoted by \(\operatorname{SLVI}(l,u,F)\). Following from (2), the KKT system of \(\operatorname{SLVI}(l,u,F)\) can be rewritten as
where \(t=x-l\in R^{n}_{+}\) and \(\bigl({\scriptsize\begin{matrix}{} t \cr y \end{matrix}} \bigr) \in R^{2n}_{+}\) are vectors, I denotes an n-dimensional identify matrix and 0 represents a zero matrix with suitable dimension.
Before proceeding, we briefly touch upon earlier efforts about SVI(\(X,F\)). For example, the expected value (EV) method [9–11] and the expected residual minimization (ERM) method [12–14] focused on minimizing the average or the average of expected residual. These methods needed the information of a probability distribution and focused on providing estimators of local solutions. In the spirit of robust approaches, instead of ERM or EV, we consider the minimization of the worst-case residual over a particular uncertainty set Ω.
By employing KKT system (4), we give the robust reformulation of \(\operatorname{SLVI}(l,u,F)\) as follows:
Obviously, (5) can be rewritten as follows:
Note that \(\bigl( {\scriptsize\begin{matrix}{} t \cr y \end{matrix}} \bigr)\geq0 \) solves (4) if and only if \(\bigl({\scriptsize\begin{matrix}{} t \cr y\end{matrix}} \bigr)\) is a solution of (5) with optimal value zero by Lemma 3.1 in [15].
The organization of this paper is as follows. In Section 2, we discuss the tractable robust counterparts of monotone \(\operatorname{SLVI}(l,u,F)\) in different uncertain sets. Non-monotone generalizations and their tractable robust counterparts form the core of Section 3. In Section 4, we give the conclusions.
2 Tractable robust counterparts of monotone \(\operatorname{SLVI}(l,u,F)\)
To begin with, we provide robust counterparts in regimes where \(M(\omega ^{1})\) is a stochastic positive semidefinite matrix and \(q(\omega^{2})\) is a stochastic vector with \(\omega^{1}\in\Omega^{1}\) and \(\omega^{2}\in \Omega^{2}\), where \(\Omega^{1}\) and \(\Omega^{2}\) are uncertainty sets. \(\Omega^{1}\) contains \(\Omega^{1}_{\infty}\) and \(\Omega^{1}_{1}\). These two types of uncertainty sets state as follows:
\(\Omega^{2}\) contains \(\Omega^{2}_{\infty}\), \(\Omega^{2}_{1}\) and \(\Omega^{2}_{2}\), these three types of uncertainty sets state as follows:
Here, \(\Vert \cdot \Vert _{\infty}, \Vert \cdot \Vert _{1}, \Vert \cdot \Vert _{2}\) denotes infinite norm, 1-norm and 2-norm, respectively. Moreover, we define \(M(\omega^{1})=M_{0}+\sum_{s = 1}^{S} {\omega_{s}^{1}M_{s} }, q(\omega ^{2})=q_{0}+\sum_{s = 1}^{S} {\omega_{s}^{2} q_{s}}\), where \(M_{s}, s=1,\ldots,S\), is an n-dimensional symmetric positive semidefinite matrix and \(q_{s}, s=1,\ldots,S\), is an n-dimensional vector. Without loss of generality, we assume that \(M(\omega^{1})\) is symmetric; if not, we may replace the matrixes by their symmetrized counterparts. This assumption guarantees \(\bigl[ {\scriptsize\begin{matrix}{} M(\omega) & I \cr -I & \mathbf{0} \end{matrix}} \bigr]\bigl( {\scriptsize\begin{matrix}{} t \cr y \end{matrix}} \bigr)+\bigl( {\scriptsize\begin{matrix}{} M(\omega)l+q(\omega) \cr u-l\end{matrix}} \bigr)\) is monotone on \(R^{2n}_{+}\) (see [16]).
In this section, we first consider the case when \(\Omega^{1}=\Omega _{\infty}^{1}\), the robust counterpart of \(\operatorname{SLVI}(l,u,F)\), and then focus on the case \(\Omega^{1}=\Omega^{1}_{1}\) while \(\omega^{2}\in\Omega ^{2}\). We now prove that robust problem (6) can be reformulated as a quadratically constrained quadratic program (QCQP) or convex program with a conic quadratic inequality quadratic program [17, 18] under the different uncertain sets.
Theorem 1
Consider the optimization problem (6) with \(\omega^{1}\in\Omega _{\infty}^{1}\) and \(M(\omega^{1})=M_{0}+\sum_{s = 1}^{S} {\omega _{s}^{1}M_{s} }, q(\omega^{2})=q_{0}+\sum_{s = 1}^{S} {\omega_{s}^{2} q_{s}}\). Then (6) can be reformulated respectively as QCQP or convex program with a conic quadratic inequality quadratic program while \(\omega^{2}\) belongs to different sets of \(\Omega^{2}\).
Proof
Case 1: \(\Omega^{2}=\Omega^{2}_{\infty}\).
We first give the equivalent reformulation of the first constraint in problem (6) as follows:
Noting that \(\Vert \eta \Vert _{1}=\mathop{\max} _{ \Vert \omega \Vert _{\infty}\leq1}\eta ^{T}\omega\), we evaluate the maximum in the above formulation as follows:
where the last equality is obtained by applying the positive semidefiniteness of \(M_{s}\) for \(s=1,\ldots,S\). Similarly, we have
Hence, reformulation (7) can be rewritten as:
We then give the equivalent form of the second constraint in problem (6) as follows:
After a simple calculation, for \(i=1, \ldots, n, s=1, \ldots, S\), we have
Similarly, we have \(\mathop{\min} _{\omega_{s}^{1}\in\Omega_{\infty }^{1}} (\sum_{s = 1}^{S} {\omega_{s}^{1} M_{s}l} )_{i}=-\sum_{s = 1}^{S}\max (- [M_{s} ]_{i}l,0 )\) and
By the fact that the upper bound \(u\geq x\), we simplify formulation (11) as follows:
Here, \(i=1,\ldots,n\) and for a given vector \(x\in R^{n}, \vert x \vert =( \vert x_{1} \vert ,\ldots, \vert x_{n} \vert )^{T}\). Then problem (6) can be rewritten as follows:
Since it is difficult to compute maximum and absolute value functions, we can eliminate them by increasing relaxation variables \(a_{s}\in R_{+}, \alpha_{s},\beta_{s}\in R_{+}^{n}, s=1,\ldots,S\). Then the above problem can be converted to QCQP:
Case 2: \(\Omega^{2}=\Omega^{2}_{1}\).
We first replace \(\omega_{s}^{2}\in\Omega_{\infty}^{2}\) in formulation (7) by \(\omega_{s}^{2}\in\Omega_{1}^{2}\) and noting that \(\Vert \eta \Vert _{\infty}=\mathop{\max} _{ \Vert \omega \Vert _{1}\leq1}\omega^{T}\eta\), then for \(i=1,\ldots,n\), we have
and
After a simple calculation, problem (6) can be rewritten as follows:
In order to calculate easily, we introduce variables \(a\in R_{+},\alpha _{s},\beta_{s}\in R_{+}^{n},s=1,\ldots,S\). Then we obtain the following QCQP:
Case 3: \(\Omega^{2}=\Omega_{2}^{2}\).
Firstly, we use \(\omega_{s}^{2}\in\Omega_{2}^{2}\) instead of \(\omega _{s}^{2}\in\Omega_{\infty}^{2}\) in formulation (7). By Example 1.3.3 in [19], it is seen that \(\mathop{\max} _{ \Vert \omega \Vert _{2}\leq r}\omega^{T}\eta=r\frac{\eta^{T}\eta}{ \Vert \eta \Vert _{2}}=r \Vert \eta \Vert _{2}\), which implies that \(\mathop{\max} _{ \Vert \omega \Vert _{2}\leq1}\omega ^{T}\eta= \Vert \eta \Vert _{2}\) and \(\mathop{\min} _{ \Vert \omega \Vert _{2}\leq1}\omega ^{T}\eta=-\frac{\eta^{T}\eta}{ \Vert \eta \Vert _{2}}=- \Vert \eta \Vert _{2}\). As a result, for every \(i=1,\ldots,n\), we have
and
After a simple calculation, for \(i=1,\ldots,n\), problem (6) can be rewritten as follows:
Through adding variables \(a\in R_{+},\alpha_{s},\beta_{s}\in R_{+}^{n},s=1,\ldots,S\), the above problem can be reformulated as the following convex program with a conic quadratic inequality quadratic program:
These complete the proof. □
We now consider the robust counterpart of (6) defined by \(\Omega ^{1}=\Omega^{1}_{1}\) and \(\omega^{2}\in\Omega^{2}\).
Theorem 2
Consider the optimization problem (6) where \(\omega^{1}\in\Omega ^{1}_{1}\) and \(M(\omega^{1})=M_{0}+\sum_{s = 1}^{S} {\omega_{s}^{1}M_{s} }, q(\omega^{2})=q_{0}+\sum_{s = 1}^{S} {\omega_{s}^{2} q_{s}}\). Then (6) can be reformulated as QCQP or convex program with a conic quadratic inequality quadratic program while \(\omega^{2}\) belongs to different sets of \(\Omega^{2}\).
Proof
Case 1: \(\Omega^{2}=\Omega_{\infty}^{2}\).
We first consider the equivalent form of quadratic constraint in problem (6), it can be represented as
We then have to evaluate the result of maximum in the above formulation by \(\Vert \eta \Vert _{\infty}=\mathop{\max} _{ \Vert \omega \Vert _{1}\leq1}\eta ^{T}\omega\) that
Here, we can obtain the last equality by applying the positive semidefiniteness of \(M_{s}\) for \(s=1,\ldots,S\). Similarly, we have
It then follows from (10) that formulation (17) can be rewritten as
We then give the equivalent component form of the second constraint in problem (6) by formulation (12) as follows:
Finally, by adding variables \(a_{s}\in R_{+},s=1,\ldots,S,\alpha,\beta \in R_{+}^{n}\), we obtain QCQP as follows:
Inspired by Case 1, we derive the conclusions of Case 2 and Case 3.
Case 2: \(\Omega^{2}=\Omega_{1}^{2}\).
We replace \(\omega_{s}^{2}\in\Omega_{\infty}^{2}\) in formulation (17) by \(\omega_{s}^{2}\in\Omega_{1}^{2}\) and combining with (13), (14), (18) and (19), by adding variables \(a\in R_{+},\alpha,\beta\in R_{+}^{n}\), problem (6) can be reformulated as the following QCQP:
Case 3: \(\Omega^{2}=\Omega_{2}^{2}\).
We use \(\omega_{s}^{2}\in\Omega_{2}^{2}\) instead of \(\omega_{s}^{2}\in \Omega_{\infty}^{2}\) in formulation (17) and taking (15), (16), (18) and (19) into account, by adding variables \(a\in R_{+},\alpha,\beta\in R_{+}^{n}\), problem (6) can be converted to convex program with a conic quadratic inequality quadratic program as follows:
These complete the proof. □
Theorems 1 and 2 present an approach to seek robust solutions of \(\operatorname{SLVI}(l,u,F)\), when \(M_{s} (s=1,\ldots,S)\) is a positive semidefinite matrix. However, this condition is a little strict so that it is difficult to satisfy in practice. Thus, we give more general circumstances in Section 3.
3 Tractable robust counterparts of non-monotone \(\operatorname{SLVI}(l,u,F)\)
In this section, we first define \(M(\omega)=M_{0}+\sum_{s = 1}^{S} {\omega_{s}M_{s} }+\sum_{k = 1}^{K} {\omega_{S+k}M^{\prime}_{k} }\), where \(M(\omega),M_{0},M_{s}\), \(M_{k}^{\prime}\) are symmetric matrices for \(s=1,\ldots,S, k=1,\ldots,K\); if not, we may replace the matrices by their symmetrical counterparts, and \(M_{0},M_{s}\succeq0,s=1,\ldots ,S, M_{k}^{\prime}\preceq0,k=1,\ldots,K\). Then the corresponding function
is no longer monotone for \(\omega\in\Omega\), a.s. In this section, we consider the case that q is a certain vector. Since it is difficult to directly apply the results of quadratic program, these problems are somewhat more challenging. As we proceed, we may still obtain the results that robust problem (6) can be reformulated as QCQP or convex program under suitably defined uncertain sets.
Theorem 3
Consider the optimization problem (6) with uncertain sets defined by \(\Omega^{2}\), (6)Â can be reformulated as QCQP or convex program.
Proof
Case 1: \(\Omega=\Omega_{\infty}^{2}\).
Firstly, we consider the first constraint in formulation (6). Similar to (8), (9), combining with \(\mathop{\max} _{ \Vert \omega \Vert _{\infty}\leq1}\eta^{T}\omega= \Vert \eta \Vert _{1}\) and \(M_{s}\succeq 0, M_{k}^{\prime}\preceq0\), for every \(s,k\), we have
We then consider the second constraint in formulation (6). Since \(\mathop{\max} _{ \Vert \omega \Vert _{\infty}\leq1}\eta^{T}\omega= \Vert \eta \Vert _{1}\), there holds
In the same way, we have
It then follows from the fact \(h(x,\omega)\geq0, \omega\in\Omega_{\infty }^{2}\), a.s. \(\Leftrightarrow\mathop{\min} _{\omega\in\Omega_{\infty }^{2}} h(x,\omega)\geq0\) and eliminate all absolute value by adding extra variables \(\alpha_{s},\beta_{s}\in R_{+}^{n},s=1,\ldots,S+K\), then problem (6) can be rewritten as the following QCQP:
Case 2: \(\Omega=\Omega_{1}^{2}\).
Similar to obtaining (18), (19), taking \(\mathop{\max} _{ \Vert \omega \Vert _{1}\leq1}\omega^{T}\eta= \Vert \eta \Vert _{\infty}\) together with the fact that for all \(t, l, t^{T}M_{s}t, t^{T}M_{s}l\geq0, s=1,\ldots ,S\) and \(t^{T}M_{k}^{\prime}t, t^{T}M_{k}^{\prime}l\leq0, k=1,\ldots ,K\), we have
Then the first constraint in problem (6) can be transformed as follows:
On the other hand, it follows from \(\mathop{\max} _{ \Vert \omega \Vert _{1}\leq 1}\omega^{T}\eta= \Vert \eta \Vert _{\infty}\) that, for every \(s,k\), we can deduce that
Similarly, we have
It then follows from (20), (21) that the second constraint can be transformed as follows:
Finally, in order to eliminate the maximum function, we add extra variables \(\alpha_{1},\alpha_{2},\beta_{1}, \beta_{2}\in R_{+}^{n}\) into constraints. In addition, taking the fact \(h(x,\omega)\geq0, \omega\in \Omega_{1}^{2}, \mbox{ a.s. }\Leftrightarrow \mathop{\min} _{\omega\in\Omega _{1}^{2}} h(x,\omega)\geq0\) into account, we obtain the QCQP form of problem (6) as follows:
Case 3: \(\Omega=\Omega_{2}^{2}\).
In this circumstance, we begin by simplifying the first constraint in problem (6), according to \(\mathop{\max} _{ \Vert \omega \Vert _{2}\leq 1}\omega^{T}\eta= \Vert \eta \Vert _{2}\), we can derive that
Similarly, we have
Noting that, by calculating the second derivative of \(\sqrt{\sum_{s = 1}^{S}(t^{T}M_{s}t)^{2}+\sum_{k = 1}^{K}(t^{T}M^{\prime}_{k}t)^{2}}\) and \(\sqrt{\sum_{s = 1}^{S}(t^{T}M_{s}l)^{2}+\sum_{k = 1}^{K}(t^{T}M^{\prime}_{k}l)^{2}}\), we can easily derive that the first constraint is a convex constraint.
We then give the equivalent form of the second constraint in problem (6), according to \(\mathop{\max} _{ \Vert \omega \Vert _{2}\leq1}\omega ^{T}\eta= \Vert \eta \Vert _{2}\), the formulation is transformed as follows:
Noting that above n constraints are in the form of second-order cone constraints, they are tractable convex constraints. Similarly, for \(i=1,\ldots,n\), we have
Therefore, problem (6) can be converted to a convex program as follows:
The proof is completed. □
The core idea of Theorem 3 is to derive the tractable robust counterparts of \(\operatorname{SLVI}(l,u,F)\). The case with uncertain q can be easily proved similar to Section 2, so it is omitted here.
4 Conclusions
We present the first attempt to give the robust reformulation for solving the box-constrained stochastic linear variational inequality problem. For three types of uncertain variables, the robust reformulation of \(\operatorname{SLVI}(l,u,F)\) can be solved as either a quadratically constrained quadratic program (QCQP) or a convex program, which are all more tractable and can provide solutions for \(\operatorname{SLVI}(l,u,F)\), no matter for monotone or non-monotone F.
References
Qi, L, Sun, D, Zhou, G-L: A new look at smoothing Newton methods for nonlinear complementarity problems and box constrained variational inequalities. Math. Program. 87, 1-35 (2000)
Harker, P-T, Pang, J-S: Finite-dimensional variational inequality and nonlinear complementarity problems: a survey of theory, algorithms and applications. Math. Program. 48, 161-220 (1990)
Dong, J, Zhang, D, Nagurney, A: A supply chain network equilibrium model with random demands. Eur. J. Oper. Res. 156, 194-212 (2004)
Nagurney, A, Dong, J, Zhang, D: A supply chain network equilibrium model. Transp. Res., Part E, Logist. Transp. Rev. 38, 281-303 (2002)
Gabriel, S-A, Bernstein, D: The traffic equilibrium problem with nonadditive path costs. Transp. Sci. 31, 337-348 (1997)
Jahn, O, Möhring, R-H et al.: System-optimal routing of traffic flows with user constraints in networks with congestion. Oper. Res. 53, 600-616 (2005)
Ordóñez, F, Stier-Moses, N-E: Robust Wardrop equilibrium. Lect. Notes Comput. Sci. 4465, 247-256 (2006)
Patriksson, M: Traffic Assignment Problems-Models and Methods, Vision Sports Publishing, Utrecht (1994)
Durbach, I-N, Stewart, T-J: Using expected values to simplify decision making under uncertainty. Omega 37, 312-330 (2009)
Li, Y-H, Xu, W-T, He, S-W: Expected value model for optimizing the multiple bus headways. Appl. Math. Comput. 219, 5849-5861 (2013)
Gürkan, G, Özge, A-Y, Robinson, S-M: Sample-path solution of stochastic variational inequalities. Math. Program. 84, 313-333 (1999)
Chen, X-J, Fukushima, M: Expected residual minimization method for stochastic linear complementarity problems. Math. Oper. Res. 30, 1022-1038 (2005)
Chen, X-J, Zhang, C et al.: Stochastic variational inequalities: residual minimization smoothing sample average approximations. SIAM J. Optim. 22, 649-673 (2012)
Luo, M-J, Lin, G-H: Expected residual minimization method for stochastic variational inequality problems. J. Optim. Theory Appl. 140, 103-116 (2009)
Xie, Y, Shanbhag, U-V: On robust solutions to uncertain monotone linear complementarity problems (LCPs) and their variants. Decis. & Control 26, 2834-2839 (2015)
Rockafellar, R-T: Convex Analysis, Princeton University Press, Princeton (1970)
Birge, J-R, Louveaux, F-V: Introduction to Stochastic Programming, Springer, New York (1997)
Shapiro, A: Stochastic programming approach to optimization under uncertainty. Math. Program. 112, 183-220 (2008)
Tal, A-B, Ghaoui, L-E, Nemirovski, A: Robust Optimization. Princeton Series in Applied Mathematics. Princeton University Press, Princeton (2009)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant No. 11501275 and the Scientific Research Fund of Liaoning Provincial Education Department under Grant No. L2015199.
Author information
Authors and Affiliations
Contributions
All authors contributed equally and significantly in writing this article. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Luo, MJ., Zhang, Y. Robust solutions to box-constrained stochastic linear variational inequality problem. J Inequal Appl 2017, 253 (2017). https://doi.org/10.1186/s13660-017-1529-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13660-017-1529-2