Solving linear bilevel multiobjective programming problem via exact penalty function approach
- Yibing Lv^{1}Email author and
- Zhongping Wan^{2}
https://doi.org/10.1186/s13660-015-0780-7
© Lv and Wan 2015
Received: 19 June 2015
Accepted: 6 August 2015
Published: 27 August 2015
Abstract
In this paper, the linear bilevel multiobjective programming problem is addressed. The duality gap of the lower level problem is appended to the objectives of the upper level problem with a penalty, and a penalized problem for the linear bilevel multiobjective programming problem is obtained. We prove that the Pareto optimality is reached for an exact penalty function, then an algorithm (original algorithm) is proposed. In addition, for the linear bilevel multiobjective programming problem with given weights for the upper level objective functions, we analyze the optimality conditions and propose an algorithm (weights algorithm). The numerical results showing viability of the penalty function approach are presented.
Keywords
linear bilevel multiobjective programming duality gap penalty function Pareto optimal solution1 Introduction
Bilevel programming (BP), which is characterized by the existence of two optimization problems in which the constraint region of the first-level problem is implicitly determined by another optimization problem, has increasingly been addressed in the literature, both from the theoretical and computational points of view (see the monographs of Dempe [1] and Bard [2] and the reviews by Vicente and Calamai [3], Dempe [4] and Colson et al. [5]). In the last two decades, many papers have been published about bilevel optimization, however, there are only very few of them dealing with the bilevel multiobjective programming (BMP) problem, where the upper level or the lower level or both of a bilevel decision have multiple conflicting objectives [6–8].
Although solving the bilevel multiobjective programming problem is not an easy task, some researchers have presented feasible approachers for this problem. Shi and Xia [9, 10] propose an interactive algorithm based on the concepts of satisfactoriness and direction vector for the nonlinear bilevel multiobjective problem. Abo-Sinna [11], Osman [12] present some approaches via fuzzy set theory for solving bilevel and multiple level multiobjective problems, and Teng and Li [13] and Deb and Sinha [14] give evolutionary algorithms for some bilevel multiobjective programming problems. Besides, for the so-called semivectorial bilevel optimization problem, Bonnel and Morgan [15] construct the penalized problem by the marginal function of the lower level problem and propose the penalty function algorithm. However, no numerical result is reported. Based on the objective penalty function approach for the single level programs, Zheng and Wan [16] propose the corresponding penalty function algorithm, which contains two penalty parameters. A recent study by Eichfelder [8] suggests a refinement-based strategy in which the algorithm starts with a uniformly distributed set of points on upper level variable. Noted that if the dimension of upper level variable is high, generating a uniformly spread upper level variables and refining the resulting upper level variable will be computationally expensive.
The linear bilevel multiobjective programming (LBMP) problem, i.e., both the objective functions and the constraint functions are linear functions, has attracted more and more attention. Nishizaki and Sakawa [17] give three Stackelberg solution definitions and propose the corresponding algorithms based on the idea of the Kth best method. However, they do not give the numerical results. Ankhili and Mansouri [18] propose an exact penalty function algorithm based on the marginal function of lower level problem for the LBMP problem, where the upper level is a linear scalar optimization problem and the lower level is a linear multiobjective optimization problem. Calvete and Gale [19] analyze the characters of the feasible region and give some algorithms frame for the LBMP problem, where the upper level is a linear multiobjective optimization problem and the lower level is a linear scalar optimization problem.
In this paper, inspired by the method presented in [20, 21] for the linear bilevel single objective programming problem, we propose an exact penalty algorithm for the LBMP problem, where both the upper level and the lower level are linear multiobjective optimization problems. There are few reports on using exact penalty approach for solving the above LBMP problem. Our strategy can be outlined as follows. By using the weighted sum scalarization approach, we reformulate the LBMP problem as a special bilevel programming problem, where the upper level is a linear multiobjective programming problem and the lower level is a linear scalar optimization problem. Then the duality gap of the lower level problem is appended to the objectives of the upper level problem with a penalty, and a penalized problem for the LBMP is obtained. We prove that the penalty function is exact, and an exact penalty function algorithm is proposed for the LBMP. In addition, for the LBMP problem with given weights for the upper level objective functions, we analyze the optimality conditions and propose a special algorithm. Finally, we give some numerical examples to illustrate the algorithm proposed in this paper.
The remainder of the paper is organized as follows. In the next section we give the mathematical model of the LBMP problem and construct the penalized problem. In Section 3, we analyze the characters of the penalized problem and give via an exact penalty method an existence theorem of Pareto optimal solutions. In Section 4, we propose the algorithm and give the numerical results. Finally, we conclude the paper with some remarks.
2 Linear bilevel multiobjective programming problem and penalized problem
- (A)
The constraint region S is nonempty and compact.
Definition 2.1
A point \((x,y)\) is feasible for problem (1) if \((x,y)\in S\) and \(y\in S(x)\); the term \((x^{*},y^{*})\) is a Pareto optimal solution to problem (1), provided that it is a feasible point and there exists no other feasible point \((x,y)\) such that \(Cx^{*}+C'y^{*}\leq Cx+C'y\).
Remark 2.1
Note that in problem (1) the objective function of the upper level is maximized with regard to x and y, that is, in this work we adopt the optimistic approach to consider the bilevel multiobjective programming problem [8].
For any given parameter couple \((x,\lambda)\in\Pi_{y}\times\Omega\), let \(\gamma(x,\lambda)\) denote the solution set of problem (2). The following relationship (see, e.g., Theorem 3.1 in [22]) relates the solution set of \((P_{x})\) and that of problem (2).
Proposition 2.1
The link between problem (1) and (4) will be formalized in the following proposition.
Proposition 2.2
- (i)
Let \((\bar{x},\bar{y})\) be a Pareto optimal solution of problem (1). Then for all \(\bar{\lambda}\in\Omega\) with \(\bar{y}\in\gamma(\bar {x},\bar{\lambda})\), the point \((\bar{x},\bar{y},\bar{\lambda})\) is a Pareto optimal solution of problem (4).
- (ii)
Let \((\bar{x},\bar{y},\bar{\lambda})\) be a Pareto optimal solution of problem (4). Then \((\bar{x},\bar{y})\) is a Pareto optimal solution of problem (1).
Proof
Following Proposition 2.1, we have \(y'\in S(x')\), i.e. \((x',y')\) is also a feasible point of problem (1). That means that there exists a feasible point \((x',y')\) of problem (1), such that (5) is satisfied. It contradicts that \((\bar{x},\bar{y})\) is a Pareto optimal solution of problem (1).
Let \(\pi(x,y,\lambda,w)=w^{T}(b-A_{1}x)-\lambda^{T}Dy\) denote the duality gap of the lower level problem, if \(\pi(x,y,\lambda,w)\) is equal to zero, the optimal solution of the lower level problem would be reached.
3 Main results
We will now analyze the main theoretical result, i.e., the exactness of the penalty function approach, which means we can get the Pareto optimal solutions of problem (1) by solving the penalized problem (9) for some finite positive constant K.
Before presenting some theoretical results, we introduce some useful notations first. Let \(Z=\{(x,y)\mid A_{1}x+A_{2}y\leq b,x\geq0,y\geq 0\}\), \(W=\{(\lambda,w)\mid \sum_{i=1}^{l}\lambda_{i}=1, w^{T}A_{2}\geq \lambda^{T}D, \lambda\geq0, w\geq0\}\), and we denote the extreme points of W and Z by \(W_{v}\) and \(Z_{v}\), respectively.
Theorem 3.1
Proof
Note that for fixed \((\lambda,w)\) and K, problem (10) is a linear multiobjective programming problem, then Theorem 3.1 is obvious. □
Theorem 3.1 yields the following theorem.
Theorem 3.2
For fixed K, a Pareto optimal solution to problem (9) is achievable in \(Z_{v}\times W_{v}\) and \(Z_{v}\times W_{v}=(Z\times W)_{v}\).
Proof
The above theorem is based on a fixed value of K. We now show that a finite value of K would yield an exact Pareto optimal solution to the overall problem (9), where the penalty term \(w^{T}(b-A_{1}x)-\lambda^{T}Dy\) becomes zero.
Theorem 3.3
There exists a finite value of K, \(K^{*}\) say, for which the Pareto optimal solution \((x,y,\lambda,w)\) to the penalty function problem (9) satisfies \(w^{T}(b-A_{1}x)-\lambda^{T}Dy=0\).
Proof
Suppose \((x^{*},y^{*},\lambda^{*})\) is the Pareto optimal solution to problem (4), i.e. the linear bilevel multiobjective problem, then the optimality conditions of the lower level problem are satisfied. That means \((w^{*})^{T}(b-A_{1}x^{*})-(\lambda^{*})^{T}Dy^{*}=0\).
We now show that, by increasing K monotonically, we can achieve the Pareto optimal solutions of the linear bilevel multiobjective programming problem (4).
Theorem 3.4
There exists some \(K^{*}\geq0\), such that for all \(K\geq K^{*}\), the Pareto optimal solution \((x,y,\lambda,w)\) to problem (9) is also a Pareto optimal solution to problem (4).
Proof
4 Algorithm and numerical results
Following the above results, we know that we can obtain the Pareto optimal solution of problem (1) by solving the penalized problem (9). Then we can propose the following exact penalty function algorithm for the linear bilevel multiobjective programming problem (1).
Original algorithm
Step 0. Choose an initial point \((x^{0},y^{0},\lambda^{0},w^{0})\in W_{v}\times Z_{v}\), a positive constant \(K>1\) and stopping tolerance \(\epsilon>0\), and set \(k:=0\).
Step 1. Find a Pareto optimal solution \((x^{k},y^{k},\lambda ^{k},w^{k})\) of problem (9).
Step 2. If \((w^{k})^{T}(b-A_{1}x^{k})-(\lambda^{k})^{T}Dy^{k}\leq \epsilon\), stop, a Pareto optimal solution is obtained; else go to Step 3.
Step 3. Set \((x^{k+1},y^{k+1},\lambda^{k+1},w^{k+1}):=(x^{k},y^{k},\lambda^{k},w^{k})\), \(k:=k+1\), \(K:=2K\), and go to Step 1.
The following theorem states the convergence of the above algorithm.
Theorem 4.1
Let assumption (A) be satisfied, then the last point in the sequence \((x^{k},y^{k},\lambda^{k})\), which is generated by the original algorithm, is a Pareto optimal solution to problem (4).
Proof
Following Theorem 3.3, we know that the penalty function is exact. Then it means that the sequence \((x^{k},y^{k},\lambda^{k})\), which is generated by the above algorithm, is finite. Let \((x^{*},y^{*},\lambda^{*})\) be the last point in the sequence \((x^{k},y^{k},\lambda^{k})\). Following Theorem 3.4, it is obvious that \((x^{*},y^{*},\lambda^{*})\) is a Pareto optimal solution to problem (4). □
It is clear that we can obtain the Pareto optimal front of problem (1) by solving problem (9) using some appropriate approaches. In the following, we consider the situation that the decision maker gives the positive weights for the upper level objective functions, and propose a special algorithm for this problem.
Let \(Q(\lambda,w,K)=\max_{(x,y)\in Z}[\mu ^{T}(Cx+C'y)-K(w^{T}(b-A_{1}x)-\lambda^{T}Dy)]\), we have the following result.
Theorem 4.2
Proof
Following Theorem 4.2, if \(\alpha(\tilde{\lambda},\tilde{w})=\min _{(\lambda,w)\in W}[(w-\tilde{w})^{T}(b-A_{1}x)-(\lambda-\tilde{\lambda })^{T}Dy]<0\), then \((\tilde{\lambda},\tilde{w})\neq(\lambda ^{*},w^{*})\in\arg\max\{Q(\lambda,w,K):(\lambda,w)\in W\}\).
Based on the above analysis, we can propose an algorithm for solving the special problem (13).
Weights algorithm
Step 0. Give the weights \(\mu=(\mu_{1},\ldots,\mu_{q})^{T}\in R_{+}^{q}\) with \(\sum_{i=1}^{q}\mu_{i}=1\) for the upper level objective functions, and choose an initial point \((\lambda^{0},w^{0})\in W_{v}\), a positive constant \(K>1\), and stopping tolerance \(\epsilon>0\), and set \(k:=0\).
Step 1. Solve \(\max_{(x,y)\in Z}\mu ^{T}(Cx+C'y)-K((w^{k})^{T}(b-A_{1}x)-(\lambda^{k})^{T}Dy)\) and we obtain the optimal solution \((x^{k},y^{k})\).
Step 2. Solve \(\alpha(\lambda^{k},w^{k})=\min_{(\lambda,w)\in W}[(w-w^{k})^{T}(b-A_{1}x^{k})-(\lambda-\lambda^{k})^{T}Dy^{k}]\), and obtain the optimal solution \((\lambda^{*},w^{*})\).
- (1)
If \(\alpha(\lambda^{k},w^{k})<0\), then \((\lambda ^{k+1},w^{k+1})=(\lambda^{*},w^{*})\), \(k:=k+1\), go to Step 1.
- (2)
If \(\alpha(\lambda^{k},w^{k})\geq0\) and \((w^{k})^{T}(b-A_{1}x^{k})-(\lambda^{k})^{T}Dy^{k}>\epsilon\), then \(K:=2K\), \(k:=k\), go to Step 1.
- (3)
If \(\alpha(\lambda^{k},w^{k})\geq0\) and \((w^{k})^{T}(b-A_{1}x^{k})-(\lambda^{k})^{T}Dy^{k}<\epsilon\), then the optimal solution to problem (13) is \((x^{k},y^{k},\lambda^{k},w^{k})\).
To illustrate the weights algorithm, we solve the following linear bilevel multiobjective programming problem using the above algorithm.
Example 1
[6]
The solution proceeds as follows.
Loop 1
Step 0. Choose the weights \(\mu=(0.5,0.5)^{T}\) for the upper level objective functions, and an initial point \((\lambda ^{0},w^{0})=(1/3,2/3,0,0)^{T}\), a positive constant \(K=100\), and stopping tolerance \(\epsilon=0.01\), and set \(k:=1\).
Step 3. As \(\alpha(\lambda^{0},w^{0})=-\frac{8}{3}<0\), let \((\lambda ^{1},w^{1})=(1,0,0,0)^{T}\), \(k:=1\), go to Step 1.
Loop 2
Step 3. \(\alpha(\lambda^{1},w^{1})=0\), and \((w^{1})^{T}(b-A_{1}x^{1})-(\lambda^{1})^{T}Dy^{1}=0<0.01\). Then the Pareto optimal solution of Example 1 to the weights \(\mu=(0.5,0.5)^{T}\) is \((x,y,\lambda,w)=(0,0,1.0,0,0,0)^{T}\).
It is noted that in [6], a Pareto optimal solution to Example 1 is \((x,y)=(0,0.5)^{T}\), and the upper level objective value is \(F(x,y)=(1,-2)^{T}\). However, in this paper the Pareto optimal solution of Example 1 is \((x,y)=(0,0)^{T}\) obtained by the weights algorithm, and the corresponding upper level objective function value is \(F(x,y)=(0,0)^{T}\). Following the vector partial order, it is obvious that the optimal solution \((x,y)=(0,0)\) obtained here is a Pareto optimal solution to Example 1. It is shown that the weights algorithm is feasible to the linear bilevel multiobjective programming problem.
To further show the viability of the weights algorithm proposed, we consider the following two examples.
Example 2
[6]
Example 3
[24]
Results in this paper comparing with the references
Examples in this paper | The Pareto optimal solution and the upper level objective value obtained in this paper | The Pareto optimal solution and the upper level objective value given in the references |
---|---|---|
Example 2 | \((x^{*},y^{*})=(144.2,26.8,2.97,67.7,0)\) | \((x^{*},y^{*})=(146.30,28.94,0,67.93,0)\) |
\(F(x^{*},y^{*})=(482.7,1\mbox{,}831.4)\) | \(F(x^{*},y^{*})=(474.7,1\mbox{,}850.1)\) | |
Example 3 | \((x^{*},y^{*})=(0.6,2.4,0,0)\) | \((x^{*},y^{*})=(1.5,1.5,4.1,3.4)\) |
\(F(x^{*},y^{*})=(5.4,4.2)\) | \(F(x^{*},y^{*})=(4.5,6.0)\) |
5 Conclusion
In this paper, we introduce a new exact penalty function method for solving a linear bilevel multiobjective programming problem. The method is based on appending the duality gap of the lower level problem to the upper level objectives with a penalty. The numerical results reported illustrated that the exact penalty function method introduced in this paper can be numerically efficient.
It is noted that, besides its theoretical properties, the original algorithm proposed in this paper has one distinct advantage: it only requires the use of practicable algorithms for solving the smooth multiobjective optimization problems, no other complex operations are necessary. In addition, for the LBMP problem with given upper level objective functions weights, using the weights algorithm proposed we only need to solve a series of linear programming problems to obtain the Pareto optimal solutions.
Declarations
Acknowledgements
The authors thank the editor Rachel for the suggestions on maintaining the integrity of this paper. The work is supported by the Nature Science Foundation of China (Nos. 11201039, 71471140, 61273179).
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- Dempe, S: Foundations of Bilevel Programming. Kluwer, Dordrecht (2002) MATHGoogle Scholar
- Bard, J: Practical Bilevel Optimization: Algorithm and Applications. Kluwer, Dordrecht (1998) MATHView ArticleGoogle Scholar
- Vicente, L, Calamai, P: Bilevel and multilevel programming: a bibliography review. J. Glob. Optim. 5(3), 291-306 (1994) MATHMathSciNetView ArticleGoogle Scholar
- Dempe, S: Annotated bibliography on bilevel programming and mathematical programs with equilibrium constraints. Optimization 52(3), 333-359 (2003) MATHMathSciNetView ArticleGoogle Scholar
- Colson, B, Marcotte, P, Savard, G: An overview of bilevel optimization. Ann. Oper. Res. 153, 235-256 (2007) MATHMathSciNetView ArticleGoogle Scholar
- Zhang, G, Lu, J, Dillon, T: Decentralized multi-objective bilevel decision making with fuzzy demands. Knowl.-Based Syst. 20(5), 495-507 (2007) View ArticleGoogle Scholar
- Ye, J: Necessary optimality conditions for multiobjective bilevel programs. Math. Oper. Res. 36(1), 165-184 (2011) MATHMathSciNetView ArticleGoogle Scholar
- Eichfelder, G: Multiobjective bilevel optimization. Math. Program. 123, 419-449 (2010) MATHMathSciNetView ArticleGoogle Scholar
- Shi, X, Xia, H: Interactive bilevel multiobjective decision making. J. Oper. Res. Soc. 48(9), 943-949 (1997) MATHView ArticleGoogle Scholar
- Shi, X, Xia, H: Model and interactive algorithm of bilevel multiobjective decision making with multiple interconnected decision makers. J. Multi-Criteria Decis. Anal. 10, 27-34 (2004) View ArticleGoogle Scholar
- Abo-Sinna, M: A bilevel nonlinear multiobjective decision making under fuzziness. J. Oper. Res. Soc. Ind. 38(5), 484-495 (2001) MATHMathSciNetGoogle Scholar
- Osman, M, Abo-Sinna, M, et al.: A multilevel nonlinear multiobjective decision making under fuzziness. Appl. Math. Comput. 153(1), 239-253 (2004) MATHMathSciNetView ArticleGoogle Scholar
- Teng, C, Li, L: A class of genetic algorithms on bilevel multiobjective decision making problem. J. Syst. Sci. Syst. Eng. 9(3), 290-296 (2000) MathSciNetGoogle Scholar
- Deb, K, Sinha, A: Solving bilevel multi-objective optimization problems using evolutionary algorithms. Lect. Notes Comput. Sci. 5467, 110-124 (2009) View ArticleGoogle Scholar
- Bonnel, H, Morgan, J: Semivectorial bilevel optimization problem: penalty approach. J. Optim. Theory Appl. 131(3), 365-382 (2006) MATHMathSciNetView ArticleGoogle Scholar
- Zheng, Y, Wan, Z: A solution method for semivectorial bilevel programming problem via penalty method. J. Appl. Math. Comput. 37, 207-219 (2011) MATHMathSciNetView ArticleGoogle Scholar
- Nishizaki, I, Sakawa, M: Stackelberg solutions to multiobjective two-level linear programming problem. J. Optim. Theory Appl. 103(1), 161-182 (1999) MATHMathSciNetView ArticleGoogle Scholar
- Ankhili, Z, Mansouri, A: An exact penalty on bilevel programs with linear vector optimization lower level. Eur. J. Oper. Res. 197, 36-41 (2009) MATHMathSciNetView ArticleGoogle Scholar
- Calvete, HI, Gale, C: Linear bilevel programs with multiple objectives at the upper level. J. Comput. Appl. Math. 234, 950-959 (2010) MATHMathSciNetView ArticleGoogle Scholar
- Anandalingam, G, White, DJ: A solution for the linear static Stackelberg problem using penalty function. IEEE Trans. Autom. Control 38(5), 484-495 (2001) Google Scholar
- Lv, YB, Hu, T, Wang, G, Wan, Z: A penalty function method based on Kuhn-Tucker condition for solving linear bilevel programming. Appl. Math. Comput. 188, 808-813 (2007) MATHMathSciNetView ArticleGoogle Scholar
- Dempe, S, Gadhi, N, Zemkoho, AB: New optimality conditions for the semivectorial bilevel optimization problem. J. Optim. Theory Appl. 157, 54-74 (2013) MATHMathSciNetView ArticleGoogle Scholar
- White, DJ: Multiobjective programming and penalty function. J. Optim. Theory Appl. 43(4), 583-600 (1984) MATHMathSciNetView ArticleGoogle Scholar
- Pieume, CO, Marcotte, P, Fotso, LP: Solving bilevel linear multiobjective programming problems. Amer. J. Oper. Res. 1, 214-219 (2011) View ArticleGoogle Scholar