- Research
- Open access
- Published:
A preconditioning method of the CQ algorithm for solving an extended split feasibility problem
Journal of Inequalities and Applications volume 2014, Article number: 163 (2014)
Abstract
In virtue of preconditioning technology, we propose a preconditioning CQ algorithm for an extend split feasibility problem (ESFP). Comparing with the others, the proposed algorithm can get faster convergence without considering to adjust the stepsize. The convergence is also established under mild conditions. Several extensions of the preconditioning CQ algorithm are presented. Moreover, we present an approximate variable preconditioner which does not compute the matrix inverse. Finally, some numerical experiments show the better behaviors of the proposed methods.
MSC:47J10, 47J20, 65B05.
1 Introduction
The problem to find with , if such x exists, was called the split feasibility problem (SFP) by Censor and Elfving [1], where and are nonempty closed convex sets, and A is an M by N matrix. This problem plays an important role in the study of signal processing, image reconstruction, and so on [2, 3]. Censor and Elfving’s algorithm in [1], as well as others obtained later [4, 5] involve matrix inverses at each step. Byrne [6] presented a method called the CQ algorithm for solving the SFP that does not involve matrix inverses.
The CQ algorithm Let be arbitrary. For , calculate
where and L denotes the largest eigenvalue of the matrix , I is the identical matrix. and are the orthogonal projections onto C and Q, respectively.
In recent years, how to modify the CQ algorithm so that it can easily be implemented and converge faster is the hot topic. The typical modifications are as follows: Yang [7] presented a relaxed CQ algorithm for solving the SFP, then the orthogonal projections onto halfspaces and can be executed exactly. Qu and Xiu [8] proposed the modified relaxed algorithm which does not need to compute the largest eigenvalue of the matrix and can get an adaptive stepsize by adopting an Armijo-like search. The paper [9] extended the algorithm in [10] and proposed a relaxed inexact projection method for the SFP. Xu [11] extended the problem into infinite-dimensional Hilbert spaces, and modified the CQ algorithm with Mann’s iteration. In [12], López et al. presented a variable stepsize, and improved the algorithm with a Halpern-type iteration.
However, using preconditioning technology to accelerate the CQ algorithm not only has not been taken into account, but also one will obtain a special effect. In this paper, we consider to modify the CQ algorithm from the views of fixed point and variational inequality. Combining with the appropriate preconditioner, the SFP can be transformed into an extended split feasibility problem (ESFP). Naturally, a preconditioning CQ algorithm for solving the ESFP can also solve the SFP indirectly.
The rest of the paper is organized as follows. In Section 2, we review some concepts and existing results. In Section 3, we propose a preconditioning CQ algorithm for solving ESFP and establish its convergence. Several extensions are presented in Section 4. In Section 5, we discuses the methods how to estimate the approximate inverse preconditioner. In Section 6, we report some computational results with the proposed algorithm and methods. Finally, Section 7 gives some concluding remarks.
2 Preliminaries
Our argument mainly depends on monotone operators, nonexpansive mappings, and the metric projections.
Definition 2.1 [13]
Let T be a mapping from a set into itself. Then
-
(i)
T is said to be monotone on C, if
-
(ii)
a mapping is nonexpansive if
We denote by the set of fixed points of T; that is, . Note that is always closed and convex (but maybe empty).
The metric projection from onto C is the mapping , which assigns to each point the unique point satisfying the property
where is the 2-norm.
The following properties of projections are useful and pertinent to our purpose.
Lemma 2.1 [13]
Given
Consequently, is nonexpansive and monotone, and is also nonexpansive, then
Lemma 2.2 For
Lemma 2.3 [14]
Let , where .
-
(i)
U is an averaged operator; i.e. there exist some and a nonexpansive operator V, .
-
(ii)
, then .
Proposition 2.1 [15]
For every , let , and be defined as in [7]. Then for any and we have
and
3 The preconditioning CQ algorithm
Stand [16] and Piana and Bertero [17] have applied the preconditioning matrix technologies to improve the Landweber and projected Landweber algorithms. The analyses deal with the operators A and , which are based on the singular value decomposition and a more general spectrum, respectively. We can also extend the technologies to improve the CQ algorithm.
As the SFP is to find a point , with . Firstly, we set , . From Lemma 2.3, (1) can be depicted from the view of fixed point,
Assume that , i.e. the SFP has a nonempty solution set, and is the solution of SFP. Thus, we have
so
Then let be a symmetrical positive definite matrix, and . Referring to (9), we can deduce that
or
Then also has the same properties of U in Lemma 2.3, and we can obtain
Now we present a new algorithm, which is named a preconditioning CQ algorithm (PCQ).
Algorithm 3.1 Let be a symmetrical positive definite matrix, be arbitrary. For , calculate
where , .
Algorithm 3.1 is to solve an extended SFP (ESFP), which can be represented as follows.
Definition 3.1 Let C and Q be nonempty closed convex sets in and , respectively, and A is an M by N matrix, D is an N by N symmetrical positive definite matrix, the ESFP is to find with . We denote the solution set of ESFP by G.
Remark 3.1 If we set , then , the problem in Definition 3.1 is transformed into SFP.
Remark 3.2 If we set D is an unit matrix, then to find with , the problem in Definition 3.1 is transformed into SFP.
From Remark 3.1 we know that the SFP is to minimize the equation
Substituting into (13), its gradient operator is
While and , we also have
where is the solution set of the extended SFP. We can obtain the following variational inequality:
Therefore, we have the next constrained least-squares problem:
The following immediately follows.
Theorem 3.1 Assume , then , if and only if , if and only if , , where
As , from (12) we have
In order to establish the convergence of Algorithm 3.1, we need the following theorem.
Theorem 3.2 Assume that , then
-
(i)
;
-
(ii)
.
Proof As , , we have .
Firstly, we prove . For , then and , we have . So
Therefore, .
Secondly, we prove .
As , we choose , then and , so .
For , we have . From the properties of a projection, we can deduce
therefore,
then , and .
We obtain , thus (i) is proved.
We can also deduce that . □
Theorem 3.3 Assume , , , the sequence is generated by (15), there exists .
Proof Firstly, we show that if , the operator
is nonexpansive.
For , from (4) and (6) we have
therefore,
Next, we can easily obtain , and we set
From (16) we deduce that
and V is nonexpansive, hence, while , is an averaged nonexpansive operator.
Finally, we choose , where and . We have . From (7), we have
which implies that is monotonically decreasing and hence . Specially, is bounded.
From (19) we can deduce that
as , we have .
Let be an arbitrary cluster point of the sequence . Then there exists a subsequence , then (). As , , and . Because V is nonexpansive and continuous, then ().
As , we have , then . Therefore, , from Theorem 3.2, we have . However, exists, and there exists a subsequence of s.t. (), therefore, there must be (). □
4 Several extensions of the preconditioning CQ algorithm
In virtue of kinds of CQ-like algorithms for solving the SFP, we can also deduce the following meaningful results for solving the ESFP without proof.
According to the relaxed CQ algorithm [7], we firstly obtain the relaxed projection method.
Algorithm 4.1 Let be a symmetrical positive definite matrix, be arbitrary. For , calculate
where , .
Theorem 4.1 Let be a sequence generated by the relaxed preconditioning CQ algorithm. Then converges to a solution of ESFP.
Next, from the papers [8] and [14], define by
and we can obtain an adaptive algorithm with strong convergence.
Algorithm 4.2 Let be a symmetrical positive definite matrix, given constants , , . Let be arbitrary, for , let
where and is the smallest nonnegative integer m such that
Set
where is a real sequence in that satisfies conditions (C1) ; and (C2) .
Lemma 4.1 For all , is Lipschitz continuous on with constant L and co-coercive on with modulus , where L is the largest eigenvalue of the matrix . Therefore, the Armijo-like search rule (22) is well defined.
Lemma 4.2 For all , .
Theorem 4.2 Let be a sequence generated by Algorithm 4.2. If the solution set of the SFP is nonempty, then converges strongly to a solution of the ESFP.
As there exists an Armijo-like search step in Algorithm 4.2, the complexity of the implementation will be increased. Next, we propose a new variable stepsize to improve Algorithm 3.1.
Algorithm 4.3 Let be a variable symmetrical positive definite matrix, . For , calculate
where , L is the largest eigenvalue of , is the minimum value of all the largest eigenvalues of , for . Specially, set .
5 Approximating a variable preconditioner
In the above algorithms, the preconditioner D is continuous, positive definite and bounded so that it has a continuous inverse [17]. According to the preconditioning CQ algorithm, we set D commutes with the operator . Therefore, we set a matrix function F with positive value, and its dimension should be consistent with . Moreover, F should have a positive lower bound in order to satisfy the existing inverse. Strand [16] also assumes that F is a polynomial or a rational function. Thus, the operator D is given by
Assume is existed, the product is without restrictions in (10), we can deduced that sometimes D should be chose close to as more as possible.
The best condition is to calculate exactly, but it is always hard with the signal and image reconstruction problems. If F be a polynomial function, Stand [16] have provided an example with seventh-order, and Neumann’s series approach can also express . However, the polynomial method needs to calculate the high order matrix multiplication, therefore, it can not be implemented easily.
If we choose F be a rational function, a simple example, closely related to the Tikhonov regularization method has been used in [17]. According to the example, the approximate inverse preconditioner D can be given by
where Re denotes the real part, α is a positive real parameter, and good choices of α may be much smaller than the values provided by the methods used for estimating optimum values of the Tikhonov regularization parameter.
As (26) involves the matrix inverse, we next propose a diagonal format of D that does not calculate matrix inverses. Furthermore, the choice of D is related to the convergence properties of the algorithm. If D is evolutive following the iterations, the convergence rate of algorithm will also be accelerated.
From (10), we can deduce that
As D should be chosen closely to , we assume λ is the approximate eigenvalue matrix of , and then we set
Therefore, we can obtain the approximate variable preconditioners with respect to on the th iteration:
Then we can also get the approximate variable preconditioners with respect to on the th iteration:
Otherwise, a variable stepsize in Algorithm 4.3 can be estimated. Set is the largest eigenvalue of , , on the k th iteration, we have . Then set , the minimum eigenvalue of , , on the k th iteration, we have . Therefore, a variable stepsize with respect to Algorithm 4.3 can be approximated by
6 Numerical results
In this section, we present some numerical results for the proposed method. The following three examples are taken from the test problems in [15]. For Examples 6.2 and 6.3, we should first transform into the ESFP. The stopping criterion is , and we took , , . The projections are computed by Proposition 2.1.
Algorithm 4.1 was implemented in the Matlab R2011b (Windows version) programming environment. The codes were ran on a PC with 1.98 GB memory and Intel(R) Pentium(R) dual-core CPU G630 running at 2.69 GHz. The iteration numbers and the computational time for the methods in Section 5 with different starting points are given in Tables 1, 2, and 3, all CPU times reported are in seconds.
Example 6.1 (A convex feasibility problem, CFP)
Let , . Find some point x in .
Example 6.2 (A split feasibility problem)
Let , , . Find with .
Example 6.3 (A split feasibility problem)
Let , , . Find with .
Compared with the results in [15], we can obtain:
-
(1)
For the CFP, as , the relaxed preconditioning method played a role inconspicuously.
-
(2)
For the SFP, the results are better than the ones in [15], and when A is not sparse the effect is obvious.
7 Conclusions
In this paper, by adopting the preconditioning techniques, a modified CQ algorithm is named preconditioning CQ algorithm, and its extensions for solving the ESFP have been presented. The approximate methods for how to estimate the preconditioner D are also discussed; the approximate diagonal preconditioner method does not need to compute the matrix inverses and the largest eigenvalue of the matrix . Thus, the algorithm can be implemented easily. Moreover, the corresponding convergence property has been established in the feasible case of ESFP. The numerical results showed that the proposed algorithms and methods are effective to solve some problems.
References
Censor Y, Elfving T: A multiprojection algorithm using Bregman projections in a product space. Numer. Algorithms 1994, 8: 221-239. 10.1007/BF02142692
Bauschke HH, Borwein JM: On projection algorithms for solving convex feasibility problems. SIAM Rev. 1996, 38: 367-426. 10.1137/S0036144593251710
Byrne CL: A unified treatment of some iterative algorithms in signal processing and image reconstruction. Inverse Probl. 2004, 20: 103-120. 10.1088/0266-5611/20/1/006
Byrne CL: Iterative projection onto convex sets using multiple Bregman distances. Inverse Probl. 1999, 15: 1295-1313. 10.1088/0266-5611/15/5/313
Byrne CL: Bregman-Legendre multidistances projection algorithm for convex feasibility and optimization. In Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications. Edited by: Butnariu D, Censor Y, Reich S. Elsevier, Amsterdam; 2001:87-100.
Byrne CL: Iterative oblique projection onto convex sets and the split feasibility problem. Inverse Probl. 2002, 18: 441-453. 10.1088/0266-5611/18/2/310
Yang QZ: The relaxed CQ algorithm solving the split feasibility problem. Inverse Probl. 2004, 20: 1261-1266. 10.1088/0266-5611/20/4/014
Qu B, Xiu N: A note on the CQ algorithm for the split feasibility problem. Inverse Probl. 2005, 21: 1655-1665. 10.1088/0266-5611/21/5/009
Wang Z, Yang Q: The relaxed inexact projection methods for the split feasibility problem. Appl. Math. Comput. 2011, 217: 5347-5359. 10.1016/j.amc.2010.11.058
Yang Q, Zhao J: The projection-type methods for solving the split feasibility problem. Math. Numer. Sin. 2006, 28: 121-132. (in Chinese)
Xu HK: Iterative methods for the split feasibility problem in infinite-dimensional Hilbert spaces. Inverse Probl. 2010, 26: 1-17.
López G, Martín-Márquez V, Wang F, Xu H-K: Solving the split feasibility problem without prior knowledge of matrix norms. Inverse Probl. 2012, 28: 1-18.
Zarantonello EH: Projections on convex sets in Hilbert space and spectral theory. In Contributions to Nonlinear Functional Analysis. Edited by: Zarantonello EH. Academic Press, New York; 1971.
Wang F, Xu HK: Approximating curve and strong convergence of the CQ algorithm for the split feasibility problem. J. Inequal. Appl. 2010., 2010: Article ID 102085
Abdellah B, Muhammad AN: On descent-projection method for solving the split feasibility problems. J. Glob. Optim. 2012, 54: 627-639. 10.1007/s10898-011-9782-2
Strand ON: Theory and methods related to the singular-function expansion and Landweber’s iteration for integral equations of the first kind. SIAM J. Numer. Anal. 1974, 11: 798-825. 10.1137/0711066
Piana M, Bertero M: Projected Landweber method and preconditioning. Inverse Probl. 1997, 13: 441-463. 10.1088/0266-5611/13/2/016
Acknowledgements
The authors would like to thank the associate editor and the referees for their comments and suggestions. This research was supported by the National Natural Science Foundation of China (11071053).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
Both authors take equal roles in deriving results and writing of this paper. Both authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Wang, P., Zhou, H. A preconditioning method of the CQ algorithm for solving an extended split feasibility problem. J Inequal Appl 2014, 163 (2014). https://doi.org/10.1186/1029-242X-2014-163
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1029-242X-2014-163