- Research Article
- Open Access
Hybrid Steepest-Descent Methods for Solving Variational Inequalities Governed by Boundedly Lipschitzian and Strongly Monotone Operators
Fixed Point Theory and Applications volume 2010, Article number: 673932 (2010)
Let be a real Hilbert space and let be a boundedly Lipschitzian and strongly monotone operator. We design three hybrid steepest descent algorithms for solving variational inequality of finding a point such that , for all , where is the set of fixed points of a strict pseudocontraction, or the set of common fixed points of finite strict pseudocontractions. Strong convergence of the algorithms is proved.
Let be a real Hilbert space with the inner product and the norm , let be a nonempty closed convex subset of and let be a nonlinear operator. We consider the problem of finding a point such that
This is known as the variational inequality problem (i.e., initially introduced and studied by Stampacchia  in 1964. In the recent years, variational inequality problems have been extended to study a large variety of problems arising in structural analysis, economics, optimization, operations research, and engineering sciences; see [1–6] and the references therein.
Yamada  proposed hybrid methods to solve , where is composed of fixed points of a nonexpansive mapping; that is, is of the form
where is a nonexpansive mapping (i.e., for all ), is Lipschitzian and strongly monotone.
He and Xu  proved that has a unique solution and iterative algorithms can be devised to approximate this solution if is a boundedly Lipschitzian and strongly monotone operator and is a closed convex subset of . In the case where is the set of fixed points of a nonexpansive mapping, they invented a hybrid iterative algorithm to approximate the unique solution of and this extended the Yamada's results.
The main purpose of this paper is to continue our research in . We assume that is a boundedly Lipschitzian and strongly monotone operator as in , but is the set of fixed points of a strict pseudo-contraction , or the set of common fixed points of finite strict pseudo-contractions . For the two cases of , we will design the hybrid iterative algorithms for solving and prove their strong convergence, respectively. Relative definitions are stated as below.
Let be a nonempty closed and convex subset of a real Hilbert space , and , then
(1) is called Lipschitzian on , if there there exists a positive constant such that
(2) is called boundedly Lipschitzian on , if for each nonempty bounded subset of , there exists a positive constant depending only on the set such that
(3) is said to be -strongly monotone on , if there exists a positive constant such that
(4) is said to be a -strict pseudo-contraction if there exists a constant such that
Obviously, the nonexpansive mapping class is a proper subclass of the strict pseudo-contraction class and the Lipschitzian operator class is a proper subclass of the boundedly Lipschitzian operator class, respectively.
We will use the following notations:
(i) for weak convergence and for strong convergence,
(ii) denotes the weak -limit set of
(iii) denotes a closed ball with center and radius .
We need some facts and tools which are listed as lemmas below.
Let be a real Hilbert space. The following expressions hold:
Lemma 2.2 (see ).
Assume that is a sequence of nonnegtive real numbers satisfying the property
If and satisfy the following conditions:
Lemma 2.3 (see ).
Let be a nonempty closed convex subset of a real Hilbert space and is a nonexpansive mapping. If a one has sequence in such that and then
Lemma 2.4 (see ).
Let be a nonempty closed convex subset of a real Hilbert space , if is a -strict pseudo-contraction, then the mapping is demiclosed at 0. That is, if is a sequence in such that and then
Lemma 2.5 (see ).
Assume that is a nonempty closed convex subset of a real Hilbert space , if is boundedly Lipschitzian and -strongly monotone, then variational inequality (1.1) has a unique solution.
Assume that is a -strict pseudo-contraction, and the constant satisfies Let
then is nonexpansive and
Using Lemma 2.1(i) and the conception of -strict pseudo-contraction, we get
so is nonexpansive. is obvious.
Assume that is a real Hilbert space, is a -strict pseudo-contraction such that and is a boundedly Lipschitzian and -strongly monotone operator. Take arbitrarily and set . Denote by the Lipschitz constant of on and let
where the constants and are such that and , respectively, and is defined as in Lemma 2.6 above. Then restricted to is a contraction.
If , that is, , by Lemma 2.6, we have
It suggests that . Since is Lipschitzian and -strongly monotone on , using Lemma 2.6, we obtain
Therefore, restricted to that is a contraction with coefficient , where
Lemma 2.8 (see ).
Assume is a closed convex subset of a Hilbert space .
(i)Given an integer , assume that for each , is a -strict pseudo-contraction for some . Assume is a positive sequence such that . Then is a -strict pseudo-contraction, with
Let , and be given as in (i) above. Suppose that , then
Assume that is a -strict pseudo-contraction for some let if , then
We prove it by induction. For , set , . Obviously
Now we prove
, if , then the conclusion holds. In fact, we can claim that . From Lemma 2.6, we know that is nonexpansive and Take , then
Since , we get
Namely, that is,
Suppose that the conclusion holds for , we prove that
It suffices to verify
, . Using Lemma 2.6 again, take ,
Since , we have
this implies that
From (2.19) and inductive assumption, we get
Substituting it into (2.19), we obtain Thus we assert that
3. Further Extension of Hybrid Iterative Algorithm
Yamada got the following result.
Theorem 3.1 (see ).
Assume that is a real Hilbert space, is nonexpansive such that and is -strongly monotone and -Lipschitzian. Fix a constant . Assume also that the sequence satisfies the following conditions:
(iii), or .
Take arbitrarily and define by
then converges strongly to the unique solution of .
He and Xu  proved that has a unique solution if is a boundedly Lipschitzian and strongly monotone operator and is a closed convex subset of . Using this result, they were able to relax the global Lipschitz condition on in Theorem 3.1 to the weaker bounded Lipschitz condition and invented a hybrid iterative algorithm to approximate the unique solution of . Their result extended the Yamada's above theorem.
In this section, we mainly focus on further extension of our hybrid algorithm in . Consider , where is composed of fixed points of a -strict pseudo-contraction such that and is still -strongly monotone and boundedly Lipschitzian. Fix a point arbitrarily, set . Denote by the Lipschitz constant of on . Fix the constant satisfying . Assume also that the sequences and satisfy for a constant and , respectively. Let and , define by the scheme:
We have the following result.
If the sequences and satisfy the following conditions:
(iii), , or ,
then generated by (3.2) converges strongly to the unique solution of.
We prove that for all by induction. It is trivial that . Suppose we have proved , that is,
Using Lemma 2.7, We then derive from (3.2) and (3.3) that
However, since and we get
This together with (3.4) implies that
It proves that . Therefore, for all . Thus is bounded. It is not difficult to verify that the sequences and are all bounded.
By (3.2) and Lemma 2.7, we have
where . By Lemma 2.2 and conditions (i)–(iii), we conclude that
Since , it is straitforward from (3.2) that
On the other hand
By the condition and (3.8)–(3.10), we obtain
By Lemma 2.4 and (3.11), we obtain
Lemma 2.5 asserts that has a unique solution . Now we prove that . By Lemma 2.1(ii), (3.2), and Lemma 2.7, we have
Let us show that
In fact, there exists a subsequence such that
Without loss of generality, we may further assume that . Since is the unique solution of , we obtain
Finally conditions (i)–(iii) and (3.14) allow us to apply Lemma 2.2 to the relation (3.13) to conclude that
4. Parallel Algorithm and Cyclic Algorithm
In this section, we discuss the parallel algorithm and the cyclic algorithm, respectively, for solving the variational inequality over the set of the common fixed points of finite strict pseudo-contractions.
Let be a real Hilbert space and a -strongly monotone and boundedly Lipschitzian operator. Let be a positive integer and a -strict pseudo-contraction for some such that We consider the problem of finding such that
Since is a nonempty closed convex subset of , (4.1) has a unique solution. Throughout this section, is an arbitrary fixed point, , is the Lipschitz constant of on , the fixed constant satisfies , and the sequence belongs to .
Firstly we consider the parallel algorithm. Take a positive sequence such that and let
By using Lemma 2.8, we assert that is a -strict pseudo-contraction with and holds. Thus VI(4.1) is equivalent to VI and we can use scheme (3.2) to solve VI(4.1). In fact, taking in the scheme (3.2), we get the so-called parallel algorithm
Using Lemma 2.8 and Thorem 3.2, the following conclusion can be deduced directly.
Suppose that and satisfy the same conditions as in Theorem 3.2. Then the sequence generated by the parallel algorithm (4.3) converges strongly to the unique solution of (4.1).
For each let
where the constant such that . Then we turn to defining the cyclic algorithm as follows:
Indeed, the algorithm above can be rewritten as
where , namely, is one of circularly. For convenience, we denote (4.6) as
We get the following result
If satisfies the following conditions:
then the sequence generated by (4.6) converges strongly to the unique solution of .
We break the proof process into six steps.
. We prove it by induction. Definitely . Suppose , that is,(4.8)
We have from , (4.8), and Lemma 2.7 that
where Observing , we get
This together with (4.9) implies that
It suggests that . Therefore, for all . We can also prove that the sequences , , are all bounded.
By (4.6) and Lemma 2.7, we have(4.12)
where Since satisfies (i)–(iii), using Lemma 2.2, we get
By (4.3) and , we have(4.14)
By Lemma 2.6, is nonexpansive, we obtain
Adding all the expressions above, we get
Using this together with the conclusion of step (2), we obtain
. Assume that such that , we prove . By the conclusion of step (3), we get(4.19)
Observe that, for each is some permutation of the mappings , since are finite, all the full permutation are , there must be some permutation that appears infinite times. Without loss of generality, suppose that this permutation is , we can take a subsequence such that
It is easy to prove that is nonexpansive. By Lemma 2.3, we get
Using Lemmas 2.6 and 2.9, we obtain
In fact, there exists a subsequence such that(4.23)
Without loss of generality, we may further assume that Since is the solution of , we obtain
By (4.6), Lemmas 2.1(ii), and 2.7, we obtain(4.25)
From the conclusion of step (5) and Lemma 2.2, we get
Stampacchia G: Formes bilinéaires coercitives sur les ensembles convexes. Comptes Rendus de l'Académie des Sciences 1964, 258: 4413–4416.
Cottle RW, Giannessi F, Lions JL: Variational Inequalities and Complementarity Problems: Theory and Applications. John Wiley & Sons, New York, NY, USA; 1980.
Fukushima M: Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems. Mathematical Programming 1992,53(1):99–110. 10.1007/BF01585696
Geobel K, Reich S: Uniform Convexity, Nonexpansive Mappings, and Hyperbolic Geometry. Dekker, New York, NY, USA; 1984.
Glowinski R, Lions J-L, Trémolières R: Numerical Analysis of Variational Inequalities, Studies in Mathematics and Its Applications. Volume 8. North-Holland, Amsterdam, The Netherlands; 1981:xxix+776.
He BS: A class of implicit methods for monotone variational inequalities. In Reports of the Institute of Mathematics. Nanjing University, China; 1995.
Yamada I: The hybrid steepest descent method for the variational inequality problem over the intersection of fixed point sets of nonexpansive mappings. In Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, Studies in Computational Mathematics. Volume 8. Edited by: Butnariu D, Censor Y, Reich S. North-Holland, Amsterdam, The Netherlands; 2001:473–504.
He SN, Xu HK: Variational inequalities governed by boundedly Lipschitzian and strongly monotone operators. Fixed Point Theory 2009,10(2):245–258.
Xu HK: Iterative algorithms for nonlinear operators. Journal of the London Mathematical Society 2002,66(1):240–256. 10.1112/S0024610702003332
Geobel K, Kirk WA: Topics in Metric Fixed Point Theory, Cambridge Studies in Advanced Mathematics. Volume 28. Cambridge University Press, Cambridge, UK; 1990:viii+244.
Acedo GL, Xu H-K: Iterative methods for strict pseudo-contractions in Hilbert spaces. Nonlinear Analysis: Theory, Methods & Applications 2007,67(7):2258–2271. 10.1016/j.na.2006.08.036
This research is supported by the Fundamental Research Funds for the Central Universities (GRANT:ZXH2009D021).
About this article
Cite this article
He, S., Liang, X. Hybrid Steepest-Descent Methods for Solving Variational Inequalities Governed by Boundedly Lipschitzian and Strongly Monotone Operators. Fixed Point Theory Appl 2010, 673932 (2010). https://doi.org/10.1155/2010/673932
- Variational Inequality
- Parallel Algorithm
- Nonexpansive Mapping
- Monotone Operator
- Hybrid Algorithm