- Research
- Open Access

# Convergence analysis of projection methods for a new system of general nonconvex variational inequalities

- Dao-Jun Wen
^{1}Email author, - Xian-Jun Long
^{1}and - Qian-Fen Gong
^{2}

**2012**:59

https://doi.org/10.1186/1687-1812-2012-59

© Wen et al; licensee Springer. 2012

**Received: **23 July 2011

**Accepted: **13 April 2012

**Published: **13 April 2012

## Abstract

In this article, we introduce and consider a new system of general nonconvex variational inequalities defined on uniformly prox-regular sets. We establish the equivalence between the new system of general nonconvex variational inequalities and the fixed point problems to analyze an explicit projection method for solving this system. We also consider the convergence of the projection method under some suitable conditions. Results presented in this article improve and extend the previously known results for the variational inequalities and related optimization problems.

**MSC (2000)**: 47J20; 47N10; 49J30.

## Keywords

- system of general nonconvex variational inequalities
- explicit projection methods
- uniform prox-regular set
*r*-strongly monotone mappings*μ*-Lipschitz continuous.

## 1 Introduction

Variational inequalities theory, which was introduced by Stampacchia [1], has emerged as an interesting and fascinating branch of mathematical and engineering sciences. The ideas and techniques of variational inequalities are being applied in structural analysis, economics, optimization, operations research fields. It has been shown that variational inequalities provide the most natural, direct, simple, and efficient framework for a general treatment of some unrelated problems arising in various fields of pure and applied sciences. In recent years, there have been considerable activities in the development of numerical techniques including projection methods, Wiener-Hopf equations, auxiliary principle, and descent framework for solving variational inequalities; see [2–17] and the references therein. These activities have motivated us to generalize and extend the variational inequalities and related optimization problems in several directions using novel techniques.

Projection technique has played a significant role in the numerical solution of variational inequalities based on the convergence analysis. It is worth mentioning that almost all the results regarding the existence and iterative schemes for variational inequalities, which have been investigated and considered, if the underlying set is a convex set. This is because all the techniques are based on the properties of the projection operator over convex sets, which may not hold in general, when the sets are nonconvex. Recently, Clarke et al. [8] and Poliquin et al. [9] have introduced and studied a new class of nonconvex sets, which are called uniformly prox-regular sets. It is known that uniformly prox-regular sets are nonconvex sets and include convex sets as a special case. This class of uniformly prox-regular sets has played an important part in many nonconvex applications such as optimization, dynamical systems, and differential inclusions.

In 2009, Noor [10] introduced a nonconvex variational inequalities based on the uniformly prox-regular sets. Moreover, he discussed the existence and algorithm of the solution for the nonconvex variational inequalities, which shows projection technique can be extended to nonconvex sets. Noor [11] proposed some iterative methods for solving a general nonconvex variational inequalities with projection methods and Wiener-Hopf equations technique. On the other hand, Verma [13] and Noor and Noor [14] proposed explicit projection methods for solving systems of variational inequalities and general variational inequalities on a closed convex subset of Hilbert space, respectively. Very recently, Wen [15] modified projection methods to a generalized system of nonconvex variational inequalities with different nonlinear operators. However, only iterative sequences {*g*(*x*_{
n
})}, {*g*(*y*_{
n
})} come from the projection methods, which requires that mapping *g* must be injective in order to arrive at a solution of the generalized system. Furthermore, the property defined on the underlying operator *T* depends on the mapping *g* in convergence analysis. These strict conditions rule out many applications of the projection type methods for the generalized system of nonconvex variational inequalities.

In this article, motivated and inspired by the research going on in this direction, we introduce and consider a more general system, which is called a new general nonconvex variational inequalities. The new system includes the system of variational inequalities involving two different nonlinear operators, the general nonconvex variational inequalities and the systems of variational inequalities defined on closed convex sets as special cases.

The purpose of this article is not only to show that projection technique can be extended to the new system of general nonconvex variational inequalities on uniformly prox-regular sets, but also to get rid of the dependence of *T* on the mapping *g* and the injective property defined on *g* in convergence analysis of the projection method for solving the new system of general nonconvex variational inequalities. Our results extend and improve the corresponding results of [7, 10–15].

## 2 Preliminaries

Let *H* be a real Hilbert space whose inner product and norm are denoted by 〈.,.〉 and ∥.∥, respectively. Let *K* be a nonempty and convex subset in *H*.

First of all, we recall the following well-known concepts from nonlinear convex analysis and non-smooth analysis [8, 9].

**Definition 2.1**. The proximal normal cone of

*K*at

*u*∈

*H*is given by

*α*> 0 is a constant and

Here *d*_{
K
}(.) is the usual distance function to the subset *K*, that is *d*_{
K
}(*u*) = inf_{v∈K}∥*v* - *u*∥. The proximal normal cone ${N}_{K}^{P}\left(u\right)$ has the following characterization.

**Lemma 2.1**. Let

*K*be a nonempty, closed, and convex subset in

*H*. Then $\varsigma \in {N}_{K}^{P}\left(u\right)$ if and only if there exists a constant

*α*=

*α*(

*ζ*,

*u*) > 0 such that

**Definition 2.2**. The Clarke normal cone, denoted by ${N}_{K}^{C}\left(u\right)$, is defined as

where $\overline{co}$means the closure of the convex hull. Clearly ${N}_{K}^{P}\left(u\right)\subset {N}_{K}^{C}\left(u\right)$, but the converse is not true. Note that ${N}_{K}^{C}\left(u\right)$ is always closed and convex, whereas ${N}_{K}^{P}\left(u\right)$ is convex, but may not be closed [9].

**Definition 2.3**. For a given

*r*∈ (0, ∞], a subset

*K*

_{ r }is said to be normalized uniformly

*r*-prox-regular if and only if every nonzero proximal normal to

*K*

_{ r }can be realized by an

*r*-ball, that is, ∀

*u*∈

*K*

_{ r }and $0\ne \xi \in {N}_{{K}_{r}}^{P}\left(u\right)$, one has

It is clear that the class of normalized uniformly prox-regular sets is sufficiently large to include the class of convex sets, *p*-convex sets, *C*^{1,1} submanifolds (possibly with boundary) of *H*, the images under a *C*^{1,1} diffeomorphism of convex sets and many other nonconvex sets; see [8, 9]. It is known that if *K*_{
r
}is a uniformly prox-regular set, then the proximal normal cone ${N}_{{K}_{r}}^{P}\left(u\right)$ is closed as a set-valued mapping. Thus, we have ${N}_{{K}_{r}}^{P}\left(u\right)={N}_{{K}_{r}}^{C}\left(u\right)$.

**Remark 2.1**. It is clear that if *r* = ∞, then uniformly prox-regularity of *K*_{
r
}is equivalent to the convexity of *K*, that is, *K*_{
r
}= *K*.

*K*

_{ r }be a uniformly

*r*-prox-regular (nonconvex) set, and

*T*

_{1},

*T*

_{2}:

*K*

_{ r }×

*K*

_{ r }→

*K*

_{ r }and

*g*,

*h*:

*H*→

*K*

_{ r }be different nonlinear operators, respectively. For any given constants

*ρ*> 0 and

*η*> 0, we consider the problem of finding

*x**,

*y** ∈

*K*

_{ r }such that

which is called a new system of general nonconvex variational inequalities.

*g*=

*h*=

*I*, the identity operator, then problem (2.1) is equivalent to finding

*x**,

*y** ∈

*K*

_{ r }such that

which appears to be the other new system of nonconvex variational inequalities.

*r*= ∞,

*K*

_{ r }=

*K*, the convex subset in

*H*, then problem (2.1) is equivalent to finding

*x**,

*y** ∈

*K*such that

which is known as the system of general variational inequalities involving four different nonlinear operators, introduced, and studied by Noor and Noor [14].

*g*=

*h*=

*I*,

*T*

_{1},

*T*

_{2}:

*K*→

*K*are two univariate nonlinear operators, then problem (2.3) is equivalent to finding

*x**,

*y** ∈

*K*such that

which is known as the system of nonlinear variational inequalities involving two different nonlinear operators. If *T*_{1} = *T*_{2}, problem (2.4) reduces to the system of variational inequalities, which was introduced and studied by Verma [13].

*T*

_{1}=

*T*

_{2}=

*T*:

*K*

_{ r }→

*K*

_{ r }is a univariate nonlinear operator, and

*x** =

*y** =

*u*, then problem (2.2) reduces to finding

*u*∈

*K*

_{ r }such that

*u*∈

*K*

_{ r }such that

where ${N}_{{K}_{r}}^{P}\left(u\right)$ denotes the normal cone of *K*_{
r
}at *u* in the sense of nonconvex analysis. Problem (2.7) is called the variational inclusion associated with nonconvex variational inequality (2.6), which implies that the nonconvex variational inequality is equivalent to finding a zero of the sum of two monotone operators. This equivalent formulation plays a crucial and basic part in this article, which allows us to use the projection operator technique for solving the general system of nonconvex variational inequalities (2.1).

We now recall the well-known properties of the uniform prox-regular sets [8–10, 15].

**Lemma 2.2**. Let

*K*be a nonempty closed subset of

*H*,

*r*∈ (0, ∞] and set

*K*

_{ r }= {

*u*∈

*H*:

*d*(

*u*,

*K*) <

*r*}. If

*K*

_{ r }is uniformly prox-regular, then

- (i)
$\forall u\in {K}_{r},\phantom{\rule{2.77695pt}{0ex}}{P}_{{K}_{r}}\left(u\right)\ne 0.$.

- (ii)
$\forall {r}^{\prime}\in \left(0,r\right),\phantom{\rule{2.77695pt}{0ex}}{P}_{{K}_{r}}$ is Lipschitz continuous with constant $\delta =\frac{r}{r-{r}^{\prime}}$ on

*K*_{ r' }. - (iii)
The proximal normal cone is closed as a set-valued mapping.

**Lemma 2.3**[18]. Assume {

*α*

_{ n }} is a sequence of nonnegative real numbers such that

*γ*

_{ n }} is a sequence in (0,1) and {

*σ*

_{ n }} is a sequence in

*R*such that

- (i)
${\sum}_{n=0}^{\infty}{\gamma}_{n}=\infty $;

- (ii)
$\mathrm{lim}\phantom{\rule{0.1em}{0ex}}{\mathrm{sup}}_{n\to \infty}{\sigma}_{n}/{\gamma}_{n}\le 0$ or ${\sum}_{n=0}^{\infty}\left|{\sigma}_{n}\right|<\infty $.

Then lim_{n→∞}*a*_{
n
}= 0.

**Definition 2.4**. An operator

*T*:

*H*→

*H*is said to be

*r*-strongly monotone, if there exists a constant

*r*> 0 such that

**Definition 2.5**. An operator

*T*:

*H*→

*H*is said to be

*μ*-Lipschitz continuous, if there exists a constant

*μ*> 0 such that

**Remark 2.2**. As *T* = *I*, the identity operator is 1-strongly monotone and 1-Lipschitz continuous.

**Remark 2.3**. Obviously, whenever operator *T* is *r*-strongly monotone and *μ*-Lipschitz continuous, it follows that *μ* ≥ *r*.

## 3 Projection methods

In this section, we establish the equivalence between the new system of general nonconvex variational inequalities (2.1) and the fixed point problem with the projection technique. This alternative formulation enable us to suggest and analyze an explicit projection method for solving system (2.1).

**Lemma 3.1**.

*x**,

*y** ∈

*K*

_{ r }is a solution of the system of general nonconvex variational inequalities (2.1), if and only if

where ${P}_{{K}_{r}}$ is the projection of *H* onto the uniformly prox-regular set *K*_{
r
}.

**Proof**. Let

*x**,

*y** ∈

*K*

_{ r }be a solution of (2.1). From (2.7), we have that the problem (2.1a) is equivalent to that

*K*

_{ r }at

*x** in the sense of nonconvex analysis. Indeed, if

*ρT*

_{1}(

*y**,

*x**) +

*x** -

*g*(

*y**) = 0, because the vector zero always belongs to any normal cone, then (3.2) is valid. If

*ρT*

_{1}(

*y**,

*x**) +

*x** -

*g*(

*y**) ≠ 0, then for all

*x*∈

*H*:

*g*(

*x*) ∈

*K*

_{ r }, it follows from (2.1a) that

and so (3.2) holds also. Consequently, the general nonconvex variational inequality (2.1a) is equivalent to (3.2), which is called variational inclusion associated with the problem (2.1a).

*I*is identity operator. Moreover, we have

where we have used the well-known fact that ${P}_{{K}_{r}}={\left(I+\rho {N}_{{K}_{r}}^{P}\right)}^{-1}$. In a similar way, we can obtain (3.1b). This proves our assertions. □

**Algorithm 3.1**. For arbitrarily chosen initial points

*x*

_{0},

*y*

_{0}∈

*K*

_{ r }, compute the sequences {

*x*

_{ n }} and {

*y*

_{ n }} in the following way:

where {*α*_{
n
}}, {*β*_{
n
}} are two sequences in [0,1].

If *β*_{
n
}= 1, *K*_{
r
}= *K*, then Algorithm 3.1 reduces to the following explicit projection method for solving the system of variational inequalities (2.3), which is mainly due to Noor and Noor [14]:

**Algorithm 3.2**. For arbitrarily chosen initial points

*x*

_{0},

*y*

_{0}∈

*K*, compute the sequences {

*x*

_{ n }} and {

*y*

_{ n }} in the following way:

where {*α*_{
n
}}, {*β*_{
n
}} are two sequences in [0,1].

If *g* = *h* = *I*, *K*_{
r
}= *K*, and *T*_{1}, *T*_{2} : *K* → *K* are two univariate nonlinear operators, then Algorithm 3.1 reduces to the following explicit projection method for solving the system of variational inequalities (2.4):

**Algorithm 3.3**. For arbitrarily chosen initial points

*x*

_{0},

*y*

_{0}∈

*K*, compute the sequences {

*x*

_{ n }} and {

*y*

_{ n }} in the following way:

where {*α*_{
n
}}, {*β*_{
n
}} are two sequences in [0,1]. Algorithm 3.3 extends and improves the two-step projection methods of Verma [13].

If *g* = *h*, *T*_{1} = *T*_{2} = *T* is the univariate nonlinear operator, we again use the fixed point formulation (3.1) to suggest and analyze the following explicit projection method, known as Mann iteration:

**Algorithm 3.4**. For arbitrarily chosen initial points

*x*

_{0}∈

*K*

_{ r }, compute the sequence {

*x*

_{ n }} in the following way:

where {*α*_{
n
}} is a sequence in [0,1].

**Remark 3.1**. Algorithm 3.4 includes the projection methods of Noor [10] as special cases.

## 4 Main results

We now consider the convergence analysis of Algorithm 3.1, and this is the main motivation of our next result. In a similar way, we consider the convergence criteria of other algorithms.

**Theorem 4.1**. Let ${P}_{{K}_{r}}$ be a Lipschitz continuous operator with constant $\delta =\frac{r}{r-{r}^{\prime}}$. Let

*T*

_{ i }:

*K*

_{ r }×

*K*

_{ r }→

*K*

_{ r }be

*r*

_{ i }-strongly monotone and

*μ*

_{ i }-Lipschitz continuous in the first variable,

*i*= 1, 2, and

*g*,

*h*:

*K*

_{ r }→

*K*

_{ r }be strongly monotone with constants

*r*

_{3},

*r*

_{4}and Lipschitz continuous with constants

*μ*

_{3},

*μ*

_{4}, respectively. If there exist constants

*ρ*,

*η*> 0 such that

and *α*_{
n
}, *β*_{
n
}∈ [0, 1], ${\sum}_{n=0}^{\infty}{\alpha}_{n}=\infty $, ${\sum}_{n=0}^{\infty}\left(1-{\beta}_{n}\right)<\infty $, then the sequences {*x*_{
n
}} and {*y*_{
n
}} obtained from Algorithm 3.1 converges to a solution of the system of general nonconvex variational inequalities (2.1), respectively.

**Proof**. Let

*x**,

*y** ∈

*K*

_{ r }be a solution of (2.1). From (3.1a) and (3.3a) and the Lipschitz continuous property of operator ${P}_{{K}_{r}}$, we can obtain

*T*

_{1}is

*r*

_{1}-strongly monotone and

*μ*

_{1}-Lipschitz continuous definition in the first variable, it follows that

*μ*

_{3}≥

*r*

_{3}, from Remark 2.3)

where ${\theta}_{1}=\delta \left({k}_{1}+\sqrt{1-2\rho {r}_{1}+{\rho}^{2}{\mu}_{1}^{2}}\right)$, ${k}_{1}=\sqrt{1-2{r}_{3}+{\mu}_{3}^{2}}$. From (4.1), we obtain that *θ*_{1} ∈ (0, 1).

*T*

_{2}in the first variable, we have

*θ*

_{2}∈ (0, 1). For all

*n*≥ 1, it follows from (4.11) that

*θ*

_{1},

*θ*

_{2}∈ (0, 1))

It follows that lim_{
n
}_{→}_{∞}*x*_{
n
}= *x**, lim_{
n
}_{→}_{∞}*y*_{
n
}= *y**, satisfying the general system of nonconvex variational inequalities (2.1). This completes the proof. □

**Theorem 4.2**. Let

*K*be a nonempty and convex subset of Hilbert space

*H*. Let

*T*

_{ i }:

*K*×

*K*→

*K*be

*r*

_{ i }-strongly monotone and

*μ*

_{ i }-Lipschitz continuous in the first variable,

*i*= 1, 2, and

*g*,

*h*:

*K*→

*K*be strongly monotone with constants

*r*

_{3},

*r*

_{4}and Lipschitz continuous with constants

*μ*

_{3},

*μ*

_{4}, respectively. If there exist constants

*ρ*,

*η*> 0 such that

and *α*_{
n
}∈ [0, 1], ${\sum}_{n=0}^{\infty}{\alpha}_{n}=\infty $, then the sequences {*x*_{
n
}} and {*y*_{
n
}} obtained from Algorithm 3.2 converges to a solution of the system of general variational inequalities (2.3), respectively.

**Proof**. If *K*_{
r
}= *K*, *β*_{
n
}= 1, Algorithm 3.1 reduces to Algorithm 3.2. Moreover, we can obtain *r* = ∞ and *δ* = 1 from Remark 2.1, and ${\sum}_{n=0}^{\infty}\left(1-{\beta}_{n}\right)=0$. Then the conclusion follows immediately from Theorem 4.1. This completes the proof. □

**Theorem 4.3**. Let

*K*be a nonempty and convex subset of Hilbert space

*H*, and

*T*

_{ i }:

*K*→

*K*be

*r*

_{ i }-strongly monotone and

*μ*

_{ i }-Lipschitz continuous,

*i*= 1, 2. If there exist constants

*ρ*,

*η*such that

and *α*_{
n
}, *β*_{
n
}∈ [0, 1], ${\sum}_{n=0}^{\infty}{\alpha}_{n}=\infty $, ${\sum}_{n=0}^{\infty}\left(1-{\beta}_{n}\right)<\infty $, then the sequences {*x*_{
n
}} and {*y*_{
n
}} obtained from Algorithm 3.3 converges to a solution of the system of variational inequalities (2.4), respectively.

**Proof**. If *g* = *h* = *I*, *K*_{
r
}= *K*, Algorithm 3.1 reduces to Algorithm 3.3. Moreover, we can obtain *r* = ∞ and *δ* = 1 from Remark 2.1, and *k*_{1} = *k*_{2} = 0 from Remark 2.2 (*r*_{3} = *μ*_{3} = *r*_{4} = *μ*_{4} = 1). Then the conclusion follows immediately from Theorem 4.1. This completes the proof. □

## Declarations

### Acknowledgements

This study was supported by the National Science Foundation of China (11001287), Natural Science Foundation Project of Chongqing (CSTC 2010BB9254) and Science and Technology Research Project of Chongqing Municipal Education Commission (KJ 110701).

## Authors’ Affiliations

## References

- Stampacchia G: Formes bilinearies coercivities sur les ensembles convexes.
*C R Acad Sci Paris*1964, 258: 4413–4416.MATHMathSciNetGoogle Scholar - Noor MA: Some developments in general variational inequalities.
*Appl Math Comput*2004, 152: 199–277. 10.1016/S0096-3003(03)00558-7MATHMathSciNetView ArticleGoogle Scholar - Bounkhel M, Tadj L, Hamdi A: Iterative schemes to solve nonconvex variational problems.
*J Inequal Pure Appl Math*2003, 4: 1–14.MathSciNetGoogle Scholar - Noor MA: On implicit methods for nonconvex variational inequalities.
*J Optim Theory Appl*2010, 147: 411–417. 10.1007/s10957-010-9717-yMATHMathSciNetView ArticleGoogle Scholar - Pang LP, Shen J, Song HS: A modified predictor-corrector algorithm for solving non-convex generalized variational inequalities.
*Comput Math Appl*2007, 54: 319–325. 10.1016/j.camwa.2006.07.010MATHMathSciNetView ArticleGoogle Scholar - Verma RU: Generalized system for relaxed cocoercive variational inequalities and projection methods.
*J Optim Theory Appl*2004, 121(1):203–210.MATHMathSciNetView ArticleGoogle Scholar - Noor MA: Some iterative methods for nonconvex variational inequalities.
*Comput Math Model*2010, 21(1):97–108. 10.1007/s10598-010-9057-7MATHMathSciNetView ArticleGoogle Scholar - Clarke FH, Ledyaev YS, Wolenski PR:
*Nonsmooth Analysis and Control Theory.*Springer, Berlin; 1998.Google Scholar - Poliquin RA, Rockafellar RT, Thibault L: Local differentiability of distance functions.
*Trans Am Math Soc*2000, 352: 5231–5249. 10.1090/S0002-9947-00-02550-2MATHMathSciNetView ArticleGoogle Scholar - Noor MA: Projection methods for nonconvex variational inequalities.
*Optim Lett*2009, 3: 411–418. 10.1007/s11590-009-0121-1MATHMathSciNetView ArticleGoogle Scholar - Noor MA: Iterative methods for general nonconvex variational inequalities.
*Albanian J Math*2009, 3(1):117–127.MATHMathSciNetGoogle Scholar - Huang Z, Noor MA: An explicit projection method for a system of nonlinear variational inequalities with different (
*γ*,*r*)-cocoercive mappings.*Appl Math Comput*2007, 190: 356–361. 10.1016/j.amc.2007.01.032MATHMathSciNetView ArticleGoogle Scholar - Verma RU: General Convergence analysis for two-step projection methods and applications to variational problems.
*Appl Math Lett*2005, 18: 1286–1292. 10.1016/j.aml.2005.02.026MATHMathSciNetView ArticleGoogle Scholar - Noor MA, Noor KI: Projection algorithms for solving system of general variational inequalities.
*Nonlinear Anal*2009, 70: 2700–2706. 10.1016/j.na.2008.03.057MATHMathSciNetView ArticleGoogle Scholar - Wen DJ: Projection methods for a generalized system of nonconvex variational inequalities with different nonlinear operators.
*Nonlinear Anal*2010, 73: 2292–2297. 10.1016/j.na.2010.06.010MATHMathSciNetView ArticleGoogle Scholar - Ceng LC, Teboulle M, Yao JC: Weak convergence of an iterative method for pseudomonotone variational inequalities and fixed-point problems.
*J Optim Theory Appl*2010, 146: 19–31. 10.1007/s10957-010-9650-0MATHMathSciNetView ArticleGoogle Scholar - Wen DJ: Strong convergence theorems for equilibrium problems and
*k*-strict pseudo-contractions in Hilbert spaces.*Abstract Appl Anal*2011., 2011: Article ID 276874, doi:10.1155/2011/276874Google Scholar - Xu HK: Iterative algorithms for nonlinear operators.
*J Lond Math Soc*2002, 2: 240–256.View ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.