Variant extragradient-type method for monotone variational inequalities

Abstract

Korpelevich’s extragradient method has been studied and extended extensively due to its applicability to the whole class of monotone variational inequalities. In the present paper, we propose a variant extragradient-type method for solving monotone variational inequalities. Convergence analysis of the method is presented under reasonable assumptions on the problem data.

MSC:47H05, 47J05, 47J25.

1 Introduction

Let H be a real Hilbert space with the inner product $〈\cdot ,\cdot 〉$ and its induced norm $\parallel \cdot \parallel$. Let C be a nonempty, closed and convex subset of H and let $A:C\to H$ be a nonlinear operator. The variational inequality problem for A and C, denoted by $VI(C,A)$, is the problem of finding a point $x^{\ast }\in C$ satisfying

$$〈A{x}^{\ast },x-x^{\ast }〉\ge 0,\mathrm{\forall }x\in C.$$

(1)

We denote the solution set of this problem by $SVI(C,A)$. Under the monotonicity assumption, the solution set of $SVI(C,A)$ is always closed and convex.

The variational inequality problem is a fundamental problem in variational analysis and, in particular, in optimization theory. There are several iterative methods for solving it. See, e.g., [1–38]. The basic idea consists of extending the projected gradient method for constrained optimization, i.e., for the problem of minimizing $f(x)$ subject to $x\in C$. For $x_0\in C$, compute the sequence $\{x_n\}$ in the following manner:

$$x_{n+1}=P_C[x_n-{\alpha }_n\mathrm{\nabla }f(x_n)],n\ge 0,$$

(2)

where ${\alpha }_n>0$ is the stepsize and $P_C$ is the metric projection onto C. See [1] for convergence properties of this method for the case in which f is convex and $f:R^n\to R$ is a differentiable function, which are related to the results in this article. An immediate extension of the method (2) to $VI(C,A)$ is the iterative procedure given by

$$x_{n+1}=P_C[x_n-{\alpha }_{n}A{x}_n],n\ge 0.$$

(3)

Convergence results for this method require some monotonicity properties of A. Note that for the method given by (3) there is no chance of relaxing the assumption on A to plain monotonicity. The typical example consists of taking $C={\mathbb{R}}^2$ and A, a rotation with a $\frac{\pi }{2}$ angle. A is monotone and the unique solution of $VI(C,A)$ is $x^{\ast }=0$. However, it is easy to check that $\parallel x_n-{\alpha }_{n}A{x}_n\parallel >\parallel x_n\parallel$ for all $x_n\ne 0$ and all ${\alpha }_n>0$, therefore the sequence generated by (3) moves away from the solution, independently of the choice of the stepsize ${\alpha }_n$.

To overcome this weakness of the method defined by (3), Korpelevich [20] proposed a modification of the method, called the extragradient algorithm. It generates iterates using the following formulae:

$$\begin{array}{r}{y}_n=P_C[x_n-\lambda A{x}_n],\\ x_{n+1}=P_C[x_n-\lambda A{y}_n],n\ge 0,\end{array}$$

(4)

where $\lambda >0$ is a fixed number. The difference in (4) is that A is evaluated twice and the projection is computed twice at each iteration, but the benefit is significant, because the resulting algorithm is applicable to the whole class of monotone variational inequalities. However, we note that Korpelevich assumed that A is Lipschitz continuous and that an estimate of the Lipschitz constant is available. When A is not Lipschitz continuous, or it is Lipschitz but the constant is not known, the fixed parameter λ must be replaced by stepsizes computed through an Armijo-type search, as in the following method, presented in [39] (see also [18] for another related approach).

Let $\delta \in (0,1)$, $\{{\beta }_n\}\subset [\hat{\beta },\overline{\beta }]$ and $x_0\in C$. Given $x_n$ define

$$z_n=x_n-{\beta }_{n}A{x}_n.$$

If $x_n=P_C[z_n]$, then stop. Otherwise, let

$$\begin{array}{rl}j(n)& =min\{j\ge 0:〈A(\frac{1}{2^j}{P}_C[z_n]+(1-\frac{1}{2^j}{x}_n)),x_n-P_C[z_n]〉\\ \ge \frac{\delta }{{\beta }_n}{\parallel x_n-P_C[z_n]\parallel }^2\}\end{array}$$

(5)

and

$${\alpha }_n=2^{-j(n)},y_n={\alpha }_n{P}_C[z_n]+(1-{\alpha }_n)x_n.$$

Define

$$\begin{array}{c}{H}_n=\{x\in H:〈A{y}_n,z-y_n〉\le 0\},\hfill \\ W_n=\{z\in H:〈x_0-x_n,z-x_n〉\le 0\},\hfill \\ x_{n+1}=P_{H_n\cap W_n\cap C}{x}_0.\hfill \end{array}$$

(6)

It is proved that if A is maximal monotone, point-to-point and uniformly continuous on bounded sets, and if $VI(C,A)$ is nonempty, then ${\{x_n\}}_n$ strongly converges to $P_{VI(C,A)}{x}_0$.

We now know that the difficult implementation of these methods is in computational respect. First, we note that in order to get ${\alpha }_n$, we have to compute $j(n)$, which may be time-consuming. At the same time, we observe that (6) involves two half-spaces $H_n$ and $W_n$. If the sets C, $H_n$ and $W_n$ are simple enough, then $P_C$, $P_{H_n}$ and $P_{W_n}$ are easily executed. But $H_n\cap W_n\cap C$ may be complicated, so that the projection $P_{H_n\cap W_n\cap C}$ is not easily executed. This might seriously affect the efficiency of the method.

The literature on the $VI(C,A)$ is vast and Korpelevich’s method has received great attention from many authors, who improved it in various ways; see, e.g., [33, 39–44] and references therein. It is known that Korpelevich’s method (4) has only weak convergence in the infinite-dimensional Hilbert spaces (please refer to a recent result of Censor et al. [40] and [41]). So, to obtain strong convergence, the original method was modified by several authors. For example, in [4, 43] it was proved that some very interesting Korpelevich-type algorithms strongly converge to a solution of $VI(C,A)$. Very recently, Yao et al. [33] suggested modified Korpelevich’s method which converges strongly to the minimum norm solution of variational inequality (1) in infinite-dimensional Hilbert spaces.

Motivated by the works given above, in the present paper, we propose a variant extragradient-type method for solving monotone variational inequalities. Strong convergence analysis of the method is presented under reasonable assumptions on the problem data in the infinite-dimensional Hilbert spaces.

2 Preliminaries

In this section, we present some definitions and results that are needed for the convergence analysis of the proposed method. Let C be a closed convex subset of a real Hilbert space H.

A mapping $F:C\to H$ is said to be Lipschitz if there exists a positive real number $L>0$ such that

$$\parallel F(x)-F(y)\parallel \le L\parallel x-y\parallel$$

for all $x,y\in C$. In the case $L\in (0,1)$, F is called L-contractive. A mapping $A:C\to H$ is called α-inverse-strongly-monotone if there exists a positive real number α such that

$$〈Au-Av,u-v〉\ge \alpha {\parallel Au-Av\parallel }^2,\mathrm{\forall }u,v\in C.$$

The following result is well known.

Proposition 1 [45]

Let C be a bounded closed convex subset of a real Hilbert space H and let A be an α-inverse strongly monotone operator of C into H. Then $SVI(C,A)$ is nonempty.

For any $u\in H$, there exists a unique $u_0\in C$ such that

$$\parallel u-u_0\parallel =inf\{\parallel u-x\parallel :x\in C\}.$$

We denote $u_0$ by $P_{C}u$, where $P_C$ is called the metric projection of H onto C. The following is a useful characterization of projections.

Proposition 2 Given $x\in H$. We have

$$〈x-P_{C}x,y-P_{C}x〉\le 0,\mathrm{\forall }y\in C,$$

which is equivalent to

$$〈x-y,P_{C}x-P_{C}y〉\ge {\parallel P_{C}x-P_{C}y\parallel }^2,\mathrm{\forall }x,y\in H.$$

Consequently, we deduce immediately that $P_C$ is nonexpansive, that is,

$$\parallel P_{C}x-P_{C}y\parallel \le \parallel x-y\parallel$$

for all $x,y\in H$.

It is well known that $2P_C-I$ is nonexpansive.

Lemma 1 [45]

Let C be a nonempty closed convex subset of a real Hilbert space H. Let the mapping $A:C\to H$ be α-inverse strongly monotone and $r>0$ be a constant. Then we have

$${\parallel (I-rA)x-(I-rA)y\parallel }^2\le {\parallel x-y\parallel }^2+r(r-2\alpha ){\parallel Ax-Ay\parallel }^2,\mathrm{\forall }x,y\in C.$$

In particular, if $0\le r\le 2\alpha$, then $I-rA$ is nonexpansive.

Lemma 2 [46]

Let $\{x_n\}$ and $\{y_n\}$ be bounded sequences in a Banach space X and let $\{{\beta }_n\}$ be a sequence in $[0,1]$ with $0<{lim\hspace{0.17em}inf}_{n\to \mathrm{\infty }}{\beta }_n\le {lim\hspace{0.17em}sup}_{n\to \mathrm{\infty }}{\beta }_n<1$.

Suppose that

• (1) $x_{n+1}=(1-{\beta }_n)y_n+{\beta }_n{x}_n$ for all $n\ge 0$;

• (2) ${lim\hspace{0.17em}sup}_{n\to \mathrm{\infty }}(\parallel y_{n+1}-y_n\parallel -\parallel x_{n+1}-x_n\parallel )\le 0$.

Then ${lim}_{n\to \mathrm{\infty }}\parallel y_n-x_n\parallel =0$.

Lemma 3 [47]

Assume that $\{a_n\}$ is a sequence of nonnegative real numbers, which satisfies

$$a_{n+1}\le (1-{\gamma }_n)a_n+{\delta }_n,n\ge 0,$$

where $\{{\gamma }_n\}$ is a sequence in $(0,1)$ and $\{{\delta }_n\}$ is a sequence such that

• (1) ${\sum }_{n=1}^{\mathrm{\infty }}{\gamma }_n=\mathrm{\infty }$;

• (2) ${lim\hspace{0.17em}sup}_{n\to \mathrm{\infty }}{\delta }_n/{\gamma }_n\le 0$ or ${\sum }_{n=1}^{\mathrm{\infty }}|{\delta }_n|<\mathrm{\infty }$.

Then ${lim}_{n\to \mathrm{\infty }}{a}_n=0$.

3 Algorithm and its convergence analysis

In this section, we present the formal statement of our proposal for the algorithm.

Variant extragradient-type method

Let C be a nonempty, closed and convex subset of a real Hilbert space H. Let $A:C\to H$ be an α-inverse-strongly-monotone mapping and let $F:C\to H$ be a ρ-contractive mapping. Consider the sequences $\{{\alpha }_n\}\subset [0,1]$, $\{{\lambda }_n\}\subset [0,2\alpha ]$, $\{{\mu }_n\}\subset [0,2\alpha ]$ and $\{{\gamma }_n\}\subset [0,1]$.

• 1. Initialization:

  $$x_0\in C.$$

• 2. Iterative step: Given $x_n$, define

  $$\{\begin{array}{c}{y}_n=P_C[x_n-{\lambda }_{n}A{x}_n+{\alpha }_n(F{x}_n-x_n)],\hfill \\ x_{n+1}=P_C[x_n-{\mu }_{n}A{y}_n+{\gamma }_n(y_n-x_n)],n\ge 0.\hfill \end{array}$$

  (7)

Remark 1 Note that algorithm (7) includes Korpelevich’s method (4) as a special case.

Next, we shall perform a study on the convergence analysis of the proposed algorithm (7).

Theorem 1 Suppose that $SVI(C,A)\ne \mathrm{\varnothing }$. Assume that the algorithm parameters $\{{\alpha }_n\}$, $\{{\lambda }_n\}$, $\{{\mu }_n\}$ and $\{{\gamma }_n\}$ satisfy the following conditions:

• (C1) ${lim}_{n\to \mathrm{\infty }}{\alpha }_n=0$ and ${\sum }_{n=1}^{\mathrm{\infty }}{\alpha }_n=\mathrm{\infty }$;

• (C2) ${\lambda }_n\in [a,b]\subset (0,2\alpha )$ and ${lim}_{n\to \mathrm{\infty }}({\lambda }_{n+1}-{\lambda }_n)=0$;

• (C3) ${\gamma }_n\in (0,1)$, ${\mu }_n\le 2\alpha {\gamma }_n$ and ${lim}_{n\to \mathrm{\infty }}({\gamma }_{n+1}-{\gamma }_n)={lim}_{n\to \mathrm{\infty }}({\mu }_{n+1}-{\mu }_n)=0$.

Then the sequence $\{x_n\}$ generated by (7) converges strongly to $\tilde{x}\in SVI(C,A)$, which solves the following variational inequality:

$$〈\tilde{x}-F\tilde{x},\tilde{x}-x^{\ast }〉\le 0\mathit{\text{for all}}{x}^{\ast }\in SVI(C,A).$$

We shall prove our main result in several steps, included into the propositions given bellow.

Proposition 3 The sequences $\{x_n\}$ and $\{y_n\}$ are bounded. Therefore, the sequences $\{F{x}_n\}$, $\{A{x}_n\}$ and $\{A{y}_n\}$ are all bounded.

Proof From conditions (C1) and (C2), since ${\alpha }_n\to 0$ and ${\lambda }_n\in [a,b]\subset (0,2\alpha )$, we have ${\alpha }_n<1-\frac{{\lambda }_n}{2\alpha }$, for n large enough. Without loss of generality, we may assume that, for all $n\in \mathbb{N}$, ${\alpha }_n<1-\frac{{\lambda }_n}{2\alpha }$. So, $\frac{{\lambda }_n}{1-{\alpha }_n}\in (0,2\alpha )$.

Consider any $x^{\ast }\in SVI(C,A)$. By the property of the metric projection, we know $x^{\ast }=P_C[x^{\ast }-\delta A{x}^{\ast }]$ for any $\delta >0$. Hence,

$$\begin{array}{rl}{x}^{\ast }& =P_C[x^{\ast }-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}^{\ast }]=P_C[x^{\ast }-{\lambda }_{n}A{x}^{\ast }]\\ =P_C[{\alpha }_n{x}^{\ast }+(1-{\alpha }_n)(x^{\ast }-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}^{\ast })],\mathrm{\forall }n\ge 0.\end{array}$$

(8)

Thus, by (7) and (8), we have

$$\begin{array}{rl}\parallel y_n-x^{\ast }\parallel =& \parallel P_C[{\alpha }_{n}F{x}_n+(1-{\alpha }_n)x_n-{\lambda }_{n}A{x}_n]-x^{\ast }\parallel \\ =& \parallel P_C[{\alpha }_{n}F{x}_n+(1-{\alpha }_n)(x_n-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}_n)]\\ -P_C[{\alpha }_n{x}^{\ast }+(1-{\alpha }_n)(x^{\ast }-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}^{\ast })]\parallel \\ \le & \parallel {\alpha }_n(F{x}_n-x^{\ast })+(1-{\alpha }_n)[(x_n-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}_n)-(x^{\ast }-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}^{\ast })]\parallel .\end{array}$$

(9)

Since $\frac{{\lambda }_n}{1-{\alpha }_n}\in (0,2\alpha )$, from Lemma 1, we know that $I-\frac{{\lambda }_n}{1-{\alpha }_n}A$ is nonexpansive. From (9), we get

$$\begin{array}{rcl}\parallel y_n-x^{\ast }\parallel & \le & {\alpha }_n\parallel F{x}_n-x^{\ast }\parallel +(1-{\alpha }_n)\parallel (I-\frac{{\lambda }_n}{1-{\alpha }_n}A)x_n-(I-\frac{{\lambda }_n}{1-{\alpha }_n}A)x^{\ast }\parallel \\ \le & {\alpha }_n\parallel F{x}_n-F{x}^{\ast }\parallel +{\alpha }_n\parallel F{x}^{\ast }-x^{\ast }\parallel +(1-{\alpha }_n)\parallel x_n-x^{\ast }\parallel \\ \le & {\alpha }_n\rho \parallel x_n-x^{\ast }\parallel +{\alpha }_n\parallel F{x}^{\ast }-x^{\ast }\parallel +(1-{\alpha }_n)\parallel x_n-x^{\ast }\parallel \\ =& [1-(1-\rho ){\alpha }_n]\parallel x_n-x^{\ast }\parallel +{\alpha }_n\parallel F{x}^{\ast }-x^{\ast }\parallel .\end{array}$$

By (C3), we obtain $\frac{{\mu }_n}{{\gamma }_n}\le 2\alpha$. So, $I-\frac{{\mu }_n}{{\gamma }_n}A$ is also nonexpansive. Therefore,

$$\begin{array}{rl}\parallel x_{n+1}-x^{\ast }\parallel =& \parallel P_C[x_n-{\mu }_{n}A{y}_n+{\gamma }_n(y_n-x_n)]-x^{\ast }\parallel \\ =& \parallel P_C[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\\ -P_C[(1-{\gamma }_n)x^{\ast }+{\gamma }_n(x^{\ast }-\frac{{\mu }_n}{{\gamma }_n}A{x}^{\ast })]\parallel \\ \le & (1-{\gamma }_n)\parallel x_n-x^{\ast }\parallel +{\gamma }_n\parallel (y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)-(x^{\ast }-\frac{{\mu }_n}{{\gamma }_n}A{x}^{\ast })\parallel \\ \le & (1-{\gamma }_n)\parallel x_n-x^{\ast }\parallel +{\gamma }_n\parallel y_n-x^{\ast }\parallel \\ \le & (1-{\gamma }_n)\parallel x_n-x^{\ast }\parallel +{\gamma }_n{\alpha }_n\parallel F{x}^{\ast }-x^{\ast }\parallel \\ +{\gamma }_n[1-(1-\rho ){\alpha }_n]\parallel x_n-x^{\ast }\parallel \\ =& [1-(1-\rho ){\gamma }_n{\alpha }_n]\parallel x_n-x^{\ast }\parallel +{\gamma }_n{\alpha }_n\parallel F{x}^{\ast }-x^{\ast }\parallel \\ \le & max\{\parallel x_n-x^{\ast }\parallel ,\frac{\parallel F{x}^{\ast }-x^{\ast }\parallel }{1-\rho }\}.\end{array}$$

(10)

By induction, we get

$$\parallel x_{n+1}-x^{\ast }\parallel \le max\{\parallel x_0-x^{\ast }\parallel ,\frac{\parallel F{x}^{\ast }-x^{\ast }\parallel }{1-\rho }\}.$$

Then $\{x_n\}$ is bounded, and so are $\{y_n\}$, $\{F{x}_n\}$, $\{A{x}_n\}$ and $\{A{y}_n\}$. Therefore, the proof is complete. □

Proposition 4 The following two properties hold:

$$\underset{n\to \mathrm{\infty }}{lim}\parallel x_{n+1}-x_n\parallel =0,\underset{n\to \mathrm{\infty }}{lim}\parallel x_n-y_n\parallel =0.$$

Proof Let $S=2P_C-I$. From the property of the metric projection, we known that S is nonexpansive. Therefore, we can rewrite $x_{n+1}$ in (7) as

$$\begin{array}{rcl}{x}_{n+1}& =& \frac{I+S}{2}[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\\ =& \frac{1-{\gamma }_n}{2}{x}_n+\frac{{\gamma }_n}{2}(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)+\frac{1}{2}S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\\ =& \frac{1-{\gamma }_n}{2}{x}_n+\frac{1+{\gamma }_n}{2}{z}_n,\end{array}$$

where

$$\begin{array}{rcl}{z}_n& =& \frac{\frac{{\gamma }_n}{2}(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)+\frac{1}{2}S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]}{\frac{1+{\gamma }_n}{2}}\\ =& \frac{{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)+S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]}{1+{\gamma }_n}.\end{array}$$

It follows that

$$\begin{array}{r}{z}_{n+1}-z_n\\ =\frac{{\gamma }_{n+1}(y_{n+1}-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A{y}_{n+1})+S[(1-{\gamma }_{n+1})x_{n+1}+{\gamma }_{n+1}(y_{n+1}-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A{y}_{n+1})]}{1+{\gamma }_{n+1}}\\ -\frac{{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)+S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]}{1+{\gamma }_n}.\end{array}$$

So,

$$\begin{array}{rl}\parallel z_{n+1}-z_n\parallel \le & \frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}\parallel (y_{n+1}-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A{y}_{n+1})-(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)\parallel \\ +|\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}-\frac{{\gamma }_n}{1+{\gamma }_n}|\parallel y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n\parallel \\ +\frac{1}{1+{\gamma }_{n+1}}\parallel S[(1-{\gamma }_{n+1})x_{n+1}+{\gamma }_{n+1}(y_{n+1}-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A{y}_{n+1})]\\ -S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\parallel \\ +|\frac{1}{1+{\gamma }_{n+1}}-\frac{1}{1+{\gamma }_n}|\parallel S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\parallel \\ \le & \frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}\parallel (I-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A)y_{n+1}-(I-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A)y_n\parallel \\ +\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}|\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}-\frac{{\mu }_n}{{\gamma }_n}|\parallel A{y}_n\parallel \\ +|\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}-\frac{{\gamma }_n}{1+{\gamma }_n}|\parallel y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n\parallel \\ +\frac{1}{1+{\gamma }_{n+1}}\parallel S[(1-{\gamma }_{n+1})x_{n+1}+{\gamma }_{n+1}(y_{n+1}-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A{y}_{n+1})]\\ -S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\parallel \\ +|\frac{1}{1+{\gamma }_{n+1}}-\frac{1}{1+{\gamma }_n}|\parallel S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\parallel .\end{array}$$

Again, by using the nonexpansivity of $I-\frac{{\mu }_n}{{\gamma }_n}A$ and S, we have

$$\begin{array}{rl}\parallel z_{n+1}-z_n\parallel \le & \frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}\parallel y_{n+1}-y_n\parallel +|\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}-\frac{{\gamma }_n}{1+{\gamma }_n}|\parallel y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n\parallel \\ +\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}|\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}-\frac{{\mu }_n}{{\gamma }_n}|\parallel A{y}_n\parallel +\frac{1}{1+{\gamma }_{n+1}}\parallel (1-{\gamma }_{n+1})(x_{n+1}-x_n)\\ +{\gamma }_{n+1}[(I-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A)y_{n+1}-(I-\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}A)y_n]\\ +({\gamma }_{n+1}-{\gamma }_n)(y_n-x_n)+({\mu }_n-{\mu }_{n+1})A{y}_n\parallel \\ +|\frac{1}{1+{\gamma }_{n+1}}-\frac{1}{1+{\gamma }_n}|\parallel S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\parallel \\ \le & \frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}\parallel y_{n+1}-y_n\parallel +|\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}-\frac{{\gamma }_n}{1+{\gamma }_n}|\parallel y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n\parallel \\ +\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}|\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}-\frac{{\mu }_n}{{\gamma }_n}|\parallel A{y}_n\parallel +\frac{1-{\gamma }_{n+1}}{1+{\gamma }_{n+1}}\parallel x_{n+1}-x_n\parallel \\ +\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}\parallel y_{n+1}-y_n\parallel \\ +\frac{|{\gamma }_{n+1}-{\gamma }_n|}{1+{\gamma }_{n+1}}(\parallel x_n\parallel +\parallel y_n\parallel )+\frac{|{\mu }_{n+1}-{\mu }_n|}{1+{\gamma }_{n+1}}\parallel A{y}_n\parallel \\ +|\frac{1}{1+{\gamma }_{n+1}}-\frac{1}{1+{\gamma }_n}|\parallel S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\parallel .\end{array}$$

Next, we estimate $\parallel y_{n+1}-y_n\parallel$.

By (7), we have

$$\begin{array}{rl}\parallel y_{n+1}-y_n\parallel =& \parallel P_C[x_{n+1}-{\lambda }_{n+1}A{x}_{n+1}+{\alpha }_{n+1}(F{x}_{n+1}-x_{n+1})]\\ -P_C[x_n-{\lambda }_{n}A{x}_n+{\alpha }_n(F{x}_n-x_n)]\parallel \\ \le & \parallel [x_{n+1}-{\lambda }_{n+1}A{x}_{n+1}]-[x_n-{\lambda }_{n}A{x}_n]\parallel +{\alpha }_{n+1}\parallel F{x}_{n+1}-x_{n+1}\parallel \\ +{\alpha }_n\parallel F{x}_n-x_n\parallel \\ =& \parallel (I-{\lambda }_{n+1}A)x_{n+1}-(I-{\lambda }_{n+1}A)x_n+({\lambda }_n-{\lambda }_{n+1})A{x}_n\parallel \\ +{\alpha }_{n+1}\parallel F{x}_{n+1}-x_{n+1}\parallel +{\alpha }_n\parallel F{x}_n-x_n\parallel \\ \le & \parallel x_{n+1}-x_n\parallel +|{\lambda }_{n+1}-{\lambda }_n|\parallel x_n\parallel +{\alpha }_{n+1}\parallel F{x}_{n+1}-x_{n+1}\parallel +{\alpha }_n\parallel F{x}_n-x_n\parallel .\end{array}$$

So, we deduce

$$\begin{array}{rl}\parallel z_{n+1}-z_n\parallel \le & |\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}-\frac{{\gamma }_n}{1+{\gamma }_n}|\parallel y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n\parallel +\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}|\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}-\frac{{\mu }_n}{{\gamma }_n}|\parallel A{y}_n\parallel \\ +\frac{|{\gamma }_{n+1}-{\gamma }_n|}{1+{\gamma }_{n+1}}(\parallel x_n\parallel +\parallel y_n\parallel )+\frac{|{\mu }_{n+1}-{\mu }_n|}{1+{\gamma }_{n+1}}\parallel A{y}_n\parallel +\parallel x_{n+1}-x_n\parallel \\ +|\frac{1}{1+{\gamma }_{n+1}}-\frac{1}{1+{\gamma }_n}|\parallel S[(1-{\gamma }_n)x_n+{\gamma }_n(y_n-\frac{{\mu }_n}{{\gamma }_n}A{y}_n)]\parallel \\ +|{\lambda }_{n+1}-{\lambda }_n|\parallel x_n\parallel \\ +{\alpha }_{n+1}\parallel F{x}_{n+1}-x_{n+1}\parallel +{\alpha }_n\parallel F{x}_n-x_n\parallel .\end{array}$$

Since ${lim}_{n\to \mathrm{\infty }}({\gamma }_{n+1}-{\gamma }_n)=0$ and ${lim}_{n\to \mathrm{\infty }}({\mu }_{n+1}-{\mu }_n)=0$, we derive that

$$\underset{n\to \mathrm{\infty }}{lim}|\frac{{\gamma }_{n+1}}{1+{\gamma }_{n+1}}-\frac{{\gamma }_n}{1+{\gamma }_n}|=0,\underset{n\to \mathrm{\infty }}{lim}|\frac{{\mu }_{n+1}}{{\gamma }_{n+1}}-\frac{{\mu }_n}{{\gamma }_n}|=0,\underset{n\to \mathrm{\infty }}{lim}|\frac{1}{1+{\gamma }_{n+1}}-\frac{1}{1+{\gamma }_n}|=0.$$

At the same time, note that $\{x_n\}$, $\{F{x}_n\}$, $\{y_n\}$ and $\{A{y}_n\}$ are bounded. Therefore,

$$\underset{n\to \mathrm{\infty }}{lim\hspace{0.17em}sup}(\parallel z_{n+1}-z_n\parallel -\parallel x_{n+1}-x_n\parallel )\le 0.$$

By Lemma 2, we obtain

$$\underset{n\to \mathrm{\infty }}{lim}\parallel z_n-x_n\parallel =0.$$

Hence,

$$\underset{n\to \mathrm{\infty }}{lim}\parallel x_{n+1}-x_n\parallel =\underset{n\to \mathrm{\infty }}{lim}\frac{1+{\gamma }_n}{2}\parallel z_n-x_n\parallel =0.$$

From (9), (10), Lemma 1 and the convexity of the norm, we deduce

$$\begin{array}{rl}{\parallel x_{n+1}-x^{\ast }\parallel }^2\le & (1-{\gamma }_n){\parallel x_n-x^{\ast }\parallel }^2+{\gamma }_n{\parallel y_n-x^{\ast }\parallel }^2\\ \le & {\gamma }_n{\parallel {\alpha }_n(F{x}_n-x^{\ast })+(1-{\alpha }_n)[(x_n-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}_n)-(x^{\ast }-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}^{\ast })]\parallel }^2\\ +(1-{\gamma }_n){\parallel x_n-x^{\ast }\parallel }^2\\ \le & {\gamma }_n[{\alpha }_n{\parallel F{x}_n-x^{\ast }\parallel }^2+(1-{\alpha }_n){\parallel (I-\frac{{\lambda }_n}{1-{\alpha }_n}A)x_n-(I-\frac{{\lambda }_n}{1-{\alpha }_n}A)x^{\ast }\parallel }^2]\\ +(1-{\gamma }_n){\parallel x_n-x^{\ast }\parallel }^2\\ \le & (1-{\alpha }_n){\gamma }_n[{\parallel x_n-x^{\ast }\parallel }^2+\frac{{\lambda }_n}{1-{\alpha }_n}(\frac{{\lambda }_n}{1-{\alpha }_n}-2\alpha ){\parallel A{x}_n-A{x}^{\ast }\parallel }^2]\\ +(1-{\gamma }_n){\parallel x_n-x^{\ast }\parallel }^2+{\alpha }_n{\gamma }_n{\parallel F{x}_n-x^{\ast }\parallel }^2\\ \le & {\alpha }_n{\gamma }_n{\parallel F{x}_n-x^{\ast }\parallel }^2+{\parallel x_n-x^{\ast }\parallel }^2+{\gamma }_{n}a(\frac{b}{1-{\alpha }_n}-2\alpha ){\parallel A{x}_n-A{x}^{\ast }\parallel }^2.\end{array}$$

Therefore, we have

$$\begin{array}{r}{\gamma }_{n}a(2\alpha -\frac{b}{1-{\alpha }_n}){\parallel A{x}_n-A{x}^{\ast }\parallel }^2\\ \le {\alpha }_n{\gamma }_n{\parallel F{x}_n-x^{\ast }\parallel }^2+{\parallel x_n-x^{\ast }\parallel }^2-{\parallel x_{n+1}-x^{\ast }\parallel }^2\\ \le {\alpha }_n{\gamma }_n{\parallel F{x}_n-x^{\ast }\parallel }^2+(\parallel x_n-x^{\ast }\parallel +\parallel x_{n+1}-x^{\ast }\parallel )\times \parallel x_n-x_{n+1}\parallel .\end{array}$$

Since ${lim}_{n\to \mathrm{\infty }}{\alpha }_n=0$, ${lim}_{n\to \mathrm{\infty }}\parallel x_n-x_{n+1}\parallel =0$ and ${lim\hspace{0.17em}inf}_{n\to \mathrm{\infty }}{\gamma }_{n}a(2\alpha -\frac{b}{1-{\alpha }_n})>0$, we deduce

$$\underset{n\to \mathrm{\infty }}{lim}\parallel A{x}_n-A{x}^{\ast }\parallel =0.$$

By the property (ii) of the metric projection $P_C$, we have

$$\begin{array}{rl}{\parallel y_n-x^{\ast }\parallel }^2=& {\parallel P_C[{\alpha }_{n}F{x}_n+(1-{\alpha }_n)x_n-{\lambda }_{n}A{x}_n]-P_C[x^{\ast }-{\lambda }_{n}A{x}^{\ast }]\parallel }^2\\ \le & 〈{\alpha }_{n}F{x}_n+(1-{\alpha }_n)x_n-{\lambda }_{n}A{x}_n-(x^{\ast }-{\lambda }_{n}A{x}^{\ast }),y_n-x^{\ast }〉\\ =& \frac{1}{2}\{{\parallel x_n-{\lambda }_{n}A{x}_n-(x^{\ast }-{\lambda }_{n}A{x}^{\ast })+{\alpha }_n(F{x}_n-x_n)\parallel }^2+{\parallel y_n-x^{\ast }\parallel }^2\\ -{\parallel {\alpha }_{n}F{x}_n+(1-{\alpha }_n)x_n-{\lambda }_{n}A{x}_n-(x^{\ast }-{\lambda }_{n}A{x}^{\ast })-(y_n-x^{\ast })\parallel }^2\}\\ \le & \frac{1}{2}\{{\parallel (x_n-{\lambda }_{n}A{x}_n)-(x^{\ast }-{\lambda }_{n}A{x}^{\ast })\parallel }^2\\ +2{\alpha }_n\parallel F{x}_n-x_n\parallel \parallel x_n-{\lambda }_{n}A{x}_n-(x^{\ast }-{\lambda }_{n}A{x}^{\ast })+{\alpha }_n(F{x}_n-x_n)\parallel \\ +{\parallel y_n-x^{\ast }\parallel }^2-{\parallel (x_n-y_n)-{\lambda }_n(A{x}_n-A{x}^{\ast })+{\alpha }_n(F{x}_n-x_n)\parallel }^2\}\\ \le & \frac{1}{2}\{{\parallel (x_n-{\lambda }_{n}A{x}_n)-(x^{\ast }-{\lambda }_{n}A{x}^{\ast })\parallel }^2+{\alpha }_{n}M+{\parallel y_n-x^{\ast }\parallel }^2\\ -{\parallel (x_n-y_n)-{\lambda }_n(A{x}_n-A{x}^{\ast })+{\alpha }_n(F{x}_n-x_n)\parallel }^2\}\\ \le & \frac{1}{2}\{{\parallel x_n-x^{\ast }\parallel }^2+{\alpha }_{n}M+{\parallel y_n-x^{\ast }\parallel }^2-{\parallel x_n-y_n\parallel }^2+2{\lambda }_n〈x_n-y_n,A{x}_n-A{x}^{\ast }〉\\ -2{\alpha }_n〈F{x}_n-x_n,x_n-y_n〉-{\parallel {\lambda }_n(A{x}_n-A{x}^{\ast })-{\alpha }_n(F{x}_n-x_n)\parallel }^2\}\\ \le & \frac{1}{2}\{{\parallel x_n-x^{\ast }\parallel }^2+{\alpha }_{n}M+{\parallel y_n-x^{\ast }\parallel }^2-{\parallel x_n-y_n\parallel }^2\\ +2{\lambda }_n\parallel x_n-y_n\parallel \parallel A{x}_n-A{x}^{\ast }\parallel +2{\alpha }_n\parallel F{x}_n-x_n\parallel \parallel x_n-y_n\parallel \},\end{array}$$

where $M>0$ is some constant satisfying

$$\underset{n}{sup}\{2\parallel F{x}_n-x_n\parallel \parallel x_n-{\lambda }_{n}A{x}_n-(x^{\ast }-{\lambda }_{n}A{x}^{\ast })+{\alpha }_n(F{x}_n-x_n)\parallel \}\le M.$$

It follows that

$$\begin{array}{rcl}{\parallel y_n-x^{\ast }\parallel }^2& \le & {\parallel x_n-x^{\ast }\parallel }^2+{\alpha }_{n}M-{\parallel x_n-y_n\parallel }^2+2{\lambda }_n\parallel x_n-y_n\parallel \parallel A{x}_n-A{x}^{\ast }\parallel \\ +2{\alpha }_n\parallel F{x}_n-x_n\parallel \parallel x_n-y_n\parallel ,\end{array}$$

and hence

$$\begin{array}{rcl}{\parallel x_{n+1}-x^{\ast }\parallel }^2& \le & (1-{\gamma }_n){\parallel x_n-x^{\ast }\parallel }^2+{\gamma }_n{\parallel y_n-x^{\ast }\parallel }^2\\ \le & {\parallel x_n-x^{\ast }\parallel }^2+{\alpha }_{n}M-{\gamma }_n{\parallel x_n-y_n\parallel }^2+2{\lambda }_n\parallel x_n-y_n\parallel \parallel A{x}_n-A{x}^{\ast }\parallel \\ +2{\alpha }_n\parallel F{x}_n-x_n\parallel \parallel x_n-y_n\parallel ,\end{array}$$

which implies that

$$\begin{array}{rl}{\gamma }_n{\parallel x_n-y_n\parallel }^2\le & (\parallel x_n-x^{\ast }\parallel +\parallel x_{n+1}-x^{\ast }\parallel )\parallel x_{n+1}-x_n\parallel +2{\lambda }_n\parallel x_n-y_n\parallel \parallel A{x}_n-A{x}^{\ast }\parallel \\ +{\alpha }_{n}M+2{\alpha }_n\parallel F{x}_n-x_n\parallel \parallel x_n-y_n\parallel .\end{array}$$

Since ${lim}_{n\to \mathrm{\infty }}{\alpha }_n=0$, ${lim}_{n\to \mathrm{\infty }}\parallel x_n-x_{n+1}\parallel =0$ and ${lim}_{n\to \mathrm{\infty }}\parallel A{x}_n-A{x}^{\ast }\parallel =0$, we derive

$$\underset{n\to \mathrm{\infty }}{lim}\parallel x_n-y_n\parallel =0,$$

and this concludes the proof. □

Proposition 5 ${lim\hspace{0.17em}sup}_{n\to \mathrm{\infty }}〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉\le 0$, where $\tilde{x}=P_{SVI(C,A)}F\tilde{x}$.

Proof In order to show that ${lim\hspace{0.17em}sup}_{n\to \mathrm{\infty }}〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉\le 0$, we choose a subsequence $\{y_{n_i}\}$ of $\{y_n\}$ such that

$$\underset{n\to \mathrm{\infty }}{lim\hspace{0.17em}sup}〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉=\underset{i\to \mathrm{\infty }}{lim}〈\tilde{x}-F\tilde{x},\tilde{x}-y_{n_i}〉.$$

As $\{y_{n_i}\}$ is bounded, we deduce that a subsequence $\{y_{n_{ij}}\}$ of $\{y_{n_i}\}$ converges weakly to z.

Next, we show that $z\in SVI(C,A)$. The following proofs are similar to the one in [45]. Since the involved algorithms are not different, we still give the details. Now, we define a mapping T by the formula

$$Tv=\{\begin{array}{ll}Av+N_{C}v,& v\in C,\\ \mathrm{\varnothing },& v\notin C.\end{array}$$

Then T is maximal monotone.

Let $(v,w)\in G(T)$. Since $w-Av\in N_{C}v$ and $y_n\in C$, we have $〈v-y_n,w-Av〉\ge 0$. On the other hand, from $y_n=P_C[{\alpha }_{n}F{x}_n+(1-{\alpha }_n)x_n-{\lambda }_{n}A{x}_n]$, we obtain

$$〈v-y_n,y_n-{\alpha }_{n}F{x}_n-(1-{\alpha }_n)x_n+{\lambda }_{n}A{x}_n〉\ge 0,$$

that is,

$$〈v-y_n,\frac{y_n-x_n}{{\lambda }_n}+A{x}_n-\frac{{\alpha }_n}{{\lambda }_n}(F{x}_n-x_n)〉\ge 0.$$

Therefore, we have

$$\begin{array}{rcl}〈v-y_{n_i},w〉& \ge & 〈v-y_{n_i},Av〉\\ \ge & 〈v-y_{n_i},Av〉-〈v-y_{n_i},\frac{y_{n_i}-x_{n_i}}{{\lambda }_{n_i}}+A{x}_{n_i}-\frac{{\alpha }_{n_i}}{{\lambda }_{n_i}}(F{x}_{n_i}-x_{n_i})〉\\ =& 〈v-y_{n_i},Av-A{x}_{n_i}-\frac{y_{n_i}-x_{n_i}}{{\lambda }_{n_i}}+\frac{{\alpha }_{n_i}}{{\lambda }_{n_i}}(F{x}_{n_i}-x_{n_i})〉\\ =& 〈v-y_{n_i},Av-A{y}_{n_i}〉+〈v-y_{n_i},A{y}_{n_i}-A{x}_{n_i}〉\\ -〈v-y_{n_i},\frac{y_{n_i}-x_{n_i}}{{\lambda }_{n_i}}-\frac{{\alpha }_{n_i}}{{\lambda }_{n_i}}(F{x}_{n_i}-x_{n_i})〉\\ \ge & 〈v-y_{n_i},A{y}_{n_i}-A{x}_{n_i}〉-〈v-y_{n_i},\frac{y_{n_i}-x_{n_i}}{{\lambda }_{n_i}}-\frac{{\alpha }_{n_i}}{{\lambda }_{n_i}}(F{x}_{n_i}-x_{n_i})〉.\end{array}$$

Noting that ${\alpha }_{n_i}\to 0$, $\parallel y_{n_i}-x_{n_i}\parallel \to 0$ and A is Lipschitz continuous, we obtain $〈v-z,w〉\ge 0$. Since T is maximal monotone, we have $z\in T^{-1}(0)$ and hence $z\in SVI(C,A)$. Therefore,

$$\underset{n\to \mathrm{\infty }}{lim\hspace{0.17em}sup}〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉=\underset{i\to \mathrm{\infty }}{lim}〈\tilde{x}-F\tilde{x},\tilde{x}-y_{n_i}〉=〈\tilde{x}-F\tilde{x},\tilde{x}-z〉\le 0.$$

The proof of this proposition is now complete. □

Finally, by using Propositions 3-5, we prove Theorem 1.

Proof By the property of the metric projection $P_C$, we have

$$\begin{array}{rl}{\parallel y_n-\tilde{x}\parallel }^2=& \parallel P_C[{\alpha }_{n}F{x}_n+(1-{\alpha }_n)(x_n-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}_n)]\\ -P_C[{\alpha }_n\tilde{x}+(1-{\alpha }_n)(\tilde{x}-\frac{{\lambda }_n}{1-{\alpha }_n}A\tilde{x})]{\parallel }^2\\ \le & 〈{\alpha }_n(F{x}_n-\tilde{x})+(1-{\alpha }_n)[(x_n-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}_n)-(\tilde{x}-\frac{{\lambda }_n}{1-{\alpha }_n}A\tilde{x})],y_n-\tilde{x}〉\\ \le & {\alpha }_n〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉+{\alpha }_n〈F\tilde{x}-F{x}_n,\tilde{x}-y_n〉\\ +(1-{\alpha }_n)\parallel (x_n-\frac{{\lambda }_n}{1-{\alpha }_n}A{x}_n)-(\tilde{x}-\frac{{\lambda }_n}{1-{\alpha }_n}A\tilde{x})\parallel \parallel y_n-\tilde{x}\parallel \\ \le & {\alpha }_n〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉+{\alpha }_n\parallel F\tilde{x}-F{x}_n\parallel \parallel \tilde{x}-y_n\parallel +(1-{\alpha }_n)\parallel x_n-\tilde{x}\parallel \parallel y_n-\tilde{x}\parallel \\ \le & {\alpha }_n〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉+[1-(1-\rho ){\alpha }_n]\parallel x_n-\tilde{x}\parallel \parallel \tilde{x}-y_n\parallel \\ \le & {\alpha }_n〈\tilde{x}-G\tilde{x},\tilde{x}-y_n〉+\frac{1-(1-\rho ){\alpha }_n}{2}{\parallel x_n-\tilde{x}\parallel }^2+\frac{1}{2}{\parallel y_n-\tilde{x}\parallel }^2.\end{array}$$

Hence,

$${\parallel y_n-\tilde{x}\parallel }^2\le [1-(1-\rho ){\alpha }_n]{\parallel x_n-\tilde{x}\parallel }^2+2{\alpha }_n〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉.$$

Therefore,

$$\begin{array}{rcl}{\parallel x_{n+1}-\tilde{x}\parallel }^2& \le & (1-{\gamma }_n){\parallel x_n-\tilde{x}\parallel }^2+{\gamma }_n{\parallel y_n-\tilde{x}\parallel }^2\\ \le & [1-(1-\rho ){\alpha }_n{\gamma }_n]{\parallel x_n-\tilde{x}\parallel }^2+2{\alpha }_n{\gamma }_n〈\tilde{x}-F\tilde{x},\tilde{x}-y_n〉.\end{array}$$

We apply Lemma 3 to the last inequality to deduce that $x_n\to \tilde{x}$.

The proof of our main result is completed. □

Remark 2 Our algorithm (7) includes Korpelevich’s method (4) as a special case. However, it is well known that Korpelevich’s algorithm (4) has only weak convergence in the setting of infinite-dimensional Hilbert spaces. But our algorithm (7) has strong convergence in the setting of infinite-dimensional Hilbert spaces.

If we take $F\equiv 0$, then we have the following algorithm:

• 1. Initialization:

  $$x_0\in C.$$

• 2. Iterative step: Given $x_n$, define

  $$\{\begin{array}{c}{y}_n=P_C[x_n-{\lambda }_{n}A{x}_n-{\alpha }_n{x}_n],\hfill \\ x_{n+1}=P_C[x_n-{\mu }_{n}A{y}_n+{\gamma }_n(y_n-x_n)],n\ge 0.\hfill \end{array}$$

  (11)

Corollary 1 Suppose that $SVI(C,A)\ne \mathrm{\varnothing }$. Assume that the algorithm parameters $\{{\alpha }_n\}$, $\{{\lambda }_n\}$, $\{{\mu }_n\}$ and $\{{\gamma }_n\}$ satisfy the following conditions:

• (C1) ${lim}_{n\to \mathrm{\infty }}{\alpha }_n=0$ and ${\sum }_{n=1}^{\mathrm{\infty }}{\alpha }_n=\mathrm{\infty }$;

• (C2) ${\lambda }_n\in [a,b]\subset (0,2\alpha )$ and ${lim}_{n\to \mathrm{\infty }}({\lambda }_{n+1}-{\lambda }_n)=0$;

• (C3) ${\gamma }_n\in (0,1)$, ${\mu }_n\le 2\alpha {\gamma }_n$ and ${lim}_{n\to \mathrm{\infty }}({\gamma }_{n+1}-{\gamma }_n)={lim}_{n\to \mathrm{\infty }}({\mu }_{n+1}-{\mu }_n)=0$.

Then the sequence $\{x_n\}$ generated by (11) converges strongly to the minimum norm element $\tilde{x}$ in $SVI(C,A)$.

Proof It is clear that algorithm (11) is a special case of algorithm (7). So, from Theorem 1, we have that the sequence $\{x_n\}$ defined by (11) converges strongly to $\tilde{x}\in SVI(C,A)$, which solves

$$〈\tilde{x},\tilde{x}-x^{\ast }〉\le 0,\text{for all }{x}^{\ast }\in SVI(C,A).$$

(12)

Applying the characterization of the metric projection, we can deduce from (12) that

$$x^{\ast }=P_{SVI(C,A)}(0).$$

This indicates that $\tilde{x}$ is the minimum-norm element in $SVI(C,A)$. This completes the proof. □

Remark 3 Corollary 1 includes the main result in [1] as a special case.