- Research
- Open access
- Published:
A hybrid inertial algorithm for approximating solution of convex feasibility problems with applications
Fixed Point Theory and Applications volume 2020, Article number: 12 (2020)
Abstract
An inertial iterative algorithm for approximating a point in the set of zeros of a maximal monotone operator which is also a common fixed point of a countable family of relatively nonexpansive operators is studied. Strong convergence theorem is proved in a uniformly convex and uniformly smooth real Banach space. This theorem extends, generalizes and complements several recent important results. Furthermore, the theorem is applied to convex optimization problems and to J-fixed point problems. Finally, some numerical examples are presented to show the effect of the inertial term in the convergence of the sequence of the algorithm.
1 Introduction
An inertial-type algorithm was first introduced and studied by Polyak [35], as a method of speeding up the convergence of the sequence of an algorithm. This algorithm is a two step iterative procedure in which the successive iterates are obtained by using two previous iterates. Numerical experiments have shown that an algorithm with an inertial extrapolation term converges faster than an algorithm without it. Thus, one can see an increasing interest in the class of inertial-type algorithms (see, for example, the following papers [12, 26, 44] and the references therein).
Let X be a real normed space with dual space \(X^{*}\). Let \(T:X\to 2^{X^{*}}\), be a set-valued operator with domain \(D(T):=\{p\in X :Tp \neq\emptyset\}\), range \(R(T):=\bigcup_{p\in D(T)}\{ Tp\}\) and graph \(G(T):=\{(p,p^{*}) : p^{*}\in Tp\}\). Then T is called monotone if
T is said to be maximal monotone if \(G(T)\) is not properly contained in the graph of any other monotone operator. Monotone maps were first introduced by Minty [29] to aid in the abstract study of electrical networks and later studied by Browder [4] in the setting of partial differential equations. Later, Kačurovskii [19], Minty [30], Zarantonello [48] and many other authors studied this class of operators in Hilbert spaces. Interest in monotone operators stems mainly from their various applications (see e.g., the following monographs [2, 5, 17] and the references therein).
A fundamental problem of interest in the study of monotone operators in Banach spaces is the following:
For the prove of existence of solutions of (1.2) see, for example, Browder [3], and Martin [27]. Many problems in applications can be transformed into the form of the inclusion (1.2). For example, problems arising from convex minimization, variational inequality, Hammerstein equations, and evolution equations can be transformed into the form of the inclusion (1.2) (see, e.g., Chidume et al. [8, 14], Rockafellar [37]).
Iterative methods for approximating solutions of the inclusion (1.2) have been studied extensively by various authors in Hilbert spaces and in more general Banach spaces. One of the classical methods for approximating solution(s) of (1.2) in Hilbert spaces is the celebrated proximal point algorithm (PPA) introduced by Martinet [28] and studied extensively by Rockafellar [37] and a host of other authors. Concerning the iterative approximation of solution(s) of (1.2) in more general Banach space, see, e.g., [6, 11, 14, 20, 32].
Let \(S: X \to X\) be a map and let \(p\in X\), p be called an asymptotic fixed point of S if X contains a sequence \(\{ p_{n}\}\) which converges weakly to p and \(\lim_{n \to \infty} \|p_{n}-Sp_{n}\|=0\). We denote the set of asymptotic fixed points of S by \(\widehat{F}(S)\). The map S is said to be relatively nonexpansive if \(\widehat{F}(S)=F(S)\neq\emptyset\) and \(\psi(p,Sq)\leq\psi(p,q)\), for all \(p\in F(S)\) and \(q\in X\), where \(F(S)=\{p\in X : Sp=p\}\) and ψ is the Lyapunov function (see, e.g., Alber [1]).
One of the motivations for the study of relatively nonexpansive self or nonself mappings in Banach spaces is the fact that they are an extension of nonexpansive mappings with nonempty fixed point sets in Hilbert spaces. In 2018, Chidume et al. [12] introduced and studied an inertial-type algorithm in a uniformly convex and uniformly smooth real Banach space. They proved the following theorem.
Theorem 1.1
LetBbe a uniformly convex and uniformly smooth real Banach space. Let\(T_{i} :B\rightarrow B\), \(i=1,2,3,\ldots\)be a countable family of relatively nonexpansive maps such that\(\bigcap_{i=1}^{\infty}F(T_{i})\neq \emptyset\). Suppose\({\lbrace\eta_{i} \rbrace} \subset(0,1)\)and\({\lbrace\beta_{i} \rbrace} \subset(0,1)\)are sequences such that\(\sum_{i=1}^{\infty}\eta_{i}=1\)and\(T :B \rightarrow B\)is defined by\(Tp=J^{-1} (\sum_{i=1}^{\infty}\eta_{i}(\beta_{i}Jp+(1-\beta _{i})JT_{i}p) )\)for each\(p\in B\). Let\(\lbrace x_{n}\rbrace\)be generated by the following algorithm:
\(n\geq0\), where\(\alpha_{n}\in[0,1)\), \(\beta\in(0,1)\). Then\(\{x_{n}\}\)converges strongly to\(p=\varPi_{F(T)}x_{0}\).
Several iterative algorithms for approximating fixed points of self maps satisfying certain contractive conditions and zeros of monotone and monotone type operators has recently been studied extensively by various authors; see e.g., [24, 33, 34, 39–42]. In 2009, Inoue et al. [18] introduced and studied a hybrid algorithm in a uniformly convex and uniformly smooth Banach space. They proved the following theorem.
Theorem 1.2
LetBbe a uniformly convex and uniformly smooth Banach space and letCbe a nonempty closed and convex subset ofB. Let\(A: B\to 2^{B^{*}}\)be a maximal monotone operator satisfying\(D(A) \subset C\)and let\(J_{r}=(J+rA)^{-1}J\)for all\(r>0\). Let\(S: C \to C\)be a relatively nonexpansive mapping such that\(F(S)\cap A^{-1}0 \neq\emptyset\). Let\(\{x_{n}\}\)be a sequence generated by\(x_{0}=x\in C\)and
for all\(n\in \Bbb {N}\cup\{0\}\), whereJis the duality mapping onB, \(\{\beta_{n}\}\subset[0,1]\), and\(\{r_{n}\}\subset[a,\infty)\)for some\(a>0\). If\(\liminf_{n\to\infty}(1-\beta_{n})>0\), then\(\{x_{n}\}\)converges strongly to\(\varPi_{F(S)\cap A^{-1}0}x_{0}\).
In 2009, Klin et al. [21] extended the results of Inoue et al. [18]. They proved the following theorem.
Theorem 1.3
LetBbe a uniformly convex and uniformly smooth Banach space and letCbe a nonempty closed and convex subset ofB. Let\(A: B\to 2^{B^{*}}\)be a maximal monotone operator satisfying\(D(A) \subset C\)and let\(J_{r}=(J+rA)^{-1}J\)for all\(r>0\). LetSandTbe relatively nonexpansive mappings fromCinto itself such that\(\varOmega =F(S)\cap F(T)\cap A^{-1}0 \neq\emptyset\). Let\(\{x_{n}\}\)be a sequence generated by\(x_{0}\in C\)and
for all\(n\in \Bbb {N}\cup\{0\}\), whereJis the duality mapping onB, \(\{\alpha_{n}\},\{\beta_{n}\}\subset[0,1]\), and\(\{r_{n}\}\subset [a,\infty)\)for some\(a>0\). If\(\liminf_{n\to\infty}(1-\alpha _{n})>0\)and\(\liminf_{n\to\infty}(1-\beta_{n})>0\), then\(\{x_{n}\}\)converges strongly to\(\varPi_{\varOmega}x_{0}\).
Motivated by the results of Chidume et al. [12] and Klin et al. [21], in this paper we introduce and study an inertial iterative algorithm in a uniformly convex and uniformly smooth real Banach space and prove a strong convergence theorem for approximating a common element in the set of zeros of a maximal monotone operator and the sets of fixed points of countable family of relatively nonexpansive mappings. Furthermore, we give applications of our theorem to convex optimization and J-fixed point. Finally, we present numerical examples to demonstrate the effect of the inertial term on the convergence of the sequence of our algorithm.
2 Preliminaries
The following definitions and lemmas will be needed in the sequel.
Definition 2.1
Let X be a real normed space. The normalized duality map J from X to \(2^{X^{*}}\) is defined by \(Jp := \lbrace p^{*}\in X^{*} :\langle p,p^{*} \rangle=\|p\|^{2}=\|p^{*}\| ^{2}, \forall p\in X \rbrace\), where \(\langle\cdot, \cdot \rangle\) denotes the value of \(p^{*}\) at p and \(X^{*}\) is the dual space of X. It is well known that if X is smooth then J is single-valued and if X is uniformly smooth, then J is uniformly continuous on bounded subsets of X.
Definition 2.2
Let B be a smooth real Banach space; the Lyapunov functional \(\psi: B\times B \to \Bbb {R}\) is defined by
The mapping ψ was introduced by Alber [1]. Since its introduction, one can notice an increasing interest in the functional see e.g., [7, 10, 38, 43, 45, 46, 49]. Observe that, in a real Hilbert space H, Eq. (2.1) reduces to \(\psi(p,y)=\|p-y\|^{2}\), \(\forall p,y\in H\). Furthermore, the following properties of ψ can be verified easily from its definition:
-
(P1)
\((\|p\|-\|q\|)^{2}\leq\psi(p,q) \leq(\|p\|+\|q\|)^{2}\),
-
(P2)
\(\psi(p,q)= \psi(p,z)+\psi(z,q)+2\langle p-z, Jz-Jq \rangle\),
-
(P3)
\(\psi(p,q) \leq\|p\|\|Jp-Jq\|+\|q-p\|\|q\|\),
for all \(p,q,z \in B\).
Definition 2.3
Let B be a strictly convex, smooth and reflexive real Banach space and let C be a nonempty, closed and convex subset of B. The map \(\varPi_{C}:B\rightarrow C\) defined by \(\tilde{t}:=\varPi_{C} (t) \) such that \(\psi(\tilde{t},t)= \inf_{y\in C}\psi(y,t)\) is called the generalized projection of t onto C. Observe that in a real Hilbert space, the generalized projection \(\varPi_{C}\) and the metric projection \(P_{C}\) are equivalent.
Lemma 2.4
(Rockafellar, [36])
LetBbe a smooth, strictly convex and reflexive real Banach space and\(A: B\to2^{B^{*}}\)be a monotone mapping. ThenAis maximal if and only if\(R(J+rA)=B^{*}\), \(\forall r>0\).
Lemma 2.5
(Alber, [1])
LetCbe a nonempty closed and convex subset of a smooth, strictly convex and reflexive real Banach spaceB. Then:
-
(1)
given\(t\in B\)and\(y \in C\), \(\tilde{t} =\varPi_{C}t\)if and only if\(\langle\tilde{t}-y, Jt-J\tilde{t} \rangle\geq0\), for all\(y\in C\),
-
(2)
\(\psi(y,\tilde{t})+\psi(\tilde{t},t)\leq\psi(y,t)\), for all\(t\in B, y \in C\).
Lemma 2.6
(Nilsrakoo and Saejung, [31])
Let B be a smooth Banach space. Then
Remark 1
Let B be a smooth, strictly convex and reflexive real Banach space, let C be a nonempty closed and convex subset of B and let \(A: B\to 2^{B^{*}}\) be a monotone operator satisfying
Then we can define the resolvent \(J_{r}: C\to D(A)\) of A by
It is well known that \(J_{r}t\) is single-valued. For \(r>0\), the Yosida approximation \(A_{r}:C\to B^{*}\) is defined by \(A_{r}t=(Jt-JJ_{r}t)/r\) for all \(t\in C\).
Lemma 2.7
(Kohsaka and Takahashi, [22])
LetBbe a smooth, strictly convex and reflexive real Banach space, letCbe a nonempty closed convex subset ofBand let\(A: B\to 2^{B^{*}}\)be a monotone operator satisfying (2.2). Let\(r>0\)and let\(J_{r}\)and\(A_{r}\)be the resolvent and the Yosida approximation ofA, respectively. Then the following hold:
-
(i)
\(\psi(u,J_{r}t)+\psi(J_{r}t,t)\leq\psi(u,t)\), \(\forall t\in C\), \(u\in A^{-1}0\);
-
(ii)
\((J_{r}t, A_{r}t)\in A\), \(\forall t\in C\), where\((t,t^{*})\in A\)denotes the value of\(t^{*}\)att (\(t^{*}\in At\)).
-
(iii)
\(F(J_{r})=A^{-1}0\).
Lemma 2.8
(Xu, [47])
LetBbe a uniformly convex Banach space and let\(r>0\). Then there exists a strictly increasing, continuous, and convex function\(g:[0,\infty) \to[0,\infty)\)such that\(g(0)=0\)and
for all\(t,y\in B_{r}(0)\)and\(\tau\in[0,1]\).
Lemma 2.9
(Kamimura and Takahashi, [20])
LetBbe a uniformly convex and smooth real Banach space, and let\(\{ x_{n}\}\)and\(\{y_{n}\}\)be two sequences ofB. If either\(\{x_{n}\}\)or\(\{y_{n}\}\)is bounded and\(\psi(x_{n},y_{n} )\to0\), then\(\Vert x_{n}-y_{n}\Vert\to0 \).
Lemma 2.10
(Kohsaka and Takahash, [23])
LetCbe a closed convex subset of a uniformly smooth and uniformly convex Banach spaceBand let\((S_{i})_{i=1}^{\infty}\), \(S_{i}: C \to B\), for each\(i \ge1\), be a family of relatively nonexpansive maps such that\(\bigcap_{i=1}^{\infty}F(S_{i}) \neq\emptyset\). Let\((\eta_{i})_{i=1}^{\infty}\subset(0,1)\)and\((\mu_{i})_{i=1}^{\infty}\subset(0,1)\)be sequences such that\(\sum_{i=1}^{\infty}\eta_{i} =1\). Consider the map\(T:C \to B\)defined by
ThenTis relatively nonexpansive and\(F(T)=\bigcap_{i=1}^{\infty}F(S_{i})\).
3 Main result
Theorem 3.1
LetBbe a uniformly convex and uniformly smooth real Banach space. Let\(A: B\to2^{B^{*}}\)be a maximal monotone operator and let\(J_{r}=(J+rA)^{-1}J\), for all\(r>0\). Let\(S:B\to B\)and\(T:B \to B\)be relatively nonexpansive mappings such that\(\varOmega =F(S)\cap F(T)\cap A^{-1} 0 \neq\emptyset\). Define inductively the sequence\(\{x_{n}\}\)by: \(x_{0},x_{1} \in B\)
for all\(n\in \Bbb {N}\cup\{0\}\), \(\{\alpha_{n}\} \subset[0,1)\), \(\beta, \gamma\in(0,1)\)and\(\{r_{n}\} \subset[a,\infty)\), for some\(a>0\). Then\(\{x_{n}\}\)converges strongly to\(\varPi_{\varOmega}x_{0}\).
Proof
We divide the proof into four steps.
Step 1. We show that \(\{x_{n}\}\) is well defined and \(\varOmega \subset C_{n}\), \(\forall n\geq0\). Observe that by definition, \(C_{n+1}\) is closed and convex, \(\forall n\geq0\). We now show that \(\varOmega \subset C_{n}\). Let \(y_{n}=J_{r_{n}}w_{n}\) and \(u\in\varOmega\). Using Lemma 2.6, the fact that S is relatively nonexpansive and Lemma 2.7(i), we obtain
Similarly, using Lemma 2.6, the fact that T is relatively nonexpansive and inequality (3.3), we have
which implies \(u\in C_{n+1}\). So, by induction, \(\varOmega\subset C_{n}\), \(\forall n\geq 0\). Thus, \(\{x_{n}\}\) is well defined.
Step 2. We show that \(\{x_{n}\}\), \(\{w_{n}\}\), \(\{z_{n}\}\), \(\{u_{n}\}\) are bounded and \(\{x_{n}\}\) is Cauchy. We observe that \(x_{n}=\varPi_{C_{n}}x_{0}\) and \(C_{n+1}\subset C_{n}\), \(\forall n\geq0\). So, by Lemma 2.5(2)
Thus, \(\{\psi(x_{n},x_{0})\}\) is nondecreasing. Furthermore, we have
which implies that \(\{\psi(x_{n},x_{0})\}\) is bounded and by (P1), \(\{x_{n}\} \) is also bounded. Since \(\{\psi(x_{n},x_{0})\}\) is nondecreasing, \(\{\psi (x_{n},x_{0})\}\) is convergent. Furthermore, \(\{x_{n}\}\) bounded implies \(\{ w_{n}\}\) is bounded which also imply that \(\{z_{n}\}\) and \(\{u_{n}\}\) are bounded (by using inequalities (3.3) and (3.4), respectively and (P1)).
Next we show that \(\{x_{n}\}\) is Cauchy. Using Lemma 2.5(2)
Hence, \(\{x_{n}\}\) is Cauchy and this implies that \(\|x_{n+1}-x_{n}\|\to 0\), as \(n\to\infty\).
Step 3. We show the following:
-
\(\lim_{n\to\infty} \|x_{n}-w_{n}\|=0\), \(\lim_{n\to\infty} \| x_{n}-u_{n}\|=0\),
-
\(\lim_{n\to\infty} \|z_{n}-Tz_{n}\|=0\), \(\lim_{n\to\infty} \| y_{n}-Sy_{n}\|=0\).
Using the definition of \(w_{n}\), we have
Now, using the fact that \(\{w_{n}\}\) is bounded, we have \(\psi (x_{n},w_{n})\to0\), as \(n\to\infty\). Since \(x_{n+1}\in C_{n}\), it follows that
Thus, \(\lim_{n\to\infty}\psi(x_{n+1},u_{n})=0\), which implies that \(\lim_{n\to\infty}\|x_{n+1}-u_{n}\|=0\). Hence, \(\lim_{n\to\infty}\| x_{n}-u_{n}\|=0\). By the uniform continuity of J on bounded sets, we have
Observe that
which implies
Thus, \(\lim_{n\to\infty}\|Jx_{n+1}-JTz_{n}\|=0\). By the uniform continuity of \(J^{-1}\) on bounded sets, we have \(\lim_{n\to\infty} \|x_{n+1}-Tz_{n}\|=0\). Furthermore,
Next we show that \(\lim_{n\to\infty} \|z_{n}-Tz_{n}\|= \lim_{n\to\infty} \|y_{n}-Sy_{n}\|=0\). Using Lemma 2.8 we have
This implies that
Let \(\{\|w_{n_{k}}-Sy_{n_{k}}\|\}\) be an arbitrary subsequence of \(\{\| w_{n}-Sy_{n}\|\}\). Since \(\{w_{n_{k}}\}\) is bounded, there exists a subsequence \(\{w_{n_{k_{j}}}\}\) of \(\{w_{n_{k}}\}\) such that
Using (P2), (P3) and the fact that T is relatively nonexpansive, we obtain
Since \(\lim_{n\to\infty}\|w_{n}-Tz_{n}\|=0\) and hence \(\lim_{n\to \infty}\|Jx_{n}-JTz_{n}\|=0\) we obtain
We also have from inequality (3.3)
and hence
Thus, it follows from inequality (3.6) that \(\lim_{j\to \infty}g(\|Jw_{n_{k_{j}}}-JSy_{n_{k_{j}}}\|)=0\). By the properties of g, we have \(\lim_{j \to\infty}\|Jw_{n_{k_{j}}}-JSy_{n_{k_{j}}}\|=0\). By the uniform continuity of \(J^{-1}\) on bounded sets, we obtain \(\lim_{j\to\infty} \|w_{n_{k_{j}}}-Sy_{n_{k_{j}}}\|=0\). Hence, \(\lim_{n \to\infty}\|w_{n}-Sy_{n}\|=0\). So, we have \(\lim_{n \to\infty} \| Jw_{n}-JSy_{n}\|=0\). Observe that
This implies that \(\lim_{n\to\infty}\|Jz_{n}-Jw_{n}\|=0\), and hence \(\lim_{n\to\infty}\|w_{n}-z_{n}\|=0\). Furthermore, from inequality (3.2), we have
Using \(y_{n}=J_{r_{n}}w_{n}\) and Lemma 2.7(i), we have
Thus, using inequality (3.8), we have
This implies that \(\lim_{n\to\infty} \psi(y_{n},w_{n})=0\). It follows from Lemma 2.9 that
Observe that
imply
Step 4. Finally, we show that \(\{x_{n}\}\) converges strongly to a point in Ω. Since \(\{w_{n}\}\) is bounded, there exists a subsequence \(\{w_{n_{k}}\}\) of \(\{w_{n}\}\) such that \(w_{n_{k}} \rightharpoonup p\). Furthermore, since \(\lim_{n\to\infty} \|w_{n}-y_{n}\|=0\) and \(\lim_{n \to\infty} \|w_{n}-z_{n}\|=0\), we have \(y_{n_{k}}\rightharpoonup p\) and \(z_{n_{k}}\rightharpoonup p\). Moreover, since S and T are relatively nonexpansive, we have \(p\in\widehat{F}(S)\cap\widehat {F}(T)=F(S)\cap F(T)\). Next, we show that \(p\in A^{-1} 0\). By the uniform continuity of J on bounded sets, it follows from inequality (3.9) that
Since \(r_{n}\geq a\), we have \(\lim_{n\to\infty}\frac{1}{r_{n}} \|Jw_{n}-Jy_{n}\|=0\). Therefore,
Using the fact that A is monotone and Lemma 2.7 (ii), we have
This implies that \(\lim_{k \to\infty}\langle v-y_{n_{k}},v^{*}-A_{r_{n_{k}}}w_{n_{k}} \rangle=\langle v-p, v^{*}\rangle\geq 0\). Thus, \(p\in A^{-1}0\), since A is maximal monotone. Therefore, \(p\in\varOmega\). From Step 3, there exists \(\{x_{n_{k}}\}\) a subsequence of \(\{x_{n}\}\), such that \(x_{n_{k}}\rightharpoonup p\), as \(k \to\infty\). We now show that \(p=\varPi_{\varOmega}x_{0}\). Set \(q=\varPi _{\varOmega}x_{0}\). Using the fact that \(x_{n}=\varPi_{C_{n}} x_{0}\) and \(\varOmega\subset C_{n}\), \(\forall n\geq0\), we have \(\psi(x_{n},x_{0})\leq \psi(q,x_{0})\). Using the fact that the norm is weakly lower semi-continuous, we obtain
But
Thus, \(\psi(p,x_{0})=\psi(q,x_{0})\). By uniqueness of \(\varPi_{\varOmega}x_{0}\), \(p=q\). Next, we show that \(x_{n_{k}}\to p\), as \(k\to\infty\). Using inequalities (3.10) and (3.11), we obtain \(\psi(x_{n_{k}},x_{0})\to\psi(p,x_{0})\), as \(k\to\infty\). Thus, \(\| x_{n_{k}}\|\to\|p\|\), as \(k \to\infty\). By the Kadec–Klee property of B, we conclude that \(x_{n_{k}}\to p\) as \(k \to\infty\). Therefore, \(x_{n} \to\varPi_{\varOmega}x_{0}\). This completes the proof. □
Theorem 3.2
LetBbe a uniformly convex and uniformly smooth real Banach space. Let\(A: B\to2^{B^{*}}\)be a maximal monotone operator and let\(J_{r}=(J+rA)^{-1}J\), for all\(r>0\). Let\(T: B \to B \)be a relatively nonexpansive and let\(\{ S_{i} \}_{i=1}^{\infty}\)be a countable family of relatively nonexpansive maps such that\(\bigcap_{i=1} ^{\infty}F(S_{i}) \neq\emptyset\), where\(S_{i}: B \to B \), ∀i. Let\(\{ \zeta_{i}\}_{i=1}^{\infty}\subset(0,1)\)and\(\{\tau_{i}\}_{i=1}^{\infty}\subset(0,1)\)be sequences such that\(\sum_{i=1}^{\infty}\zeta_{i} =1\). Assume\(\varOmega= (\bigcap_{i=1} ^{\infty}F(S_{i}) ) \cap F(T) \cap {A^{-1} 0 \neq\emptyset}\). Define inductively the sequence\(\{x_{n}\}\)by: \(x_{0},x_{1} \in B\)
for all\(n\in \Bbb {N}\cup\{0\}\), where\(St=J^{-1} (\sum_{i=1}^{\infty}\zeta_{i}(\tau_{i}Jt+(1-\tau_{i})JS_{i}t) )\)for each\(t \in B\), \(\{\alpha_{n}\} \subset[0,1)\), \(\beta, \gamma\in(0,1)\)and\(\{r_{n}\} \subset[a,\infty)\), for some\(a>0\). Then\(\{x_{n}\}\)converges strongly to\(\varPi_{\varOmega}x_{0}\).
Proof
By Lemma 2.10, S is relatively nonexpansive and \(F(S)=\bigcap_{i=1} ^{\infty}F(S_{i})\). The conclusion follows from Theorem 3.1. □
4 Applications
4.1 Application to a convex optimization problem
Let X be a normed space and let \(f : X\to(-\infty, \infty] \) be a convex, proper and lower semi-continuous function. The subdifferential of f is defined by
Observe that \(0\in\partial f(u) \) if and only if u is a minimizer of f. Furthermore, it is well known that the subdifferential of f, ∂f is maximal monotone (see, e.g., Rockafellar [37]). Set \(A=\partial f\) in Theorem 3.2.
4.2 Application to J-fixed point
The notion of J-fixed point (which has also been called semi-fixed point, Zegeye [49], duality fixed point, Liu [25]) has been defined and studied by Chidume and Idu [11], for maps from a space, say X, to its dual space \(X^{*}\).
Definition 4.1
Let \(T:X\to2^{X^{*}}\) be any map. A point \(u\in X\) is called a J-fixed point of T if \(Ju \in Tu\), where \(J:X\to X^{*}\) is the single-valued normalized duality map on X.
Consider, for example, the evolution inclusion
where \(A : B \to2^{B^{*}}\) is monotone. At equilibrium, we have
and the solutions of Eq. (4.2) correspond to equilibrium states of (4.1). Define \(T:B\to2^{B^{*}}\) by \(T:=J-A\). Then u is a J-fixed point of T if and only if u is a solution of (4.2). Consequently, approximating solutions of (4.2) is equivalent to approximating J-fixed points of maps \(T:X\to2^{X^{*}}\) defined by \(T:=J-A\). This connection is now generating considerable research interest in the study of J-fixed points (see, e.g., Chidume and Idu [11], Chidume and Monday [13], Chidume et al. [15, 16], and the references contained in them). This notion turns out to be very useful and applicable in approximating solutions of Eq. (4.2). For example, Chidume and Idu [11], introduced the concept of J-pseudocontractive maps and proved a strong convergence theorem for approximating J-fixed points of a J-pseudocontractive map. As an application of their theorem, they proved a strong convergence theorem for approximating a zero of a maximal monotone operator.
Recently, Chidume et al. [9] introduced the concept of relativelyJ-nonexpansive maps in a uniformly smooth and uniformly convex real Banach spaces. They gave the following definitions.
Definition 4.2
Let \(T:B\to B^{*}\) be a map. A point \(x^{*}\in B\) is called an asymptoticJ-fixed point ofT if there exists a sequence \(\{x_{n}\}\subset B\) such that \(x_{n}\rightharpoonup x^{*}\) and \(\|Jx_{n}-Tx_{n}\| \to0\), as \(n \to\infty\). We shall denote the set of asymptotic J-fixed points of T by \(\widehat{F}_{J}(T)\).
Definition 4.3
A map \(T:B\to B^{*}\) is said to be relativelyJ-nonexpansive if
-
(i)
\(\widehat{F}_{J}(T)=F_{J}(T) \neq\emptyset\),
-
(ii)
\(\psi(p,J^{-1}Tx)\leq\psi(p,x)\), \(\forall x\in B\), \(p\in F_{J}(T)\); where \(F_{J}(T)=\{x\in B: Tx=Jx \}\).
Chidume et al. [9] used these new definitions in approximating a common J-fixed point of a countable family of relatively J-nonexpansive mappings in a uniformly convex and uniformly smooth real Banach space. We now use these definitions to prove a similar result. The following remark is key in the proof of the theorem below.
Remark 2
Observe that in the definition above, a mapping T is relatively J-nonexpansive if and only if \(J^{-1}T\) is relatively nonexpansive in the usual sense. Furthermore, \(x^{*}\in F_{J} (T ) \Leftrightarrow x^{*}\in F (J^{-1} T )\).
Theorem 4.4
LetBbe a uniformly convex and uniformly smooth real Banach space. Let\(A: B\to2^{B^{*}}\)be a maximal monotone operator and let\(J_{r}=(J+rA)^{-1}J\), for all\(r>0\). Let\(T: B \to B^{*} \)be a relatively nonexpansive and let\(\{ S_{i} \}_{i=1}^{\infty}\)be a countable family of relatively nonexpansive maps such that\(\bigcap_{i=1} ^{\infty}F(S_{i}) \neq\emptyset\), where\(S_{i}: B \to B^{*} \), ∀i. Let\(\{\zeta_{i}\}_{i=1}^{\infty}\subset(0,1)\)and\(\{\tau_{i}\} _{i=1}^{\infty}\subset(0,1)\)be sequences such that\(\sum_{i=1}^{\infty}\zeta_{i} =1\). Assume\(\varOmega= (\bigcap_{i=1} ^{\infty}F(S_{i}) ) \cap F(T) \cap {A^{-1} 0 \neq\emptyset}\). Define inductively the sequence\(\{x_{n}\}\)by: \(x_{0},x_{1} \in B\)
for all\(n\in \Bbb {N}\cup\{0\}\), where\(Sx=J^{-1} (\sum_{i=1}^{\infty}\zeta_{i}(\tau_{i}Jx+(1-\tau_{i})JS_{i}x) )\)for each\(t \in B\), \(\{\alpha_{n}\} \subset[0,1)\), \(\beta, \gamma\in(0,1)\)and\(\{r_{n}\} \subset[a,\infty)\), for some\(a>0\). Then\(\{x_{n}\}\)converges strongly to\(\varPi_{\varOmega}x_{0}\).
Proof
By Remark 2, \(J^{-1}T\) is relatively nonexpansive and \(J^{-1}S_{i}\) is relatively nonexpansive for each i. The conclusion follows from Theorem 3.2. □
5 Numerical illustrations
In this section, we give some examples to illustrate the effect of the inertial term in the fast convergence of the sequence of our algorithm. For simplicity, we consider an example in \(\Bbb {R}\) and choose A such that the resolvent can be easily computed.
Example 1
In Theorems 1.3 and 3.1, set \(B=C_{0}=\Bbb {R}\),
Clearly, A is maximal monotone and, T and S are relatively nonexpansive. Furthermore, \(\varOmega=\{0\}\). We choose \(\alpha _{n}=\beta_{n}=\frac{4n}{4n+5}\), \(r_{n}=\frac{2n+1}{n}\), \(\beta=\frac {1}{2}\), \(\gamma=\frac{1}{4}\) as the parameters. Obviously, these parameters satisfy the hypothesis of Theorems 1.3 and 3.1. We choose \(x_{0}=x_{1}=0.5\) and use a tolerance of 10−14 and set maximum number of iteration to be 2000 (see Tables 1 and 2 and Figs. 1 and 2).
Next, we give an example to show that Algorithm (3.12) is implementable.
Example 2
In Theorem 3.2, set \(C_{0}=\Bbb {R}\)
Clearly, A is maximal monotone, T is relatively nonexpansive and \(S_{i}\) is relatively nonexpansive for each i. Furthermore, \(\varOmega = (\bigcap_{i=1} ^{\infty}F(S_{i}) ) \cap F(T) \cap A^{-1} 0 =\{0\}\). We choose \(\zeta_{i}=\tau_{i}=\frac{1}{2^{i}}\), \(i\geq1 \), and \(\alpha_{n}=\beta_{n}=\frac{4n}{4n+5}\), \(r_{n}=\frac{2n+1}{n}\), \(\beta =\frac{1}{2}\), \(\gamma=\frac{1}{4}\) as the parameters. Clearly, these parameters satisfy the hypothesis of Theorem 3.2. Observe that \(Sx=J^{-1} (\sum_{i=1}^{\infty}\eta_{i}(\mu_{i}Jx+{(1-\mu_{i})S_{i}x}) )=\frac{7x-4\sin x}{21}\). We choose \(x_{0}=1\), \(x_{1}= 2.5\) and use a tolerance of 10−14 and set the maximum number of iterations to be 2000 (see Table 3 and Fig. 3).
Conclusion. From the numerical experiments above, we observe that indeed incorporating the inertial term in our algorithm speeds up the convergence of the sequence generated by our algorithm to the desired solution.
References
Alber, Ya.I.: Metric and generalized projection operators in Banach spaces: properties and applications. In: Kartsatos, A.G. (ed.) Theory and Applications of Nonlinear Operators of Accretive and Monotone Type. Lecture Notes Pure Appl. Math., vol. 178, pp. 15–50 (1996)
Berinde, V.: Iterative Approximation of Fixed Points. Lecture Notes in Mathematics. Springer, London (2007)
Browder, F.E.: Nonlinear elliptic boundary value problems. Bull. Am. Math. Soc. 69, 862–874 (1963)
Browder, F.E.: Existence and perturbation theorems for nonlinear maximal monotone operators in Banach spaces. Bull. Am. Math. Soc. 73(3), 322–327 (1967)
Chidume, C.E.: Geometric Properties of Banach Spaces and Nonlinear Iterations. Lectures Notes in Mathematics, vol. 1965. Springer, London (2009)
Chidume, C.E.: Strong convergence theorems for bounded accretive operators in uniformly smooth Banach spaces. Contemp. Math. 659, 31–41 (2016)
Chidume, C.E., Adamu, A., Chinwendu, L.O.: A Krasnoselskii-type algorithm for approximating solutions of variational inequality problems and convex feasibility problems. J. Nonlinear Var. Anal. 2(2), 203–218 (2018)
Chidume, C.E., Adamu, A., Chinwendu, L.O.: Iterative algorithms for solutions of Hammerstein equations in real Banach spaces. Fixed Point Theory Appl. (2020). https://doi.org/10.1186/s13663-020-0670-7
Chidume, C.E., Adamu, A., Chinwendu, L.O.: Strong convergence theorem for some nonexpansive-type mappings in certain Banach spaces. Thai J. Math. (in press)
Chidume, C.E., Chinwendu, L.O., Adamu, A.: A hybrid algorithm for approximating solutions of a variational inequality problem and a convex feasibility problem. Adv. Nonlinear Var. Inequal. 21(1), 46–64 (2018)
Chidume, C.E., Idu, K.O.: Approximation of zeros of bounded maximal monotone maps, solutions of Hammerstein integral equations and convex minimization problems. Fixed Point Theory Appl. (2016). https://doi.org/10.1186/s13663-016-0582-8
Chidume, C.E., Ikechukwu, S.I., Adamu, A.: Inertial algorithm for approximating a common fixed point for a countable family of relatively nonexpansive maps. Fixed Point Theory Appl. (2018). https://doi.org/10.1186/s13663-018-0634-3
Chidume, C.E., Nnakwe, M.O.: A new Halpern-type algorithm for a generalized mixedequilibrium problem and a countable family of generalizednonexpansive-type maps. Carpath. J. Math. 34(2), 191–198 (2018)
Chidume, C.E., Nnakwe, M.O., Adamu, A.: A strong convergence theorem for generalized-Φ-strongly monotone maps, with applications. Fixed Point Theory Appl. (2019). https://doi.org/10.1186/s13663-019-0660-9
Chidume, C.E., Nnyaba, U.V., Romanus, O.M., Ezea, C.G.: Convergence theorems for strictly J-pseudocontractions with application to zeros of Gamma-inverse strongly monotone maps. Panam. Math. J. 26, 57–76 (2016)
Chidume, C.E., Uba, M.O., Uzochukwu, M.I., Otubo, E.E., Idu, K.O.: A strong convergence theorem for zeros of maximal monotone maps with applications to convex minimization and variational inequality problems. Proc. Edinb. Math. Soc. 62(1), 241–257 (2019)
Goebel, K., Reich, S.: Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings. Monographs and Textbooks in Pure and Applied Mathematics, vol. 83. Marcel Dekker, New York (1984)
Inoue, G., Takahashi, W., Zembayashi, K.: Strong convergence theorems by hybrid methods for maximal monotone operator and relatively nonexpansive mappings in Banach spaces. J. Convex Anal. 16(16), 791–806 (2009)
Kačurovskii, R.I.: On monotone operators and convex functionals. Usp. Mat. Nauk 15(4), 213–215 (1960)
Kamimura, S., Takahashi, W.: Strong convergence of a proximal-type algorithm in a Banach space. SIAM J. Optim. 13, 938–945 (2002)
Klin-eam, C., Suantai, S., Takahashi, W.: Strong convergence of generalized projection algorithms for nonlinear operators. Abstr. Appl. Anal. 2009, Article ID 649831 (2009). https://doi.org/10.1155/2009/649831
Kohsaka, F., Takahashi, W.: Existence and approximation of fixed points of firmly nonexpansive-type mappings in Banach spaces. SIAM J. Optim. 19(2), 824–835 (2008)
Kohsaka, F., Takahashi, W.: The set of common fixed points of an infinite family of relatively nonexpansive mappings. In: Banach and Function Spaces II, pp. 361–373. Yokohama Publishers, Yokohama (2008)
Kumam, P., Wattanawitoon, K.: Convergence theorems of a hybrid algorithm for equilibrium problems. Nonlinear Anal. Hybrid Syst. 3, 386–394 (2009)
Liu, B.: Fixed point of strong duality pseudocontractive mappings and applications. Abstr. Appl. Anal. (2012). https://doi.org/10.1155/2012/623625
Maingé, P.E., Merabet, N.: A new inertial-type hybrid projection-proximal algorithm for monotone inclusions. Appl. Math. Comput. 215(9), 3149–3162 (2010)
Martin, R.H.: A global existence theorem for autonomous differential equations in Banach spaces. Proc. Am. Math. Soc. 26, 307–314 (1970)
Martinet, B.: Regularisation d’inequations variationelles par approximations successives. Rev. Fr. Inform. Rech. Oper. 4, 154–159 (1970)
Minty, G.J.: Monotone networks. Proc. R. Soc. Lond. 257, 194–212 (1960)
Minty, G.J.: Monotone (nonlinear) operators in Hilbert space. Duke Math. J. 29(4), 341–346 (1962)
Nilsrakoo, W., Saejung, S.: Strong convergence theorems by Halpern–Mann iterations for relatively nonexpansive maps in Banach spaces. Appl. Math. Comput. 217, 6577–6586 (2011)
Oteroa, R.G., Iusem, A.N.: Proximal methods in reflexive Banach spaces without monotonicity. J. Math. Anal. Appl. 330(1), 433–450 (2007)
Petrot, N., Wattanawitoon, K., Kumam, P.: A hybrid projection method for generalized mixed equilibrium problems and fixed point problems in Banach spaces. Nonlinear Anal. Hybrid Syst. 4, 631–643 (2010)
Phuangphoo, P., Kumam, P.: Two block hybrid projection method for solving a common solution for a system of generalized equilibrium problems and fixed point problems for two countable families. Optim. Lett. (2013). https://doi.org/10.1007/s11590-012-0520-6
Polyak, B.T.: Some methods of speeding up the convergence of iteration methods. USSR Comput. Math. Math. Phys. 4(5), 1–17 (1964)
Rockafellar, R.T.: On the maximality of sums of nonlinear monotone operators. Trans. Am. Math. Soc. 149, 75–88 (1970)
Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14(5), 877–898 (1976)
Saewan, S., Cho, Y., Kumam, P.: Weak and strong convergence theorems for mixed equilibrium problems in Banach spaces. Optim. Lett. (2014). https://doi.org/10.1007/s11590-012-0593-2
Saewan, S., Kumam, P.: Convergence theorems for mixed equilibrium problems, variational inequality problem and uniformly quasi-ψ-asymptotically nonexpansive mappings. Appl. Math. Comput. 218, 3522–3538 (2011)
Saewan, S., Kumam, P.: A modified hybrid projection method for solving generalized mixed equilibrium problems and fixed point problems in Banach spaces. Comput. Math. Appl. 62, 1723–1735 (2011)
Saewan, S., Kumam, P.: A generalized f-projection method for countable families of weak relatively nonexpansive mappings and the system of generalized Ky Fan inequalities. J. Glob. Optim. (2013). https://doi.org/10.1007/s10898-012-9922-3
Saewan, S., Kumam, P., Kanjanasamranwonga, P.: The hybrid projection algorithm for finding the common fixed points of nonexpansive mappings and the zeroes of maximal monotone operators in Banach spaces. Optimization (2014) https://doi.org/10.1080/02331934.2012.724686
Takahashi, W., Zembayashi, K.: Strong and weak convergence theorems for equilibrium problems and relatively nonexpansive mappings in Banach spaces. Nonlinear Anal. 70, 45–57 (2009)
Thong, D.V., Hieu, D.V.: Inertial extragradient algorithms for strongly pseudomonotone variational inequalities. J. Comput. Appl. Math. 341(15), 80–98 (2018)
Wattanawitoon, K., Kumam, P.: Strong convergence theorems by a new hybrid projection algorithm for fixed point problems and equilibrium problems of two relatively quasi-nonexpansive mappings. Nonlinear Anal. Hybrid Syst. 3, 11–20 (2009)
Wattanawitoon, K., Kumam, P.: The modified block iterative algorithms for asymptotically relatively nonexpansive mappings and the system of generalized mixed equilibrium problems. J. Appl. Math. 2012, Article ID 395760 (2012). https://doi.org/10.1155/2012/395760
Xu, H.K.: Inequalities in Banach spaces with applications. Nonlinear Anal. 16(12), 1127–1138 (1991)
Zarantonello, E.H.: Solving functional equations by contractive averaging. Technical report 160, U. S. Army Math. Research Center, Madison, WI (1960)
Zegeye, H.: Strong convergence theorems for maximal monotone maps in Banach spaces. J. Math. Anal. Appl. 343, 663–671 (2008)
Acknowledgements
The authors acknowledge the African Development Bank (AfDB), the Pan African Material Institute (PAMI), AUST and the Center of Excellence in Theoretical and Computational Science (TaCS-CoE) for their financial support. The authors would like to thank the referees for their esteemed comments and suggestions.
Availability of data and materials
NA.
Funding
This work is supported from the African Development Bank (AfDB) research grant funds to AUST and the Center of Excellence in Theoretical and Computational Science (TaCS-CoE) research grant to KMUTT.
Author information
Authors and Affiliations
Contributions
CEC and PK formulated the problem and suggested the method of proof of the theorem to AA. The computations using the method suggested by CEC and PK was carried out by AA. The analysis of the computations to arrive at the proof of the Theorem was done jointly by CEC, PK and AA. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no conflict of interest.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Chidume, C.E., Kumam, P. & Adamu, A. A hybrid inertial algorithm for approximating solution of convex feasibility problems with applications. Fixed Point Theory Appl 2020, 12 (2020). https://doi.org/10.1186/s13663-020-00678-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13663-020-00678-w