Abstract
The purpose of this paper is to present a modified implicit rules for finding a common element of the set of solutions of proximal split feasibility problem and the set of fixed point problems for \(\vartheta \)-strictly pseudo-contractive mappings in Hilbert spaces. First, we prove strong convergence results for finding a point which minimizes a convex function such that its image under a bounded linear operator minimizes another convex function which is also a solution to fixed point of \(\vartheta \)-strictly pseudo-contractive mapping. Our second algorithm generates a strong convergent sequence to approximate common solution of non-convex minimization feasibility problem and fixed point problem. In all our results in this work, our iterative scheme is proposed by a way of selecting the step size such that their implementation does not need any prior information about the operator norm because the calculation or at least an estimate of an operator norm is not an easy task. Finally, we gave numerical example to study the efficiency and implementation of our schemes.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Let \(H_1\) and \(H_2\) be two real Hilbert spaces. Suppose that \(f: H_1 \rightarrow \mathbb {R} \cup \{+\infty \},\)\(g:H_2 \rightarrow \mathbb {R} \cup \{+\infty \}\) are two proper, convex and lower semicontinuous functions and \(A_1: H_1 \rightarrow H_2\) is a bounded linear operator. In this paper, we consider the following problem: find a solution \(\bar{x} \in H_1\) such that
where \(g_{\lambda }(y) = \min _{u\in H_2}\{g(u) + \frac{1}{2\lambda }\Vert u-y\Vert ^2\}\) stands for the Moreau-Yosida approximate of the function g of parameter \(\lambda .\)
Based on an idea introduced in Lopez et al. [14], Moudafi and Thakur [18] proved weak convergence results for solving (1.1) in the case when \(\arg \min f \cap A^{-1}(\arg \min ) \ne \emptyset ,\) or in other words: in finding a minimizer \(\bar{x}\) of f such that \(A\bar{x}\) minimizes g, namely
f, g being two proper, lower semicontinuous convex functions, \(\arg \min f :=\{\bar{x} \in H_1: f(\bar{x})\le f(x), \ \forall x\in H_1\}\) and \(\arg \min g:=\{\bar{y} \in H_2:g(\bar{y}) \le g(y), \ \ \forall y\in H_2 \}.\) We shall denote the solution set of (1.2) by \(\Gamma .\) Concerning problem (1.2), moudafi and Thakur [18] introduced a new way of selecting the step size: Set \(\theta (x) :=\sqrt{\Vert \nabla h(x)\Vert ^2 + \Vert \nabla l(x)\Vert ^2}\) with \(h(x)=\frac{1}{2}\Vert (I-prox_{\lambda g})Ax\Vert ^2,\)\(l(x) = \frac{1}{2}\Vert (I-prox_{\lambda \mu _n f})x\Vert ^2\) and introduced the following algorithm:
Split Proximal Algorithm Given an initial point \(x_1\in H_1.\) Assume that \(\{x_n\}\) has been constructed and \(\theta (x_n) \ne 0,\) then compute \(x_{n+1}\) via the rule
where \(prox_{\mu \lambda f}(y) = \arg \min _{x\in H_1}\{f(u) + \frac{1}{2\mu \lambda }\Vert u-y\Vert ^2\},\) stepsize \(\mu _n :=\rho _n \frac{h(x_n) + l(x_n)}{\theta ^2(x_n)}\) with \( 0\le \rho _n < 4.\) If \(\theta (x_n) = 0,\) then \(x_{n+1} = x_n\) is a solution of (1.1) and the iterative process stops, otherwise, we set \(n=n+1\) and go to (1.3). Using the split proximal algorithm (1.3), Moudafi and Thakur [18] proved a weak convergence theorem for approximating a solution of (1.2).
In 2015, Shehu and Ogbuisi [20] studied the following algorithm:
Algorithm 1 Given an initial point \(x_1\in H_1,\) compute \(u_n\) using \(u_n = (1-\alpha _n)x_n\) and \(\theta (u_n) \ne 0,\) then compute \(x_{n+1}\) via the rule
where stepsize \(\mu _n :=\rho _n\frac{h(u_n) + l(u_n)}{\theta ^2(u_n)}\) with \(0<\rho _n<4.\) If \(\theta (u_n) =0,\) then \(x_{n+1} = x_n\) is a solution of (1.1) which is also a fixed point of a k-strictly pseudo contractive mapping T and the iterative process stops, otherwise, we set \(n:= n+1\) and go to (1.4).
Using (1.4), they prove the following strong convergence theorem for approximation of solution of (1.1) which is also a fixed point of a k strictly pseudocontractive mapping of \(H_1\) into itself.
Theorem 1.1
Assume that f and g are two proper convex lower-semicontinuous functions and that (1.1) is consistent (i.e., \(\Gamma \ne 0).\) Let T be a k-strictly pseudocontractive mapping of \(H_1\) into itself such that \(\Gamma \cap F(T) \ne \emptyset .\) Let \(\{\alpha _n\}_{n=1}^\infty \) and \(\{\beta _n\}_{n=1}^\infty \) be real sequences in (0, 1) satisfying the following conditions
-
(A1)
\(\lim _{n\rightarrow \infty } \alpha _n =0;\)
-
(A2)
\(\sum _{n=1}^{\infty }\alpha _n = \infty ;\)
-
(A3)
\(\epsilon \le \rho _n\le \frac{4h(u_n)}{h(u_n) + l(u_n)} - \epsilon \) for some \(\epsilon > 0;\)
-
(A4)
\(0< \liminf _{n\rightarrow \infty }\beta _n \le \limsup _{n\rightarrow \infty } \beta _n < 1-k,\)
then the sequence \(\{x_n\}\) generated by (1.4) converges strongly to \(\bar{x} \in \Gamma \cap F(T).\)
It should be noted that all the above-mentioned results on proximal split feasibility problems, the iterative schemes are proposed with a way of selecting the step sizes such that their implementation does not need any information about the norm of the bounded linear operator A because the calculation or at least an estimate of the operator norm \(\Vert A\Vert \) is not an easy task. Please see [1, 20,21,22,23] for more recent results on split feasibility problems.
Also note that by taking \(f=\delta _C\) [defined as \(\delta _C(x) = 0\) if \(x\in C\) and \(+\infty \) otherwise], \(g = \delta _Q,\) the indicator functions of two nonempty, closed and convex sets C, Q of \(H_1\) and \(H_2\) respectively, Problem (1.1) reduces to
which when \(C\cap A^{-1}(Q) \ne \emptyset ,\) is equivalent to the Split Feasibility Problem (SFP): find a point
where \(A: H_1 \rightarrow H_2\) is a bounded linear operator. The SFP in finite-dimensional Hilbert space was first introduced by Censor and Elfving [7] for modeling inverse problems which arises from phase retrievals and in medical image reconstruction [4]. The SFP attracts the attention of many authors due to its application in signal processing. Various algorithms have been invented to solve it (see, e.g. [4, 5, 16, 19, 29, 31,32,33] and references therein). For more current and update survey on SFP please see [2, 12, 13, 24, 25, 34, 35].
Very recently, the implicit midpoint rules for solving fixed point problems of nonexpansive mappings have been studied by many authors, since it is a powerful numerical method for solving ordinary differential equation; see [3, 9, 11, 26, 30] and references therein. For example, Xu et al. [30] studied the following viscosity implicit midpoint rule:
Precisely, they obtained the following strong convergence theorems.
Theorem 1.2
(Xu et al. [30]) Let H be a Hilbert space, C a closed convex subset of H, \(T: C\rightarrow C \) a nonexpansive mapping with \(S:=F(T) \ne \emptyset ,\) and \(f : C\rightarrow C\) a contraction with \(\alpha \in [0,1).\) Let \(\{x_n\}\) be generated by the viscosity implicit midpoint rule (1.7), where \(\{\alpha _n\}\) is a sequence in (0, 1) satisfying
-
(C1)
\(\underset{n\rightarrow \infty }{\lim }\alpha _n = 0,\)
-
(C2)
\(\sum _{n=1}^{\infty } \alpha _n = \infty ,\)
-
(C3)
either \(\sum _{n=0}^{\infty }|\alpha _{n+1} - \alpha _n| < \infty \) or \(\underset{n\rightarrow \infty }{\lim }\frac{\alpha _{n+1}}{\alpha _n} = 1.\)
Then \(\{x_n\}\) converges in norm to a fixed point q of T, which is also the unique solution of the variational inequality
Ke and Ma [11] studied the following generalized viscosity implicit rules:
To be more exact, they proved the followings main results.
Theorem 1.3
(Ke and Ma [11]) Let C be a nonempty closed convex subset of real Hilbert space H. Let \(T:C\rightarrow C\) be a nonexpansive mapping with \(F(T) \ne \emptyset \) and \(f:C\rightarrow C\) be a contraction with coefficient \(\theta \in [0,1).\) Pick any \(x_0 \in C,\) let \(\{x_n\}\) be a sequence generated by (1.8), where \(\{\alpha _n\},\)\(\{s_n\} \subset (0,1)\) satisfying the following conditions:
-
(1)
\(\mathop {\lim }_{{n \rightarrow \infty }} \alpha _n = 0,\)
-
(2)
\(\sum _{n=0}^{\infty } \alpha _n = \infty ,\)
-
(3)
\(\sum _{n=0}^{\infty }|\alpha _{n+1} - \alpha _n| < \infty ,\)
-
(4)
\(0< \epsilon \le s_n \le s_{n+1} < 1\) for all \(n \ge 0.\)
Then \(\{x_n\}\) converges strongly to a fixed point q of the nonexpansive T, which is also the unique solution of the variational inequality
In other words, q is the unique fixed point of the contraction \(P_{F(T)}f,\) that is \(P_{F(T)}f(q) = q.\)
Remark 1.4
We like to emphasize that, approximating a common solution of SFPs and fixed point problems have been used for many applications in various fields of science and technology, such as in signal processing and image reconstruction, and especially applied in medical fields such as intensity-modulated radiation therapy (IMRT). Example of such problems can be seen in ([6, 10]).
Motivated by the result of Shehu and Ogbuisi [20] and other above mentioned related results on proximal split feasibility problems, we investigate the new viscosity implicit rules for finding a common solution of proximal split feasibility problems for the case of convex and nonconvex function [i.e (1.2) and (4.1)] which is also a fixed point of a \(\vartheta \)-strictly pseudocontractive mapping and prove the strong convergence of the sequence generated by our scheme in Hilbert spaces. We mentioned here that our iterative scheme is proposed with a way of selecting the stepsize such that their implementation does not need any prior information about the bounded operator norm. Finally we gave numerical comparisons of our results with other established results to verify the efficiency and implementation of our new method.
2 Preliminaries
We state the following well-known lemmas which will be used in the sequel.
Let T be nonlinear mapping from C into itself. We use F(T) to denote the set of fixed points of T. Now we recall the following basic concepts.
A mapping \(V:C\rightarrow C\) is called to be a strict contraction, if there exists a fixed constant \(\alpha \in (0,1)\) such that
A mapping \(T:C\rightarrow H\) is called to be nonexpansive if
A mapping \(T: C \rightarrow H\) is said to be \(\vartheta \)-pseudocontractive if for \(0\le \vartheta < 1\)
It is easy to show that (2.1) is equivalent to
Observe that if T is \(\vartheta \)-strictly pseudocontractive, then for \(z\in F(T),\) we can easily obtain that
A mapping \(A: C\rightarrow H\) is called monotone if
A mapping \(A: C\rightarrow H\) called \(\alpha \) -inverse strongly monotone if there exists a positive real number \(\alpha \) satisfying
A mapping \(A: C \rightarrow H\) is called \(\eta \)-strongly monotone if there exists a positive constant \(\eta \) such that
A mapping \(A:C \rightarrow H\) is called k-Lipschitzian if there exists a positive constant k such that
Lemma 2.1
Let H be a real Hilbert space. Then there holds the following well-known results:
-
(i)
\(\Vert x+ y\Vert ^2 = \Vert x\Vert ^2 + 2\langle x,y\rangle + \Vert y\Vert ^2, \ \ \forall x,y\in H.\)
-
(ii)
\(\Vert x+y\Vert ^2 \le \Vert x\Vert ^2 + 2\langle y, x+y\rangle , \ \ \forall x,y\in H.\)
Lemma 2.2
Let C be a nonempty, closed and convex subset of a real Hibert space H. Let \(T: C\rightarrow C\) be nonexpansive mapping. Then \(I-T\) is semiclosed at 0, i.e., if \(x_n \rightharpoonup x\in C\) and \(x_n - Tx_n \rightarrow 0,\) then \( x=Tx.\)
Lemma 2.3
[28] Let \(\{a_n\}\) be a sequence of nonnegative real numbers satisfying
where
-
(i)
\(\{a_n\} \subset [0,1], \ \ \sum \alpha _n = \infty ;\)
-
(ii)
\(\limsup \sigma _n \le 0;\)
-
(iii)
\( \gamma _n \ge 0; \ (n\ge 1), \ \ \sum \gamma _n < \infty .\)
Then, \(a_n \rightarrow 0\) as \(n\rightarrow \infty .\)
Lemma 2.4
[27] Let \(\lambda \) be a number in (0, 1] and \(T: C\rightarrow H\) be a nonexpansive mapping, we define the mapping \(T^{\lambda } : C\rightarrow H\) by
where \(F: H \rightarrow H\) is k-Lipschitzian and \(\eta \)-strongly monotone. Then \(T^{\lambda }\) is a contraction provided \(0< \mu < \frac{2\eta }{k^2};\) that is,
where \(\tau = 1-\sqrt{1-\mu (2\eta - \mu k^2)} \in (0,1].\)
3 Main results
Let T be a \(\vartheta \)-strictly pseudocontractive mapping of \(H_1\) into itself, \(F: H_1 \rightarrow H_1\) be a k-Lipschitz and \(\eta \)-strongly monotone mapping with \(k>0\) and \(\eta >0,\) and \(V:H_1 \rightarrow H_1\) be a \(\delta \)-Lipschitz mapping with \(\delta >0\). Let \(0< \rho < 2\eta /k^2\) and \(0< \gamma \delta < \tau ,\) where \(\tau = 1-\sqrt{ 1-\rho (2\eta - \rho k^2)}.\) Set \(\theta (x) : = \sqrt{\Vert \nabla h(x)\Vert ^2 + \Vert \nabla l(x)\Vert ^2}\) with \(h(x) = \frac{1}{2}\Vert (I-prox_{\lambda g})Ax\Vert ^2,\)\(l(x) = \frac{1}{2}\Vert (I-prox_{\lambda \mu _n f})x\Vert ^2\) and introduce the following algorithm:
Algorithm 3.1
Given an initial point \(x_1 \in H_1,\) compute \(u_n\) using \(u_n = s_nx_n + (1-s_n)y_n\) and \(\theta (u_n) \ne 0,\) then compute \(x_{n+1}\) via initial rule
where the stepsize \(\mu _n :=\rho _n\frac{h(u_n) + l(u_n)}{\theta ^2(u_n)}\) with \(0< \rho _n <4\) and \(A^*:H_2 \rightarrow H_1\) is the dual of the bounded linear operator A. If \(\theta (u_n) = 0,\) then \(x_{n+1} = x_n\) is a solution of (1.2) which is also a fixed point of a nonexpansive mapping T and the iterative process stops, otherwise, we set \(n:=n+1\) and go to (3.1).
Theorem 3.2
Assume that f and g are two proper convex lower-semicontnuous functions and that (1.2) is consistent (i.e., \(\Gamma \ne \emptyset \)). Let T be a nonexpansive mapping of \(H_1\) into itself such that \(\Omega = \Gamma \cap F(T) \ne \emptyset .\) Let \(\{\alpha _n\}_{n=1}^\infty \) and \(\{\beta _n\}_{n=1}^\infty \) be a real sequence in (0, 1) satisfying the following conditions
-
(i)
\(\lim _{n\rightarrow \infty } \alpha _n = 0\) and \(\sum _{n=1}^{\infty } \alpha _n = \infty ;\)
-
(ii)
\(\epsilon \le \rho _n \le \frac{4h(u_n)}{h(u_n) + l(u_n)} - \epsilon \) for some \(\epsilon >0;\)
-
(iii)
\( 0 < \epsilon \le s_n \le 1.\)
then the sequence \(\{x_n\}\) generated by (3.1) strongly converges to \(z\in \Omega \) which is also the unique solution of the variational inequality (VI)
We prove Theorem 3.2 using Mainge’s technique [17].
Proof
Since \(F: H_1 \rightarrow H_1\) is a \(\kappa \)-Lipschitz and \(\eta \)-strongly monotone mapping and \(V: H_1 \rightarrow H_1\) is a \(\rho \)-Lipschitz mapping, we have for all \(x,y\in H_1\) that
where \(\tau = 1-\sqrt{1-\rho (2\eta - \rho \kappa ^2)}.\) Furthermore
This implies that \(P_{\Omega }(I- \rho F + \gamma V)\) is a contraction of \(H_1\) into itself which implies that there exists a unique element \(z\in H_1\) such that \(z = P_{\Omega }(I- \rho F + \gamma V)z.\)
Let \(z\in \Gamma \cap F(T).\) Observe that \(\nabla h(x) = A^*(I- prox_{\mu g})Ax,\)\(\nabla l(x) = (I-prox_{\mu \lambda f})x.\) Using the fact that \(prox_{\mu \lambda f}\) is nonexpansive, q verifies (1.11) (since minimizers of any function are exactly fixed points of its proximal mapping) and having in hand
Using the fact that \(I-prox_{\lambda g}\) is firmly nonexpansive, we can write
We also, obtain that
which implies that
Let \(w_n = \beta _n Ty_n + (1-\beta _n)y_n\), we have that
It follows from (3.1) that
This implies that the sequence \(\{x_n\}\) is bounded. Consequently \(\{y_n\}\)\(\{Ty_n\}\) and \(\{u_n\}\) are bounded.
It follows from (3.1) that
This implies that
where \(\Vert x_n - z\Vert ^2 \le M_3,\)\(\delta _n = \frac{2(\tau - \gamma \delta )\alpha _n}{1-\alpha _n},\)\( \sigma _n = \frac{\alpha _n \rho ^2M_3}{2(\tau -\gamma \delta )} + \frac{1}{\tau - \gamma \delta }\left[ \langle \gamma V(z) - \rho F(z),x_{n+1} -z\rangle \right] \)
The rest of the proof will be divided into two parts.
Case 1 Suppose there exists \(n_0 \in \mathbb {N}\) such that \(\{\Vert x_n - z\Vert ^2\}_{n=n_0}^\infty \) is nonincreasing. Then \(\{\Vert x_n - z\Vert ^2\}_{n=1}^\infty \) converges and
From (3.7), we have for some \(M^*>0\) that
By (3.4), we have
Since \(\alpha _n \rightarrow 0\) as \(n \rightarrow \infty ,\) by (3.10), we obtain that
Hence, we obtain
Consequently, we have
because \(\theta ^2(u_n) = \Vert \nabla h(u_n)\Vert ^2 + \Vert \nabla l(u_n)\Vert ^2\) is bounded. This follows from the fact that \(\nabla h\) is Lipschitz continuous with constant \(\Vert A\Vert ^2,\)\(\nabla l\) is nonexpansive and \(\{u_n\}\) is bounded. More precisely, for any z which solves (1.9), we have
Now, let \(\bar{x}\) be a weak cluster point of \(\{u_n\},\) there exists a subsequence \(\{u_{n_j}\}\) which converges weakly to \(\bar{x}.\) The lower-semicontinuity of h then implies that
That is, \(h(\bar{x}) = \frac{1}{2}\Vert (1-prox_{\lambda g}A\bar{x})\Vert =0,\) i.e., \(A\bar{x}\) is a fixed point of the proximal mapping of g or equivalently, \(0\in \partial g (A\bar{x}).\) In other words, \(A\bar{x}\) is a minimizer of g.
Likewise, the lower-semicontinuity of l implies that
That is \(l(\bar{x}) = \frac{1}{2}\Vert (I-prox_{\mu _n \lambda f})\bar{x}\Vert = 0,\) i.e., \(\bar{x}\) is a fixed point of the proximal mapping of f or equivalently, \(0\in \partial f(\bar{x}).\) In other words, \( \bar{x}\) is a minimizer of f. Hence \(\bar{x} \in \Gamma .\)
Next, we show that \(\bar{x} \in F(T).\)\(z = prox_{\lambda \mu _n f}(z - \mu _n A^*(I-prox_{\lambda g})Az)\) and \(A^*(I-prox_{\lambda g})A\) is Lipschitz with constant \(\Vert A\Vert ^2,\) we have from Algorithm 3.1 that
Thus,
We observe that
implies that \(\mu _n \rightarrow 0,\)\(n\rightarrow \infty .\) Furthermore, we obtain from Algorithm 3.1 and 3.12 that
Since \(\mu _n \rightarrow 0, \ n\rightarrow \infty \) and \(\alpha _n \rightarrow 0, \ n \rightarrow \infty ,\) we obtain that
We observe that
It follows that
We also obtain from (3.14) and (3.15) that
This implies that
From the last inequality, (3.9) and condition (i) we obtain
Using the fact that \(u_{n_j} \rightharpoonup \bar{x} \in H_1\) and \(\Vert u_n - y_n\Vert \rightarrow 0, n \rightarrow \infty ,\) we have that \(y_{n_j} \rightharpoonup \bar{x} \in H_1.\) Similarly \(x_{n_j} \rightharpoonup \bar{x} \in H_1\) since \(\Vert u_n - x_n\Vert \rightarrow 0, n\rightarrow \infty .\) Using Lemma 2.2 and (3.16), we have that \(\bar{x} \in F(T).\) Therefore, \(\bar{x} \in \Gamma \cap F(T).\)
Next, we show that \(\limsup _{n\rightarrow \infty }\langle (\rho F - \gamma V)z, z - x_n\rangle \le 0,\) where \(z = P_{\Gamma \cap F(T)}(I - \rho F + \gamma V)z\) is a unique solution of the variational inequality:
Then, we obtain that
Next we prove that \(\{x_n\}\) converges strongly to z, where z is the unique solution of the VI (3.2). It is easy to see in (3.8) that \(\delta _n \rightarrow 0, n\rightarrow \infty ,\)\(\sum _{n=1}^{\infty }\delta _n = \infty \) and \(\limsup _{n\rightarrow \infty } \sigma _n \le 0.\) Using Lemma 2.3 in (3.8), we obtain
Thus, \(x_n \rightarrow z, n\rightarrow \infty .\)
Case 2 Assume that \(\{\Vert x_n - z\Vert \}_{n=1}^{\infty }\) is not monotonically decreasing sequence. Set \(\Gamma _n = \Vert x_n - z\Vert ,\)\(\forall n \ge 1\) and let \(\tau : \mathbb {N} \rightarrow \mathbb {N}\) be a mapping for all \(n\ge n_0\) (for some \(n_0\) large enough) by
Clearly, \(\tau \) is non decreasing sequence such that \(\tau (n) \rightarrow \infty \) as \(n \rightarrow \infty \) and
After a similar conclusion from (3.16), it is easy to see that
Furthermore, we can show that
Since \(\{x_{\tau (n)}\}\) is bounded, there exists a subsequence of \(\{x_{\tau (n)}\},\) still denoted by \(\{x_{\tau (n)}\},\) which converges weakly to \(\bar{x} \in \Gamma \cap F(T).\) By similar argument as above in Case 1, we conclude immediately that \(\lim _{n\rightarrow \infty }\delta _{\tau (n)} = 0\) and \(\limsup _{n\rightarrow \infty } \sigma _{\tau (n)} \le 0.\) From (3.8) we have that
which implies that (noting that \(\Gamma _{\tau (n)} \le \Gamma _{\tau (n)+1}\) and \(\alpha _{\tau (n)} >0)\)
This implies that
Thus,
Again from (3.17), we obtain
Therefore,
Furthermore, for \(n\ge n_0,\) it is easy to see that \(\Gamma _{\tau (n)} \le \Gamma _{\tau (n)+1}\) if \(n\ne \tau (n)\) (that is, \(\tau (n) < n\)), because \(\Gamma _j \le \Gamma _{j+1}\) for \(\tau (n) + 1 \le j \le n.\) As a consequences, we obtain for all \(n\ge n_0,\)
Hence \(\lim \Gamma _n =0,\) that is \(\{x_n\}\) converges strongly to z. \(\square \)
We can obtain the following result easily.
Let T be a \(\vartheta \)-pseudocontractive mapping of \(H_1\) into itself, \(F: H_1 \rightarrow H_1\) be a k-Lipschitz and \(\eta \)-strongly monotone mapping with \(k>0\) and \(\eta >0,\) and \(V:H_1 \rightarrow H_1\) be a \(\delta \)-Lipschitz mapping with \(\delta >0\). Let \(0< \rho < 2\eta /k^2\) and \(0< \gamma \delta < \tau ,\) where \(\tau = 1-\sqrt{ 1-\rho (2\eta - \rho k^2)}.\) Set \(\theta (x) : = \sqrt{\Vert \nabla h(x)\Vert ^2 + \Vert \nabla l(x)\Vert ^2}\) with \(h(x) = \frac{1}{2}\Vert (I-prox_{\lambda g})Ax\Vert ^2,\)\(l(x) = \frac{1}{2}\Vert (-prox_{\lambda \mu _n f})\Vert ^2\) and introduce the following algorithm:
Algorithm 3.3
Given an initial point \(x_1 \in H_1,\) the compute \(u_n\) using \(u_n = \frac{x_n + y_n}{2}\) and \(\theta (u_n) \ne 0,\) then compute \(x_{n+1}\) via initial rule
where stepsize \(\mu _n :=\rho _n\frac{h(u_n) + l(u_n)}{\theta ^2(u_n)}\) with \(0< \rho _n <4\) and \(A^*:H_2 \rightarrow H_1\) is the dual of the bounded linear operator A. If \(\theta (u_n) = 0,\) then \(x_{n+1} = x_n\) is a solution of (1.2) which is also a fixed point of a nonexpansive mapping T and the iterative process stops, otherwise, we set \(n:=n+1\) and go to (3.3).
Corollary 3.4
Assume that f and g are two proper convex lower-semicontnuous function and that (1.2) is consistent (i.e., \(\Gamma \ne \emptyset \)). Let T be a nonexpansive mapping of \(H_1\) into itself such that \(\Omega = \Gamma \cap F(T) \ne \emptyset .\) Let \(\{\alpha _n\}_{n=1}^\infty \) and \(\{\beta _n\}_{n=1}^\infty \) be a real sequence in (0, 1) satisfying the following conditions
-
(i)
\(\lim _{n\rightarrow \infty } \alpha _n = 0\) and \(\sum _{n=1}^{\infty } \alpha _n = \infty ;\)
-
(ii)
\(\epsilon \le \rho _n \le \frac{4h(u_n)}{h(u_n) + l(u_n)} - \epsilon \) for some \(\epsilon >0;\)
then sequence \(\{x_n\}\) generated by (3.3) strongly converges to \(z\in \Omega \) which is also the unique solution of the variational inequality (VI)
4 Strong convergence for nonconvex minimization feasibility problem
Throughout this section g is assumed to be prox-regular. The following problem:
is very general in the sense that it includes, as special cases, g is convex and g is a lower-\(C^2\) function which is of great importance in optimization and can be locally expressed as a difference \( g - \frac{r}{2}\Vert \centerdot \Vert ^2,\) where g is finite convex function, hence a large core of problems of interest in variational analysis and optimization. It should be noticed that examples abound of practitioners needing algorithms for solving nonconvex problems, for instance in crystallography, astronomy, and, more recently in inverse scattering; see for example, [15]. In what follows, we shall represent the set of solution of (4.1) by \(\Upsilon .\)
Definition 4.1
Let \(g : H_2 \rightarrow \mathbb {R}\) be a function and let \(\bar{x} \in dom g,\) i.e., \(g(\bar{x}) < +\infty .\) A vector v is in proximal subdifferential \(\partial _{pg}(\bar{x})\) if there exists some \(r>0\) and \(\epsilon >0\) such that for all \(x\in B(\bar{x}, \epsilon ),\)
when \(g(\bar{x}) = + \infty ,\) one puts \(\partial _{pg}(\bar{x}) = \emptyset .\)
Before starting the definition of prox-regularity of g and properties of its proximal mapping, we recall that g is locally lower semicontinuous at \(\bar{x}\) if its epigraph is closed relative to a neighborhood of (\(\bar{x},g(\bar{x}\)), prox-bounded if g is minorized by quadratic function, and recall that for \(\epsilon >0,\) the g-attentive \(\epsilon \)-localization of \(\partial _{pg}(\bar{x})\) around \((\bar{x},\bar{v}),\) is the mapping \(T_{\epsilon } :H_2 \rightarrow 2^{H_2}\) defined by
Definition 4.2
A function g is said to be prox-regular at \(\bar{x}\) for \(\bar{v} \in \partial _{pg}(\bar{x})\) if there exists some \(r>0\) and \(\epsilon >0\) such that for all \(x,x' \in B(\bar{x},\epsilon )\) with \(|g(x) - g(x')| <\epsilon \) and all \(v\in B(\bar{v}, \epsilon )\) with \(v\in \partial _{pg}(\bar{x})\) one has
It the property holds for all vectors \(\bar{v}\in \partial _{pg}(\bar{x}),\) the function is said to be prox-regular at \(\bar{x}.\) Fundamental insights into the properties of a function g come from the study of its Moreau-Yosida regularization \(g_\lambda \) and the associated proximal mapping \(prox_{\lambda g}\) defined for \(\lambda >0,\) respectively, by
The Latter is a fundamental tool in optimization and it was shown that a fixed point iteration on the proximal mapping could be used to develop a simple optimization algorithm, namely, the proximal point algorithm.
Note also, see, for example, Section 1 in [8], that local minima are zeros of the proximal subdifferential and that the proximal subdifferential and the convex one coincide in the convex case.
Now, let us state the following key property of the proximal mapping complement, which was proved in Remark 3.2 of Moudafi and Thakur [18].
Lemma 4.3
(Moudafi and Thakur [18]) Suppose that g is locally lower-semicontinuous at \(\bar{x}\) and prox-regular at for \(\bar{v} =0\) with respect to r and \(\epsilon .\) Let \(T_\epsilon \) be the g-attentive \(\epsilon \)-localization of \(\partial _{pg}\) around \((\bar{x},\bar{v}).\) Then for each \(\lambda \in (0,\frac{1}{r})\) and \(x_1,x_2\) in a neigborhood \(U_\lambda \) of \(\bar{x},\) one has
Observe that when\(r=0,\) which amounts to saying that g is convex, we recover the fact that the mapping \(I - prox_{\lambda g}\) is firmly nonexpansive.
Now, the regularization parameter \(\lambda \) are allowed to vary in the algorithm (3.1), namely considering possibly variable parameter \(\lambda \in (0,\frac{1}{r}-\epsilon )\) (for some \(\epsilon > 0\) small enough) and \(\mu _n >0,\) our interest is in studying the following the convergence properties of the following:
Algorithm 4.4
Let T be a \(\vartheta \)-strictly pseudocontractive mapping of \(H_1\) into itself, \(F: H_1 \rightarrow H_1\) be a k-Lipschitz and \(\eta \)-strongly monotone mapping with \(k>0\) and \(\eta >0,\) and \(V:H_1 \rightarrow H_1\) be a \(\delta \)-Lipschitz mapping with \(\delta >0\). Let \(0< \rho < 2\eta /k^2\) and \(0< \gamma \delta < \tau ,\) where \(\tau = 1-\sqrt{ 1-\rho (2\eta - \rho k^2)}.\) Given an initial point \(x_1 \in H_1,\) the compute \(u_n\) using \(u_n = s_nx_n + (1-s_n)y_n\) and \(\theta (u_n) \ne 0,\) then compute \(x_{n+1}\) via initial rule
where stepsize \(\mu _n :=\rho _n\frac{h(u_n) + l(u_n)}{\theta ^2(u_n)}\) with \(0< \rho _n <4\) and and \(A^*:H_2 \rightarrow H_1\) is the dual of the bounded linear operator A. If \(\theta (u_n) = 0,\) then \(x_{n+1} = x_n\) is a solution of (1.2) which is also a fixed point of a nonexpansive mapping T and the iterative process stops, otherwise, we set \(n:=n+1\) and go to (4.4).
Theorem 4.5
Assume that f is a proper convex lower-semicontnuous function, g is locally lower semicontinuous at Az, prox-bounded and prox-regular at Az for \(\bar{v} = 0.\) Let T be a nonexpansive mapping of \(H_1\) into itself such that \(\Upsilon \cap F(T) \ne \emptyset \) and A a bounded linear operator which is surjective with a dense. Let \(\{\alpha _n\}_{n=1}^\infty ,\)\(\{\beta _n\}_{n=1}^\infty \) and \(\{s_n\}_{n=1}^\infty .\)be a real sequence in (0, 1] satisfying the following conditions
-
(i)
\(\lim _{n\rightarrow \infty } \alpha _n = 0\) and \(\sum _{n=1}^{\infty } \alpha _n = \infty ;\)
-
(ii)
\(\epsilon \le \rho _n \le \frac{4h(u_n)}{h(u_n) + l(u_n)} - \epsilon \) for some \(\epsilon >0;\)
-
(iii)
\(\sum _{n=1}^{\infty }\lambda _n < \infty ;\)
-
(iv)
\( 0 < \epsilon \le s_n \le 1,\)
and if \(\Vert x_1 - z\Vert \) is small enough, then sequence \(\{x_n\}\) generated by (4.4) strongly converges to \(z\in \Upsilon \cap F(T)\) which is also the unique solution of the variational inequality (VI)
Proof
Using the fact that \(prox_{\lambda _n \mu _n f}\) is nonexpansive, z verifies (4.1) (critical points of any function are exactly fixed-point of its proximal mapping) and having in mind Lemma 4.3, we can write
Recall that A is surjective with a dense domain \(\Leftrightarrow \exists \zeta >0\) such that \(\Vert A^*x\Vert \ge \zeta \Vert x\Vert ,\)
Conditions on the parameters \(\lambda _n\) and \(\rho _n\) assure the existence of a positive constant M such that
By (3.5), (4.6) and (3.4) (taking into account that \(1+ x \le e^x, \ x\ge 0\)), we obtain that
This implies that the sequence \(\{x_n\}\) is bounded. Consequently \(\{y_n\}\)\(\{Ty_n\}\) and \(\{u_n\}\) are bounded.
Following the method of proof of Theorem 3.2, we can show that
If \(\bar{x}\) is a weak cluster point of \(\{u_n\},\) then there exists a subsequence \(\{u_{n_j}\}\) which weakly converges to \(\bar{x}\) From the proof of Theorem 3.2, we can show that
-
(i)
\(0\in \partial f(\bar{x})\) such that \(0\in \partial _{pg} (A\bar{x}),\)
-
(ii)
\(\Vert Ty_n - y_n\Vert \rightarrow 0, n\rightarrow \infty ,\)
-
(iii)
\(\lim _{n\rightarrow \infty } \Vert u_n - y_n\Vert = 0=\lim _{n\rightarrow \infty } \Vert x_n - y_n\Vert \) and
-
(iv)
\(\bar{x} \in F(T).\) Therefore, \(z\in \Upsilon \cap F(T).\)
Finally, from Algorithm 4.4, we have
This implies that for some \(M_1 >0\) we have
where \(\Vert x_n - z\Vert ^2 \le M_3,\)\(\delta _n = \frac{2(\tau - \gamma \delta )\alpha _n}{1-\alpha _n},\)\( \sigma _n = \frac{\alpha _n \rho ^2M_3}{2(\tau -\gamma \delta )} + \frac{1}{\tau - \gamma \delta }\left[ \langle \gamma V(z) - \rho F(z),x_{n+1} -z\rangle \right] \)
We conclude from condition (i),(iii) and Lemma 2.3 that \(\{x_n\}\) converges strongly to \(z \in \Upsilon \cap F(T).\)
5 Numerical example
In this section, we give a numerical example of Algorithm 3.1 in comparison with Algorithm 1.4 of Shehu and Ogbuisi in an infinite dimensional Hilbert space. Let \(H_1=H_2 = L_2([0, 1])\) be endowed with inner product
and norm
Let \(C = \{x \in L_2([0, 1]): \langle y, x\rangle \le a\},\) where \(y = 2t^2+1\) and \(a = 2.\) Then, we define Prox\(_{\lambda \mu f}\) as
where \(f=\delta _C\) (the indicator function of C).
Now, let \(Q=\{x\in L_2([0, 1])~:~||x-e||_{L_2}\le b\},\) where \(e=t+2\) and \(b=1\), then we define Prox\(_{\lambda g}\) as
where \(g=\delta _Q\).
Define the operator \(A: L_2([0, 1]) \rightarrow L_2([0, 1])\) by
Then A is a bounded linear mapping. Let \(T, F, V: L_2([0, 1]) \rightarrow L_2([0, 1])\) be defined by \(Tx(t) = -4x(t),~~Fx(t) = x(t)\) and \(Vx(t) = \frac{1}{2} x(t)\) for all \(x(t)\in L_2([0,1])\). Now, take \(\rho =1=\gamma ,~\alpha _n=\frac{1}{3n+2}, s_n=\frac{n}{2n+1}\) and \(\beta _n=\frac{2n}{5n+3}\) for all \(n\ge 1\), then the conditions in Theorem 3.2 are satisfied. We now consider the following four cases.
Case 1 Take \(x_1(t)=1+ e^{2t}\).
Case 2 Take \(x_1(t)= e^{3t}\).
Case 3 Take \(x_1(t)= t^2+3\).
Case 4 Take \(x_1(t)= t^4+e^{t}\).
By using these cases (Case 1–Case 4 above), we compared our Algorithm 3.1 with Algorithm 1.4 of Shehu and Ogbuisi [20] in Fig. 1. The graphs show that our algorithm converges faster than the Algorithm in [20]. This shows that our algorithm works well and have competitive advantages over the algorithm of Shehu and Ogbuisi [20].
6 Conclusion
Strong convergence of some new viscosity implicit rule methods for finding a common solution of proximal split feasibility problems (for convex and nonconvex functions) and fixed point problems for a \(\vartheta \)-strictly pseudocontractive mapping is established in the framework of real Hilbert spaces. The strong convergent result is obtained under some relaxed assumptions, one of which is that our proposed methods uses a stepsize such that the implementation of our methods does not need any prior information about the bounded operator norm. Also, some numerical experiments of our method (Algorithm 3.1) in comparison with Algorithm 1.4 of Shehu and Ogbuisi [20] were carried out in infinite dimensional Hilbert spaces. In all our comparisons, the numerical results demonstrate that our method performs better and has competative advantage than the method in [20].
Moreover, the problem studied in this paper can be applied to real world problems such as Intensity-Modulated Radiation Therapy (IMRT) treatment planning, phase retrievals, signal processing, image restoration problems, data compression/compressed sensing, among others (see, for example [4,5,6, 10, 12, 24]).
References
Abbas, M., AlShahrani, M., Ansari, Q.H., Iyiola, O.S., Shehu, Y.: Iterative methods for solving proximal split minimization problems. Numer. Algorithms 78, 193–215 (2018)
Ansari, Q.H., Rehan, A.: Split Feasibility and Fixed Point Problems, Nonlinear Analysis, pp. 281–322. Springer, New Delhi (2014)
Bader, G., Deuflhard, P.: A semi-implicit mid-point rule for stiff system of ordinary differential equations. Numer. Math. 41, 373–398 (1983)
Byrne, C.: Iterative oblique projection onto convex set and the split feasibility problem. Inverse Prob. 18(1), 441–453 (2002)
Byrne, C.A.: A unified treatment of some iterative algorithms in signal processing and image reconstruction. Inverse Prob. 20(1), 103–120 (2004)
Censor, Y., Bortfeld, T., Martin, B., Trofimov, A.: A unified approach for inversion problems in intensity modulated radiation therapy. Phys. Med. Biol. 51, 2353–2365 (2006)
Censor, Y., Elfving, T.A.: A multiprojection algorithm using Bregman projections in a product space. Numer. Algorithms 8(2–4), 221–239 (1998)
Clarke, Z.F.H., Ledyaev, Y.S., Stern, R.J., Wolenski, P.R.: Nonsmooth Analysis and Control Theory. Springer, New York (1998)
Deuflhard, P.: Recent progress in extrapolation methods for ordinary different equations. SIAM Rev. 27(4), 505–535 (1985)
Iiduka, H.: Acceleration method for convex optimization over the fixed point set of a nonexpansive mapping. Math. Program. Ser. A (2014). https://doi.org/10.1007/s10107-013-0741-1
Ke, Y., Ma, C.: The generalized viscosity implicit rules of nonexpansive mappings in Hilbert spaces. Fixed Point Theory Appl. 2015, 190 (2015)
Kesornprom, S., Cholamjiak, P.: Proximal type algorithms involving linesearch and inertial technique for split variational inclusion problem in hilbert spaces with applications. Optimization 68, 2365–2391 (2019)
Kesornprom, S., Pholasa, N., Cholamjiak, P.: On the convergence analysis of the gradient-CQ algorithms for the split feasibility problem. Numer. Algorithms (2019). https://doi.org/10.1007/s11075-019-00790-y
Lopez, G., Martin-Marquez, V., Wang, F., Xu, H.K.: Solving the split feasibility problem without prior knowledge of matrix norms. Inverse Probl. 28, 085004 (2012)
Luke, D.R.: Finding best approximation pairs relative to convex and prox-regular set in Hilbert space. SIAM J. Optim. 19(2), 714–729 (2008)
Maingé, P.E.: The viscosity approximation process for quasi-nonexpansive mappings in Hilbert space. Comput. Math. Appl. 59(1), 74–79 (2010)
Maingé: Strong convergence of projected subgradient methods for nonsmooth and nonstrictlyconvex minimization. Set Valued Anal. 16, 899–912 (2008)
Moudafi, A., Thakur, B.S.: Solving proximal split feasibility problems without prior knowledge of operator norms. Optim. Lett. 8(7), 2099–2110 (2014)
Qu, B., Xiu, N.: A note on the CQ algorithm for the split feasibility problem. Inverse Prob. 21(5), 1655–1665 (2005)
Shehu, Y., Ogbuisi, F.U.: Convergence analysis for split feasibility problems and fixed point problems. J. Appl. Math. Comput. 48, 221–239 (2015)
Shehu, Y.: Approximation of common solutions to proximal split feasibility problems and fixed point problems. Fixed Point Theory 18, 361–374 (2017)
Shehu, Y.: Iterative methods for convex proximal split feasibility problems and fixed point problems. Afr. Math. 27, 501–517 (2016)
Shehu, Y., Iyiola, O.S.: Strong convergence result for proximal split feasibility problem in Hilbert space. Optimization 66, 2275–2290 (2017)
Shehu, Y., Vuong, P.T., Cholamjiak, P.: A self-adaptive projection method with an inertial technique for split feasibility problems in Banach spaces with applications to image restoration problems. J. Fixed Point Theory Appl. 21, 2 (2019). https://doi.org/10.1007/s11784-019-0684-0
Suantai, S., Witthayarat, U., Shehu, Y., Cholamjiak, P.: Iterative methods for the split feasibility problem and the fixed point problem in Banach spaces. Optimization 68, 955–980 (2019)
Somalia, S.: Implicit midpoint rule to nonlinear degenerate boundary value problems. Int. J. Comput. Math. 79(3), 327–332 (2002)
Xu, H.K., Kim, T.H.: Convergence of hybrid steepest-descent methods for variational inequalities. J. Optim. Theory Appl. 119, 185–201 (2003)
Xu, H.K.: Iterative algorithm for nonlinear operators. J. Lond. Math. Soc. 66(2), 1–17 (2002)
Xu, H.K.: A variable Krasnoselki–Mann algorithm and the multiple-set split feasibility problem. Inverse Prob. 22(6), 2021–2034 (2006)
Xu, H.K., Aoghamdi, M.A., Shahzad, N.: The viscosity technique for the implicit midpoint rule of nonexpansive mappings in Hilbert. Fixed Point Theory Appl. 2015, 41 (2015)
Yang, Q.: The relaxed CQ algorithm solving the split feasibility problem. Inverse Prob. 20(4), 1261–1266 (2004)
Yang, Q., Zhao, J.: Generalized KM theorems and their applications. Inverse Prob. 22(3), 833–844 (2006)
Yao, Y., Postolache, M., Quin, X., Yao, J.C.: Iterative algorithms for the proximal split feasibility problem. U.P.B Sci. Bull. Ser. A 80(3), 37–44 (2018)
Yao, Y., Postolache, M., Zhu, Z.: Gradient methods with selection technique for the multiple-sets split feasibility problem. Optimization 69, 269–281 (2020)
Zhao, X., Yao, J.C., Yao, Y.: A proximal algorithm for solving split monotone variational inclusions. U.P.B. Sci. Bull. Ser. A (accepted)
Acknowledgements
The second author acknowledge with thanks the bursary and financial support from Global Excellence Stature fellowship 4.0. University of Johannesburg South Africa. The research of the third author is wholly supported by the National Research Foundation (NRF) South Africa (S& F-DSI/NRF Freestanding Postdoctoral Fellowship; Grant Number: 120784).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Pant, R., Okeke, C.C. & Izuchukwu, C. Modified viscosity implicit rules for proximal split feasibility and fixed point problems. J. Appl. Math. Comput. 64, 355–378 (2020). https://doi.org/10.1007/s12190-020-01358-z
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12190-020-01358-z
Keywords
- Generalized implicit rule
- Proximal split feasibility problems
- Pseudo-contractive mapping
- Fixed point
- Hilbert space