Abstract
We introduce a new iteration method and prove strong convergence theorems for finding a common element of the set of fixed points of a nonexpansive mapping and the solution set of monotone and Lipschitz-type continuous Ky Fan inequality. Under certain conditions on parameters, we show that the iteration sequences generated by this method converge strongly to the common element in a real Hilbert space. Some preliminary computational experiences are reported.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
We consider a well-known Ky Fan inequality [1], which is very general in the sense that it includes, as special cases, the optimization problem, the variational inequality, the saddle point problem, the Nash equilibrium problem in noncooperative games and the Kakutani fixed point problem; see [2–9]. Recently, methods for solving the Ky Fan inequality have been studied extensively. One of the most popular methods is the proximal point method. This method was introduced first by Martinet in [10] for variational inequality and then was extended by Rockafellar in [11] for finding the zero point of a maximal monotone operator. Konnov in [12] further extended the proximal point method to the Ky Fan inequality with a monotone and weakly monotone bifunction, respectively. Other solution methods well developed in mathematical programming and the variational inequality, such as the gap function, extragradient, and bundle methods, recently have been extended to the Ky Fan inequality; see [5, 6, 13, 14].
In this paper, we are interested in the problem of finding a common element of the solution set of the Ky Fan inequality and the set of fixed points of a nonexpansive mapping. Our motivation originates from the following observations. The problem can be on one hand considered as an extension of the Ky Fan inequality when the nonexpansive mapping is the identity mapping. On the other hand, it has been significant in many practical problems. Since the Ky Fan inequality has found many direct applications in economics, transportation, and engineering, it is natural that when the feasible set of this problem results as a fixed-point solution set of a fixed-point problem, then the obtained problem can be reformulated equivalently to the problem. An important special case of the Ky Fan inequality is the variational inequality, and this problem is reduced to finding a common element of the solution set of variational inequality and the solution set of a fixed-point problem; see [15–17].
The paper is organized as follows. Section 2 recalls some concepts related to Ky Fan inequality and fixed point problems that will be used in the sequel and a new iteration scheme. Section 3 investigates the convergence theorem of the iteration sequences presented in Sect. 2 as the main results of our paper. Applications are presented in Sect. 4.
2 Preliminaries
Let \(\mathcal{H}\) be a real Hilbert space with inner product 〈⋅,⋅〉 and norm ∥⋅∥. Let C be a nonempty, closed, and convex subset of a real Hilbert space \(\mathcal{H}\) and Proj C be the projection of \(\mathcal{H}\) onto C. When {x k} is a sequence in \(\mathcal{H}\), then \(x^{k}\to\bar{x}\) (resp. \(x^{k}\rightharpoonup\bar{x}\)) will denote strong (resp. weak) convergence of the sequence {x k} to \(\bar{x}\). Let f:C×C→ℝ be a bifunction such that f(x,x)=0 for all x∈C. The Ky Fan inequality consists in finding a point in
where f(x,⋅) is convex and subdifferentiable on C for every x∈C. The set of solutions of problem P(f,C) is denoted by Sol(f,C). When f(x,y)=〈F(x),y−x〉 with \(F: C\to \mathcal{H}\), problem P(f,C) amounts to the variational inequality problem (shortly, VI(F,C))
The bifunction f is called strongly monotone on C with β>0 iff
monotone on C iff
pseudomonotone on C iff
Lipschitz-type continuous on C with constants c 1>0 and c 2>0 in the sense of Mastroeni in [8] iff
When f(x,y)=〈F(x), y−x〉 with \(F: C\to\mathcal{H}\),
and it is easy to see that if F is Lipschitz continuous on C with constant L>0, i.e., ∥F(x)−F(y)∥≤L∥x−y∥ for all x,y∈C, then
and thus, f satisfies Lipschitz-type continuous condition with \(c_{1}=c_{2}=\frac{L}{2}\). Furthermore, when z=x, this condition becomes
This gives a lower bound on f(x,y)+f(y,x) while the strong monotonicity gives an upper bound on f(x,y)+f(y,x).
A mapping S:C→C is said to be contractive with δ∈ ]0,1[ iff
If δ=1 then S is called nonexpansive on C. Fix(S) denotes the set of fixed points of S.
In 1953, Mann [18] introduced a well-known classical iteration method to approximate a fixed point of a nonexpansive mapping S in a real Hilbert space \(\mathcal{H}\). This iteration is defined as
where C is a nonempty, closed, and convex subset of \(\mathcal{H}\) and {α k }⊂[0,1]. Then {x k} converges weakly to x ∗∈Fix(S).
Recently, Xu gave the strong convergence theorems for the following sequences in a real Hilbert space \(\mathcal{H}\):
where {α k }⊂ ]0,1[, g:C→C is contractive and S:C→C is nonexpansive. In [19], the author proved that the sequence {x k} converges strongly to x ∗, where x ∗ is the unique solution of the variational inequality:
Chen et al. in [16] studied the viscosity approximation methods for a nonexpansive mapping S and an α-inverse-strongly monotone mapping \(A: C\to\mathcal{H}\), i.e., 〈A(x)−A(y),x−y〉≥α∥A(x)−A(y)∥2 for all x,y∈C in a real Hilbert space \(\mathcal{H}\):
where {α k }⊂ ]0,1[, {λ k }⊂[a,b] with 0<a<b<2α and Proj C denotes the metric projection from \(\mathcal{H}\) onto C. They proved that if some certain conditions on {α k } and {λ k } are satisfied, then the sequence {x k} converges strongly to a common element of the set of fixed points of the nonexpansive mapping S and the set of solutions of the variational inequality for the inverse-strongly monotone mapping A. To overcome the restriction of the above methods to the class of α-inverse-strongly monotone mappings, by using the extragradient method of Korpelevich in [7], Ceng et al. in [15] could show the strong convergence result of the following method:
where the sequences {α k }, {β k }, {γ k }, and {λ k } were chosen appropriately. The authors showed that the iterative sequences {x k}, {y k}, and {z k} converged strongly to the same point \(\bar{x}=\mathrm{Proj}_{\mathrm{Sol}(F,C)\cap \mathrm{Fix}(S)}(x^{0})\).
For obtaining a common element of set of solutions of problem P(f,C) and the set of fixed points Fix(S) of a nonexpansive mapping S of a real Hilbert space \(\mathcal{H}\) into itself, Takahashi and Takahashi in [20] first introduced an iterative scheme by the viscosity approximation method. The sequence {x k} is defined by
where C is a nonempty, closed, and convex subset of \(\mathcal{H}\) and g is a contractive mapping of \(\mathcal{H}\) into itself. The authors showed that under certain conditions over {α k } and {r k }, sequences {x k} and {u k} converge strongly to z=ProjSol(f,C)∩Fix(S)(g(z)).
Recently, iterative methods for finding a common element of the set of solutions of Ky Fan inequality and the set of fixed points of a nonexpansive mapping in a real Hilbert space have further developed by many authors; see [21–24]. At each iteration k in all of the current algorithms, it requires solving an approximation auxiliary Ky Fan inequality.
Motivated by the approximation method in [15] and the iterative method in [20] via an improvement set of a hybrid extragradient method in [25], we introduce a new iterative process for finding a common element of the set of fixed points of a nonexpansive mapping and the set of solutions of Ky Fan inequality for monotone and Lipschitz-type continuous bifunctions. At each iteration, we only solve two strongly convex optimization problems instead of a regularized Ky Fan inequality. The iterative process is given by
and compute the next iteration point
where g is a contractive mapping of \(\mathcal{H}\) into itself. To investigate the convergence of this scheme, we recall the following technical lemmas which will be used in the sequel.
Lemma 2.1
[25]
Let C be a nonempty, closed, and convex subset of a real Hilbert space \(\mathcal{H}\). Let f:C×C→ℝ be a pseudomonotone and Lipschitz-type continuous bifunction. For each x∈C, let f(x,⋅) be convex and subdifferentiable on C. Then, for each x ∗∈Sol(f,C), the sequences {x k},{y k},{t k} generated by (1) satisfy the following inequalities:
Lemma 2.2
[26]
Let {x k} and {y k} be two bounded sequences in a Banach space and let {β k } be a sequence of real numbers such that 0<lim inf k→∞ β k <lim sup k→∞ β k <1. Suppose that
Then
Lemma 2.3
[27]
Let T be a nonexpansive self-mapping of a nonempty, closed, and convex subset C of a real Hilbert space \(\mathcal{H}\). Then I−T is demiclosed; that is, whenever {x k} is a sequence in C weakly converging to some \(\bar{x}\in C\) and the sequence {(I−T)(x k)} strongly converges to some \(\bar{y}\), it follows that \((I-T)(\bar{x})=\bar{y}\). Here, I is the identity operator of \(\mathcal{H}\).
Lemma 2.4
[19]
Let {a k } be a nonnegative real number sequence satisfying
where {α k }⊂ ]0,1[ is a real number sequence. If lim k→∞ α k =0 and \(\sum_{k=1}^{\infty }\alpha_{k}=\infty\), then lim k→∞ a k =0.
3 Convergence Results
Now, we prove the main convergence theorem.
Theorem 3.1
Let C be a nonempty, closed, and convex subset of a real Hilbert space \(\mathcal{H}\). Let f:C×C→ℝ be a monotone, continuous, and Lipschitz-type continuous bifunction, g:C→C be a contractive mapping with constant δ∈ ]0,1[, S be a nonexpansive mapping of C into itself, and Fix(S)∩Sol(f,C)≠∅. Suppose that x 0∈C, μ∈ ]0,1[, positive sequences {λ k }, {α k }, {β k }, and {γ k } satisfy the following restrictions:
Then the sequences {x k}, {y k}, and {t k} generated by (1) and (2) converge strongly to the same point x ∗∈Fix(S)∩Sol(f,C), which is the unique solution of the following variational inequality:
The proof of this theorem is divided into several steps.
Step 1
Claim that {x k} is bounded.
Proof of Step 1
By Lemma 2.1 and x k+1=α k g(x k)+β k x k+γ k (μS(x k)+(1−μ)t k), we have
Then
So, {x k} is bounded. Therefore, by Lemma 2.1, the sequences {y k} and {t k} are bounded. □
Step 2
Claim that lim k→∞∥t k−x k∥=0.
Proof of Step 2
Since f(x,⋅) is convex on C for each x∈C, we see that
if and only if
where N C (x) is the (outward) normal cone of C at x∈C. Thus, since f(y k,⋅) is subdifferentiable on C, by the well-known Moreau–Rockafellar theorem [11], there exists w∈∂ 2 f(y k,t k) such that
Substituting t=x ∗ into this inequality to obtain
On the other hand, it follows from (4) that \(0=\lambda_{k} w+t^{k}-x^{k}+\bar{\eta}\), where w∈∂ 2 f(y k,t k) and \(\bar{\eta}\in N_{C}(t^{k})\). By the definition of the normal cone N C we have, from this relation that
Set
For each k≥0, we have \(z^{k}=\frac{\alpha_{k} g(x^{k})+\gamma_{k}\eta^{k}}{1-\beta_{k}}\), and hence
Since f(x,⋅) is convex on C for all x∈C, we have
where w∈∂ 2 f(y k,t k). Substituting t=t k+1 into (6), then we have
By the similar way, we also have
Using (9), (10), and f is Lipschitz-type continuous and monotone, we get
Hence,
Therefore, we have
Combining this with (8), we obtain
where M k is defined by
Since Step 2, lim k→∞ λ k =0,0<lim inf k→∞ β k <lim sup k→∞ β k <1 and lim k→∞∥λ k+1−λ k ∥=0, we have lim k→∞ M k =0 and
So,
By Lemma 2.2, we have lim k→∞∥z k−x k∥=0 and hence
Note that 0<lim inf k→∞ β k <lim sup k→∞ β k <1, we have
Since
and Step 1, we have
Then
for every k=0,1,…. By Step 2, μ∈ ]0,1[, α k +β k +γ k =1, lim k→∞ α k =0, (12), and 0<lim inf k→∞ β k <lim sup k→∞ β k <1, and we have
By the similar way, we also have
Using ∥x k−t k∥≤∥x k−y k∥+∥y k−t k∥, (13) and (14), we have
□
Step 3
Claim that
Proof of Step 3
From x k+1=α k g(x k)+β k x k+γ k (μS(x k)+(1−μ)t k), we have
and hence
Using this, lim k→∞ α k =0, α k +β k +γ k =1, 0<lim inf k→∞ β k <lim sup k→∞ β k <1, Step 2, Step 3, and (12), we have
□
Step 4
Claim that
where η k is defined by (7).
Proof of Step 4
Since {η k} is bounded, there exists a subsequence \(\{\eta^{k_{i}}\}\) of {η k} such that
By Step 1, the sequence \(\{\eta^{k_{i}}\}\) is bounded, and hence there exists a subsequence \(\{\eta^{k_{i_{j}}}\}\) of \(\{\eta^{k_{i}}\}\) which converges weakly to \(\bar{\eta}\). Without loss of generality, we suppose that the sequence \(\{\eta^{k_{i}}\}\) converges weakly to \(\bar{\eta}\) such that
Using Step 2, Step 3, and η k=μS(x k)+(1−μ)t k, we also have
Since Lemma 2.3, \(\{\eta^{k_{i}}\}\) converges weakly to \(\bar{\eta}\) and Step 3, we get
Now, we show that \(\bar{\eta}\in \mathrm{Sol}(f, C)\). By Step 2, we have
Since y k is the unique solution of the strongly convex problem
we have
This follows that
where w∈∂ 2 f(x k,y k) and w k∈N C (y k). By the definition of the normal cone N C , we have
On the other hand, since f(x k,⋅) is subdifferentiable on C, by the well-known Moreau–Rockafellar theorem, there exists w∈∂ 2 f(x k,y k) such that
Combining this with (17), we have
Hence,
Then, using \(\{\lambda_{k}\}\subset\,[a, b]\subset\,\big]0, \frac{1}{L}\big[\) and continuity of f, we have
Combining this and (16), we obtain
By (15) and the definition of x ∗, we have
□
Step 5
Claim that the sequences {x k},{y k}, and {t k} converge strongly to x ∗.
Proof of Step 5
Since η k=μS(x k)+(1−μ)t k and Lemma 2.1, we have
Using this and x k+1=α k g(x k)+β k x k+γ k η k, we have
where A k and B k are defined by
Since \(\lim_{k\to\infty}\alpha_{k}=0, \sum_{k=1}^{\infty}\alpha_{k}=\infty\), Step 2, and Step 4, we have
and hence
By Lemma 2.4, we obtain that the sequence {x k} converges strongly to x ∗. It follows from Step 3 that the sequences {y k} and {t k} also converge strongly to the unique solution x ∗. □
4 Applications and Numerical Results
Let C be a nonempty, closed, and convex subset of a real Hilbert space \(\mathcal{H}\) and F be a function from C into \(\mathcal{H}\). In this section, we consider the variational inequality VI(F,C). The set of solutions of VI(F,C) is denoted by Sol(F,C). Recall that the function F is called
-
Strongly monotone on C with β>0 iff
$$\bigl\langle F(x)-F(y), x-y\bigr\rangle\geq\beta\|x-y\|^2,\quad \forall x, y\in C.$$ -
Monotone on C iff
$$\bigl\langle F(x)-F(y), x-y\bigr\rangle\geq0,\quad \forall x, y\in C.$$ -
Pseudomonotone on C iff
$$\bigl\langle F(y), x-y\bigr\rangle\geq0\quad \Rightarrow\quad \bigl\langle F(x), x-y\bigr \rangle \geq0,\quad \forall x, y\in C.$$ -
Lipschitz continuous on C with constants L>0 (shortly, L-Lipschitz continuous) iff
$$\big\|F(x)-F(y)\big\|\leq L\|x-y\|,\quad \forall x, y\in C.$$
Since
equation (1), and Theorem 3.1, the convergence theorem for finding a common element of the set of fixed points of a nonexpansive mapping S and the solution set Sol(F,C) is presented as follows.
Theorem 4.1
Let C be a nonempty, closed and convex subset of a real Hilbert space \(\mathcal{H}\). Let \(F: C\to\mathcal{H}\) be monotone and L-Lipschitz continuous, g:C→C be a contractive mapping, S be a nonexpansive mapping of C into itself, and Fix(S)∩Sol(F,C)≠∅. Suppose that μ∈ ]0,1[, positive sequences {λ k }, {α k }, {β k }, and {γ k } satisfy the following restrictions:
Then the sequences {x k}, {y k}, and {t k} generated by
converge strongly to the same point x ∗∈Fix(S)∩Sol(F,C), which is the unique solution of the following variational inequality:
Now, we consider a special case of problem P(f,C), the nonexpansive mapping S is the identity mapping. Then iterative schemes (1) and (2) are to find a solution of Ky Fan inequality P(f,C). The iterative process is given by
where g is δ-contractive and the parameters satisfy (3). By Theorem 3.1, the sequence {x k} converges to the unique solution x ∗ of the following variational inequality:
It is easy to see that if x k=t k then x k is a solution of P(f,C). So, we can say that x k is an ϵ-solution to P(f,C) if ∥t k−x k∥≤ϵ. To illustrate this scheme, we consider to numerical examples in ℝ5. The set C is a polyhedral convex set given by
and the bifunction f is defined by
where the matrices A,B,q (randomly generated) are
Then A is symmetric positive semidefinite and f is Lipschitz-type continuous on C with L=2c 1=2c 2=∥A−B∥=3.7653. Since the eigenvalues of the matrix B−A are −3.5, −0.5, −1, −1, 0, we get that B−A is negative semidefinite. Therefore, f is monotone on C. With
x 0=(1,2,1,1,1)T and ϵ=10−6, the conditions (3) are satisfied and we obtain the following iterates:
Iter (k) | \(x^{k}_{1}\) | \(x^{k}_{2}\) | \(x^{k}_{3}\) | \(x^{k}_{4}\) | \(x^{k}_{5}\) |
---|---|---|---|---|---|
0 | 1 | 2 | 1 | 1 | 1 |
1 | 0.6695 | 1.5337 | 0.7686 | 0.7481 | 0.6672 |
2 | 0.7092 | 1.3673 | 0.8069 | 0.8058 | 0.7217 |
3 | 0.9045 | 1.0437 | 0.9009 | 0.8992 | 0.5033 |
4 | 0.9338 | 0.9751 | 0.9298 | 0.9278 | 0.4670 |
5 | 0.9428 | 0.9540 | 0.9387 | 0.9366 | 0.4559 |
6 | 0.9455 | 0.9475 | 0.9414 | 0.9393 | 0.4524 |
7 | 0.9464 | 0.9456 | 0.9422 | 0.9402 | 0.4514 |
8 | 0.9466 | 0.9449 | 0.9425 | 0.9404 | 0.4511 |
9 | 0.9467 | 0.9448 | 0.9426 | 0.9405 | 0.4510 |
10 | 0.9467 | 0.9447 | 0.9426 | 0.9405 | 0.4510 |
11 | 0.9467 | 0.9447 | 0.9426 | 0.9405 | 0.4510 |
The approximate solution obtained after 11 iterations is
We perform the iterative scheme (18) in Matlab R2008a running on a PC Desktop Intel(R) Core(TM)2 Duo CPU T5750@ 2.00 GHz 1.32 GB, 2 Gb RAM.
5 Conclusion
This paper presented an iterative algorithm for finding a common element of the set of fixed points of a nonexpansive mapping and the solution set of monotone and Lipschitz-type continuous Ky Fan inequality. To solve the problem, most of current algorithms are based on solving strongly auxiliary equilibrium problems. The fundamental difference here is that, at each main iteration in the proposed algorithms, we only solve strongly convex problems. Moreover, under certain parameters, we show that the iterative sequences converge strongly to the unique solution of a strong variational inequality problem in a real Hilbert space.
References
Fan, K.: A minimax inequality and applications. In: Shisha, O. (ed.) Inequality III, pp. 103–113. Academic Press, New York (1972)
Anh, P.N.: An LQP regularization method for equilibrium problems on polyhedral. Vietnam J. Math. 36, 209–228 (2008)
Blum, E., Oettli, W.: From optimization and variational inequality to equilibrium problems. Math. Stud. 63, 127–149 (1994)
Bre’zis, H., Nirenberg, L., Stampacchia, G.: A remark on Ky Fan’s minimax principle. Boll. Unione Mat. Ital., VI, 129–132 (1972)
Giannessi, F., Maugeri, A.: Variational Inequalities and Network Equilibrium Problems. Springer, Berlin (1995)
Giannessi, F., Maugeri, A., Pardalos, P.M.: Equilibrium Problems: Nonsmooth Optimization and Variational Inequality Models. Kluwer, Dordrecht (2004)
Korpelevich, G.M.: Extragradient method for finding saddle points and other problems. Èkon. Mat. Metody 12, 747–756 (1976)
Mastroeni, G.: On auxiliary principle for equilibrium problems. In: Daniele, P., Giannessi, F., Maugeri, A. (eds.) Equilibrium Problems and Variational Models. Kluwer, Dordrecht (2003)
Quoc, T.D., Anh, P.N., Muu, L.D.: Dual extragradient algorithms to equilibrium problems. J. Glob. Optim. 52, 139–159 (2012)
Martinet, B.: Régularisation d’inéquations variationelles par approximations successives. Rev. Fr. Autom. Inform. Rech. Opér., Anal. Numér. 4, 154–159 (1970)
Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14, 877–898 (1976)
Konnov, I.V.: Combined Relaxation Methods for Variational Inequalities. Springer, Berlin (2000)
Anh, P.N.: A logarithmic quadratic regularization method for solving pseudomonotone equilibrium problems. Acta Math. Vietnam. 34, 183–200 (2009)
Anh, P.N., Kim, J.K.: Outer approximation algorithms for pseudomonotone equilibrium problems. Comput. Appl. Math. 61, 2588–2595 (2011)
Ceng, L.C., Hadjisavvas, N., Wong, N.C.: Strong convergence theorem by hybrid extragradient-like approximation method for variational inequalities and fixed point problems. J. Glob. Optim., 46, 635–646 (2010)
Chen, J., Zhang, L.J., Fan, T.G.: Viscosity approximation methods for nonexpansive mappings and monotone mappings. J. Math. Anal. Appl. 334, 1450–1461 (2007)
Anh, P.N., Son, D.X.: A new iterative scheme for pseudomonotone equilibrium problems and a finite family of pseudocontractions. J. Appl. Math. Inform. 29, 1179–1191 (2011)
Mann, W.R.: Mean value methods in iteration. Proc. Am. Math. Soc. 4, 506–510 (1953)
Xu, H.K.: Viscosity approximation methods for nonexpansive mappings. J. Math. Anal. Appl. 298, 279–291 (2004)
Takahashi, S., Takahashi, W.: Viscosity approximation methods for equilibrium problems and fixed point problems in Hilbert spaces. J. Math. Anal. Appl. 331, 506–515 (2007)
Ceng, L.C., Schaible, S., Yao, J.C.: Implicit iteration scheme with perturbed mapping for equilibrium problems and fixed point problems of finitely many nonexpansive mappings. J. Optim. Theory Appl. 139, 403–418 (2008)
Kim, J.K., Anh, P.N., Nam, J.M.: Strong convergence of an extragradient method for equilibrium problems and fixed point problems. J. Korean Math. Soc. 49, 187–200 (2012)
Tada, A., Takahashi, W.: Weak and strong convergence theorems for a nonexpansive mapping and an equilibrium problem. J. Optim. Theory Appl. 133, 359–370 (2007)
Yao, Y., Liou, Y.C., Wu, Y.J.: An extragradient method for mixed equilibrium problems and fixed point problems. Fixed Point Theory Appl. (2009). doi:10.1155/2009/632819. Article ID 632819, 15 pages
Anh, P.N.: A hybrid extragradient method extended to fixed point problems and equilibrium problems. Optimization 1–13 (2011)
Suzuki, T.: Strong convergence of Krasnoselskii and Mann type sequences for one-parameter nonexpansive semi-groups without Bochner integrals. J. Math. Anal. Appl. 305, 227–239 (2005)
Goebel, K., Kirk, W.A.: Topics on Metric Fixed Point Theory. Cambridge University Press, Cambridge (1990)
Acknowledgements
This work was supported by National Foundation for Science and Technology Development of Vietnam (NAFOSTED).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Anh, P.N. Strong Convergence Theorems for Nonexpansive Mappings and Ky Fan Inequalities. J Optim Theory Appl 154, 303–320 (2012). https://doi.org/10.1007/s10957-012-0005-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-012-0005-x