Abstract
We study the equilibrium problems with strongly pseudomonotone bifunctions in real Hilbert spaces. We show the existence of a unique solution. We then propose a strongly convergent generalized projection method for equilibrium problems with strongly pseudomonotone bifunctions. The proposed method uses only one projection without requiring Lipschitz continuity. Application to variational inequalities is discussed.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Throughout the paper, we suppose that \(\mathcal {H}\) is a real Hilbert space endowed with weak topology defined by the inner product 〈⋅,⋅〉 and its reduced norm ∥⋅∥. Let \(C\subseteq \mathcal {H}\) be a nonempty closed convex subset and \(f: C\times C \to \mathbb {R}\) be a bifunction satisfying f(x,x)=0 for every x∈C. As usual, we call such a bifunction an equilibrium bifunction. We consider the following equilibrium problem:
This problem is also often called Ky Fan’s inequality due to his contribution to the subject.
Equilibrium problem (EP) gives a unified formulation for some problems such as optimization problems, saddle point, variational inequalities, fixed point, and Nash equilibria, in the sense that it includes these problems as particular cases (see for instance [4, 6, 22]).
An important approach for solving equilibrium problem (EP) is the subgradient projection method which can be regarded as an extension of the steepest descent projection method in smooth optimization. It is well known that when the bifunction f is convex subdifferentiable with respect to the second argument and Lipschitz, strongly monotone on C, one can choose regularization parameters so that this method linearly convergent (see, e.g., [23]). However, when f is monotone, the method may not be convergent (see Example 12.1.3 in [9] for monotone variational inequality). In recent years, the extragradient (or double projection) method developed by Korpelevich in [17] has been extended to obtain convergent algorithms for pseudomonotone equilibrium problems [26]. The extragradient method requires two projections onto the strategy set C, which in some cases is computational cost. Recently, in [8, 28], inexact subgradient algorithms using only one projection have been proposed for solving equilibrium problems with paramonotone equilibrium bifunctions. Other methods such as auxiliary problem principle [18, 24], penalization technique [5, 22], gap and merit functions [19, 25], and the Tikhonov and proximal point regularization methods [12–14, 16, 20] are commonly used for equilibrium problems. Solution existence for equilibrium problems can be found in some papers (see, e.g., [2–4, 6]).
In this paper, we study equilibrium problem (EP) with strongly pseudomonotone bifunctions. We show the existence of a unique solution of the problem. We then propose a generalized projection method for strongly pseudomonotone equilibrium problems. Three main features of the proposed method are:
-
It uses only one projection without requiring Lischitz continuity allowing strong convergence;
-
It allows that moving directions can be chosen in such a general way taking both the cost bifunction and the feasible set into account;
-
It does not require that the bifunction is subdifferentiable with respect to the second argument everywhere.
2 Solution Existence
As usual, by P C , we denote the projection operator onto the closed convex set C with the norm ∥⋅∥, that is,
The following well-known results on the projection operator will be used in the sequel.
Lemma 1
([1]) Suppose that C is a nonempty closed convex set in \(\mathcal {H}\) . Then,
-
(i)
P C (x) is singleton and well defined for every x;
-
(ii)
π = P C (x) if and only if 〈x−π,y−π〉≤0 ∀y∈C;
-
(iii)
∥P C (x)−P C (y)∥ 2 ≤∥x−y∥ 2 −∥P C (x)−x+y−P C (y)∥ 2 ∀x,y∈C.
We recall some well-known definitions on monotonicity (see, e.g., [2,3,6]).
Definition 1
A bifunction \(\phi : C\times C\to \mathbb {R}\) is said to be
-
(a)
strongly monotone on C with modulus β>0 (shortly β-strongly monotone) if
$$\phi(x,y) + \phi(y,x)\leq -\beta \|x - y\|^{2} \quad \forall x, y \in C; $$ -
(b)
monotone on C, if
$$\phi(x,y) + \phi(y,x) \leq 0 \quad \forall x, y \in C; $$ -
(c)
strongly pseudomonotone on C with modulus β>0 (shortly β-strongly pseudomonotone), if
$$\phi(x,y) \geq 0\quad \Longrightarrow\quad \phi(y,x) \leq - \beta\|x-y\|^{2} \quad \forall x, y\in C; $$ -
(d)
pseudomonotone on C, if
$$\phi(x, y) \geq 0\quad \Longrightarrow\quad \phi(y,x) \leq 0 \quad \forall x, y\in C. $$
From the definitions, it follows that \({\mathrm (a)} \Rightarrow {\mathrm (b)}\Rightarrow {\mathrm (d)}\) and \({\mathrm (a)}\Rightarrow {\mathrm (c)} \Rightarrow {\mathrm (d)}\), but there is no relationship between (b) and (c). Furthermore, if f is strongly monotone (respectively pseudomonotone) with modulus β>0, then it is strongly monotone (respectively pseudomonotone) with modulus \(\beta ^{\prime }\) for every \(0 < \beta ^{\prime } \leq \beta \).
The following example, for strongly pseudomonotone, bifunction is a generalization of that for strongly pseudomonotone operator in [15]. Let
where g is strongly monotone on B r with modulus β>0, for instance g(x,y)=〈x,y−x〉, and R>r>0. We see that f is strongly pseudomonotone on B r . Indeed, suppose that f(x,y)≥0. Since x∈B r , we have g(x,y)≥0. Then, by β-strong monotonicity of g on B r , g(y,x)≤−β∥x−y∥2 for every x,y∈B r . From the definition of f and y∈B r , it follows that
Thus, f is strongly pseudomonotone on B r with modulus β(R−r).
The following lemma, that will be used to prove Proposition 1 below, is a direct consequence of Theorem 3.2 in [3].
Lemma 2
Let \(\phi : C\times C \to \mathbb {R}\) be an equilibrium bifunction such that ϕ(⋅,y) is hemicontinuous for each y∈C and ϕ(x,⋅) is lower semicontinuous convex for each x∈C. Suppose that the following coercivity condition holds
Then, the equilibrium problem (EP) has a solution.
In what follows, we need the following blanket assumptions on the bifunction f:
-
(A1)
For each x∈C, the function f(x,⋅) is lower semicontinuous, convex (not necessarily subdifferentiable everywhere), and for each y∈C, the function f(⋅,y) is hemicontinuous on C;
-
(A2)
f is β-strongly pseudomonotone on C.
It is well known that if f is strongly monotone on C, then under assumption (A1), equilibrium problem (EP) has a unique solution. The following lemma extends this result to (EP) with strongly pseudomonotone bifunctions.
Proposition 1
Suppose that f is β-strongly pseudomonotone on C, then under assumption (A1), Problem (EP) has a unique solution.
Proof
First, suppose that C is unbounded. Then, by Lemma 2, it is sufficient to prove the following coercivity condition:
Indeed, otherwise, for every closed ball B r around 0 with radius r, there is x r∈C∖B r such that \(f(x,y) \geq 0~ \forall y\in C\cap B_{r}\).
Fix r 0>0, then for every r>r 0, there exists x r∈C∖B r such that f(x r,y 0)≥0 with \(y^{0} \in C\cap B_{r_{0}}\). Thus, since f is β-strongly pseudomonotone, we have
On the other hand, since C is convex and f(y 0,⋅) is convex on C, it is well known from convex analysis that there exists x 0∈C such that ∂ 2 f(y 0,x 0)≠∅, where ∂ 2 f(y 0,x 0) stands for the subdifferential of the convex function f(y 0,⋅) at x 0. Take w ∗∈∂ 2 f(y 0,x 0), by the definition of subgradient one has
With x=x r it yields
Letting \(r \to \infty \), since \(\|x^{r} \| \to \infty \), we obtain \(f(y^{0}, x^{r} ) + \beta \|x^{r}-y^{0}\|^{2} \to \infty \) which contradicts (1). Thus, the coercivity condition (C0) must hold true, then by virtue of Lemma 2, equilibrium problem (EP) admits a solution.
In the case, C is bounded, the proposition is a consequence of Ky Fan’s theorem [10].
The uniqueness of the solution is immediate from the strong pseudomonotonicity of f. □
We recall [11] that an operator \(F : C \to \mathcal {H}\) is said to be strongly pseudomonotone on C with modulus β>0, shortly β-strongly pseudomonotone, if
In order to apply the above proposition to the variational inequality problem
where F is a strongly pseudomonotone operator on C, we define the bifunction f by taking
It is obvious that x ∗ is a solution of (VI) if and only if it is a solution of equilibrium problem (EP) with f defined by (2). Moreover, it is easy to see that F is β-strongly pseudomonotone and hemicontinuous on C if and only if so is f. The following solution existence result, which is an immediate consequence of Proposition 1, seems to have not appeared in the literature.
Corollary 1
Suppose that F is hemicontinuous and strongly pseudomonotone on C. Then, the variational inequality problem (VI) has a unique solution.
3 A Generalized Projection Method for Strongly Pseudomonotone EPs
For ε≥0, we call a point x ε∈C an ε -solution to Problem (EP), if f(x ε,y)≥−ε for every y∈C. The following well-known lemma will be used in the proof of the convergence theorem below.
Lemma 3
[21] Suppose that \(\{\alpha _{k}\}_{0}^{\infty }\) is an infinite sequence of positive numbers satisfying
with \({\sum }_{k=0}^{\infty }\xi _{k} < \infty \) . Then, the sequence {α k } is convergent.
Theorem 1
Suppose that assumptions (A1) and (A2) are satisfied. Then,
-
(i)
if the algorithm terminates at iteration k, then x k is an ε-solution;
-
(ii)
it holds that
$$ \|x^{k+1} - x^{\ast}\|^{2} \leq (1-2\beta\rho_{k})\|x^{k}-x^{\ast}\|^{2}+2{\rho^{2}_{k}} +{\rho^{2}_{k}}\|g^{k}\|^{2}\quad \forall k, $$(5)where x ∗ is the unique solution of (EP). Furthermore, if the algorithm does not terminate, then the sequence {x k } strongly converges to the solution x ∗ whenever the sequence {g k } is bounded.
Proof
-
(i)
If the algorithm terminates at Step 2, then g k=0 and ρ k ≤ε. Then, by (4), f(x k,y)≥−ρ k ≥−ε for every y∈C. Hence, x k is an ε-solution. If the algorithm terminates at Step 3, then x k is an ε-solution because of Lemma 1 (ii) and (4).
-
(ii)
Since x k+1=P C (x k−ρ k g k), one has
$$\begin{array}{@{}rcl@{}} \|x^{k+1} - x^{\ast}\|^{2} &\leq& \|x^{k} - \rho_{k} g^{k} - x^{\ast}\|^{2} \\ &=&\|x^{k} -x^{\ast}\|^{2} - 2\rho_{k}\langle g^{k}, x^{k}-x^{\ast}\rangle +{\rho^{2}_{k}}\|g^{k}\|^{2}. \end{array} $$(6)
Applying (4) with y=x ∗, we obtain
which implies
Then, it follows from (4) that
Since x ∗ is a solution, f(x ∗,x k)≥0, it follows from β-strong pseudomonotonicity of f that
Combining the last inequality with (8), we obtain
Now suppose that the algorithm does not terminate, and that ∥g k∥≤C for every k. Then, it follows from (9) that
where λ k :=2β ρ k . Since \({\sum }_{k=1}^{\infty } {\rho ^{2}_{k}} < \infty \), in virtue of Lemma 3, we can conclude that the sequence {∥x k−x ∗∥2} is convergent. In order to prove that the limit of this sequence is 0, we sum up inequality (10) from 1 to k+1 to obtain
which implies
Since λ j :=2β ρ j , we have
Note that {x k} is bounded and that \({\sum }_{j=0}^{\infty } {\rho ^{2}_{j}} < \infty ,\) we can deduce from (11) and (12) that ∥x k−x ∗∥2→0 as \(k \to \infty \). □
The algorithm described above can be regarded as an extension of the one in [28] in a Hilbert space setting. The main difference lies in the determination of g k given by formula (4). This formula is motivated from the projection-descent method in optimization, where a moving direction must be both descent and feasible. Such a direction thus involves both the objective function and the feasible domain. In fact moving directions defined by (4) rely not only upon the gradient or a subgradient as in [28] and other projection algorithms for equilibrium problems, but also upon the feasible set. Points (i), (ii), and (iii) in Remark 1 below discuss more detail on formula (4).
Remark 1
-
(i)
A subproblem in this algorithm is to find a moving direction g k satisfying (4). It is obvious that if g k is a ρ k -subgradient of the convex function f(x k,⋅) at x k, then g k satisfies (4).
When \(m_{k}:=\inf _{y\in C} f(x^{k},y) > -\infty \), it is easy to see that if g k is any vector satisfying
$$\langle g^{k}, y- x^{k} \rangle \leq m_{k} + \rho_{k} := t_{k} \quad \forall y\in C, $$i.e., g k is a vector in t k -normal set N C t k (x k) of C at x k, then (4) holds true.
-
(ii)
For variational inequality (VI) with f(x,y) defined by (2), formula (4) takes the form
$$ \langle F(x^{k}), y- x^{k} \rangle + \langle g^{k}, x^{k}- y \rangle \geq -\rho_{k} \quad \forall y \in C, $$(13)which means that g k−F(x k)∈N C ρ k (x k), where N C ρ k (x k) denotes the ρ k -normal set of C at x k, that is,
$$N^{\rho_{k}}_{C}(x^{k}):= \{w^{k}: \langle w^{k}, y-x^{k}\rangle \leq \rho_{k}~ \forall y\in C\}. $$In an usual case, when C is given by \(C := \{x \in \mathcal {H}: g(x) \leq 0\}\) with g being a subdifferentiable continuous convex function, one can take g k=F(x k) when g(x k)<0, and g k may be any vector such that g k−F(x k)∈∂ g(x k) when g(x k)=0. Since
$$N_{C}(x^{k}) = \{0\}~ \text { if }~ g(x^{k}) < 0,\quad \text{and} \quad N_{C}(x^{k}) \supseteq \partial g(x^{k})~\text{ if }~ g(x^{k}) = 0, $$in both cases \(g^{k} - F(x^{k}) \in N_{C}(x^{k})\subset N^{\rho _{k}}_{C}(x^{k})\) for any ρ k ≥0.
-
(iii)
The direction g k satisfying g k−F(x k)∈N C ρ k (x k) takes not only the cost operator F, but also the constrained set C into account. This is helpful in certain cases, for example, it allows avoiding the projection onto C. Indeed, it may happen that −F(x k) is not a feasible direction of C at x k, but −g k is it.
-
(iv)
Note that since f(x k,⋅) is convex, for every ρ k >0, a ρ k -subgradient of the function f(x k,⋅) does always exist at every point in dom f(x k,⋅), but it may fail to exist if ρ k =0. Thus, the proposed algorithm does not require that the convex function f(x k,⋅) is subdifferentiable at every point in its domain.
-
(v)
For implementing the algorithm, one suggests that we take \(\rho _{k} := \varepsilon \rho ^{\prime }_{k}\), where \(\rho ^{\prime }_{k}\) is a decreasingly monotone positive sequence satisfying (3).
Remark 2
If f is jointly continuous on an open set Δ×Δ containing C×C, then {g k} is bounded whenever ρ k →0 (see, e.g., Proposition 3.4 in [29]). In the case of variational inequality (VI) with f(x,y) defined by (2), if g k=F(x k) and F is continuous, then {g k} is bounded because of boundedness of {x k}.
4 A Numerical Example
We consider an oligopolistic equilibrium model of the electricity markets (see, e.g., [7 , 27]). In this model, there are n c companies, each company i may possess I i generating units. Let x denote the vector whose entry x i stands for the power generating by unit i. Following [7], we suppose that the price p is a decreasing affine function of σ with \(\sigma = {\sum }_{i=1}^{n^{g}} x_{i}\) where n g is the number of all generating units, that is,
where a 0>0 is a constant (in general is large). Then, the profit made by company i is given by
where c j (x j ) is the cost for generating x j . Unlike [7], we do not suppose that the cost c j (x j ) is differentiable, but
with
where \({\alpha ^{k}_{j}}, {\beta ^{k}_{j}}, {\gamma ^{k}_{j}}~(k=0, 1)\) are given parameters.
Let \(x^{\min }_{j}\) and \(x^{\max }_{j}\) be the lower and upper bounds for the power generating by the unit j. Then, the strategy set of the model takes the form
Define the matrices A, B by taking
where \(q^{i}:=({q^{i}_{1}},\dots ,q^{i}_{n^{q}})^{T}\) with
and let
Then, by Lemma 7 in [27], the equilibrium problem being solved can be formulated as
Note that f(x,y)+f(y,x)=−(y−x)T(A+B)(y−x)T. Thus, since A+B is not positive semidefinite, f may not be monotone on C. However, if we replace f by f 1 defined as
then f 1 is strongly pseudomonotone on C. In fact, one has
Thus, if f 1(x,y)≥0, then
for some λ>0. The following lemma is an immediate consequence of the auxiliary principle (see, e.g., [23 , 24]).
Lemma 4
The problem
is equivalent to the one
in the sense that their solution sets coincide.
In virtue of this lemma, we can apply the proposed algorithm to the model by solving the equilibrium problem (EP1), which in turns, is just equilibrium problem (EP).
We test the proposed algorithm for this problem which corresponds to the first model in [7] where three companies (n c=3) are considered with a 0:=387 and the parameters are given in Tables 1 and 2.
We implement Algorithm 1 in Matlab R2008a running on a Laptop with Intel(R) Core(TM) i3CPU M330 2.13 GHz with 2 GB Ram. We choose \(\varepsilon = 10^{{~}_{3}}\) and \(\rho _{k}:= \frac {\varepsilon }{k}\) for every k. The computational results are reported in Table 3 with the starting point x 1=0.
References
Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. Springer, New York (2010)
Bianchi, M., Schaible, S.: Generalized monotone bifunctions and equilibrium problems. J. Optim. Theory Appl. 90, 31–43 (1996)
Bianchi, M., Pini, R.: Coercivity conditions for equilibrium problems. J. Optim. Theory Appl. 124, 79–92 (2005)
Bigi, G., Castellani, M., Pappalardo, M., Passacantando, M.: Existence and solution methods for equilibria. Eur. J. Oper. Res. 227, 1–11 (2013)
Bigi, G., Passacantando, M.: Descent and penalization techniques for equilibrium with nonlinear constraints. J. Optim. Theory Appl. (2013). doi:10.1007/s10957-013-0473-7
Blum, E., Oettli, W.: From optimization and variational inequalities to equilibrium problems. Math. Stud. 63, 123–145 (1994)
Contreras, J., Klusch, M., Krawczyk, J.B.: Numerical solutions to Nash-Cournot equilibria in coupled constraint electricity markets. IEEE Trans. Power Syst. 19, 195–206 (2004)
Bello Cruz, J.Y., Santos, P.S.M., Scheimberg, S.: A two-phase algorithm for a variational inequality formulation of equilibrium problems. J. Optim. Theory Appl. 159, 562–575 (2013)
Facchinei, F., Pang, J.-S.: Finite-Dimensional Variational Inequalities and Complementarity Problems. Springer, New York (2003)
Fan, K.: A minimax inequality and applications. In: Shisha, O. (ed.) Inequalities, vol. 3, pp 103–113. Academic Press, New York (1972)
Farouq, N.El.: Pseudomonotone variational inequalities: Convergence of proximal methods. J. Optim. Theory Appl. 109, 311–326 (2001)
Hung, P.G., Muu, L.D.: The Tikhonov regularization extended to equilibrium problems involving pseudomonotone bifunctions. Nonlinear Anal. 74, 6121–6129 (2011)
Iusem, A.N., Sosa, W.: Iterative algorithms for equilibrium problems. Optimization 52, 301–316 (2003)
Iusem, A.N., Sosa, W.: On the proximal point method for equilibrium problems in Hilbert spaces. Optimization 59, 1259–1274 (2010)
Khanh, P.D., Vuong, P.T.: Modified projection method for strongly pseudomonotone variational inequalities. J. Glob. Optim. 58, 341–350 (2014)
Konnov, I.V.: Regularization method for nonmonone equilibrium problems. J. Nonlinear Convex Anal. 10, 93–101 (2009)
Korpelevich, G.M.: The extragradient method for finding saddle points and other problems. Ekon. Mat. Metody 12, 747–756 (1976)
Lorenzo, D., Passacantando, M., Sciandrone, M.: A convergent inexact solution method for equilibrium problems. Optim. Methods Softw. 29, 979–991 (2014)
Mastroeni, G.: Gap functions for equilibrium problems. J. Glob. Optim. 27, 411–426 (2003)
Moudafi, A.: Proximal point algorithm extended to equilibrium problems. J. Nat. Geom. 15, 91–100 (1999)
Moudafi, A.: Proximal methods for a class of bilevel monotone equilibrium problems. J. Glob. Optim. 47, 287–292 (2010)
Muu, L.D., Oettli, W.: Convergence of an adaptive penalty scheme for finding constrained equilibria. Nonlinear Anal. 18, 1159–1166 (1992)
Muu, L.D., Quoc, T.D.: Regularization algorithms for solving monotone Ky Fan inequalities with application to a Nash-Cournot equilibrium model. J. Optim. Theory Appl. 142, 185–204 (2009)
Noor, M.A.: Auxiliary principle technique for equilibrium problems. J. Optim. Theory Appl. 122, 371–386 (2004)
Pappalardo, M., Mastroeni, G., Pasacantando, M.: Merit functions: a bridge between optimization and equilibria. 4OR 12, 1–33 (2014)
Quoc, T.D., Muu, L.D., Nguyen, V.H.: Extragradient algorithms extended to equilibrium problems. Optimization 57, 749–776 (2008)
Quoc, T.D., Anh, P.N., Muu, L.D.: Dual extragradient algorithms extended to equilibrium problems. J. Glob. Optim. 52, 139–159 (2012)
Santos, P., Scheimberg, S.: An inexact subgradient algorithm for equilibrium problems. Comput. Appl. Math. 30, 91–107 (2011)
Vuong, P.T., Strodiot, J.-J., Nguyen, V.H.: Extragradient methods and linesearch algorithms for solving Ky Fan inequalites and fixed point problems. J. Optim. Theory Appl. 155, 605–627 (2012)
Acknowledgments
We would like to thank the referees for their useful remarks and comments that helped us very much in revising the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper is dedicated to Professor Nguyen Khoa Son on the occasion of his 65th birthday.
This work is supported by the National Foundation for Science and Technology Development of Vietnam (NAFOSTED).
Rights and permissions
About this article
Cite this article
Muu, L.D., Quy, N.V. On Existence and Solution Methods for Strongly Pseudomonotone Equilibrium Problems. Vietnam J. Math. 43, 229–238 (2015). https://doi.org/10.1007/s10013-014-0115-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10013-014-0115-x