Abstract
In this paper we study the stochastic maximum principle for a control problem in infinite dimensions. This problem is governed by a fully coupled forward-backward doubly stochastic differential equation (FBDSDE) driven by two cylindrical Wiener processes on separable Hilbert spaces and a Poisson random measure. We allow the control variable to enter in all coefficients appearing in this system.
Existence and uniqueness of the solutions of FBDSDEs and an extended martingale representation theorem are provided as well.
A. Al-Hussein—This work is supported by the Science College Research Center at Qassim University, project no. SR-D-012-1958.
B. Gherbal—It is also supported by the Algerian PNR project no. 8/u 07/857.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
- Wiener process
- Poisson process
- Forward-backward doubly stochastic differential equation
- Maximum principle
1 Introduction
Backward stochastic differential equations in infinite dimensions (BSDEs) were studied by Hu and Peng in [6], Tessitore in [17] and Al-Hussein in [3]. Al-Hussein proved in [3] the existence and uniqueness of the solutions to BSDEs in infinite dimensions driven by genuine \(Q\) - Wiener processes (and also cylindrical Wiener processes) on separable Hilbert spaces. He gave also a representation of the solution of a system of semi-linear parabolic PDEs and found viscosity solutions to such PDEs. In [4] sufficient conditions of optimality for backward stochastic evolution equations on Hilbert spaces are derived. Several references in these directions are recorded in [4]. These works give a motivational base to study the maximum principle for optimality of forward-backward stochastic differential equations (FBSDEs) in infinite dimensions. In fact, Yin and Wang [19], proved the existence and uniqueness of the solutions of FBSDEs with Poisson jumps in Hilbert space and with bounded random terminal times. Their work relies on those in [16] and the method of continuation given in [7]. Developing applications to such FBSDEs as for example in [3] are not yet well studied.
Let us now talk about more general equations. In finite dimensions, a fully coupled forward-backward doubly stochastic differential equation (FBDSDE) was introduced by Peng and Shi in [12]. Such equations are generalizations of stochastic Hamilton systems. Al-Hussein and Gherbal in [5] studied a stochastic control problem governed by a fully coupled multi-dimensional FBDSDE with Poisson jumps.
In the present work, we shall work in infinite dimensions and try to derive the stochastic maximum principle for optimal control of fully coupled FBDSDEs with jumps; see (1) below. Moreover, existence and uniqueness of the solutions to infinite dimensional FBDSDEs along with an extended martingale representation theorem will be provided as well.
Applications of such equations can be gleaned from [5]. Our formulation of these equations as well as cost functionals are given in abstract forms to allow the possibility to work directly in the case of partial information on one hand and on the other hand to cover most of the applications available in the literature. For instance, a linear quadratic case can be given as a concrete and useful example. For more details of this example, we refer the reader to [15] or [18]. In fact, many applications of FBDSDE either in finance or to stochastic PDEs can be developed in parallel to those provided in the literature.
Our results here can be generalized easily to the case of a stochastic relaxed control problem governed by a nonlinear fully coupled FBDSDE with Poisson jumps, which involves relaxed controls. We refer the reader to Ahmed et al. [1], in this respect.
The paper is organized as follows. Notation and an extended martingale representation theorem are recorded in Sect. 2. Section 3 is devoted to stating the stochastic optimal control problem, which is governed by FBDSDE (1). Existence and uniqueness of the solutions of FBDSDEs are included in Sect. 4. Finally, in Sect. 5 we establish the stochastic maximum principle of our control problem.
2 Notation and an Extended Martingale Representation Theorem
Let \((\varOmega ,\mathcal {F},\mathbb {P}) \) be a complete probability space. Let \(H_1\) and \(H_2\) be two separable Hilbert spaces. Assume that \((W_{t}) _{t\in [ 0,T ] }\) and \((B_{t}) _{t\in [ 0,T ] }\) are two cylindrical Wiener processes on \(H_1\) and \(H_2\) respectively, where \(T\) is a fixed positive number. Let \(\eta \) be a Poisson point process with values in a measurable space \(( \varTheta ,\mathcal {B}( \varTheta ) ) .\) We denote by \(\nu ( d\theta ) \) to the characteristic measure of \(\eta ,\) which is assumed to be a \(\sigma \)-finite measure on \(( \varTheta ,\mathcal {B}( \varTheta ) ),\) by \(N (d\theta ,dt) \) to the Poisson counting measure induced by \(\eta \) with compensator \(\nu ( d\theta ) dt\), and by \(\tilde{N}( d\theta ,dt) = N ( d\theta ,dt) -\nu ( d\theta ) dt\) to the compensation of the jump measure \(N(\cdot , \cdot )\) of \(\eta .\) We assume that the three processes \(B , W\) and \(\eta \) are mutually independent.
For each \( t\in [ 0,T ] \), define
where
and \(\mathcal {N}\) is the collection of all \(\mathbb {P}\)-null sets of \(\mathcal {F}\).
Note that \(\{ \mathcal {F}_{t} \}_{t \in [0 , T]}\) does not constitute a filtration because it is not increasing nor decreasing.
Let us set the following spaces of solutions.
For a separable Hilbert space \(E,\) let \(\mathcal {M}^{2}(0,T; E) \) denote the set of jointly measurable processes \(\left\{ \mathcal {Y}_{t} , t\in [0,T] \right\} \) taking values in \(E,\) and satisfy: \(\mathcal {Y}_{t}\) is \(\mathcal {F}_{t}\)-measurable for a.e. \(t \in [0,T], \) and
Let \(L_{\nu }^{2}(E)\) be the set of \(\mathcal {B}( \varTheta )\)-measurable mapping \(k\) with values in \(K\) such that
Denote by \(\mathcal {V}_{\eta }^{2}( 0,T ;E) \) to the set of processes \(\{ \mathfrak {K}_{t} , \; t \in [0,T] \}\) that take their values in \(L_{\nu }^{2}(K)\) and satisfy: \(\mathfrak {K}_{t}\) is \(\mathcal {F}_{t}\)-measurable for a.e. \(t \in [0,T], \) and
Finally, fixing a fixed separable Hilbert space \(K ,\) we set
Here \(L_2 (E, K)\) denotes the space of all Hilbert-Schmidt operators from \(E\) into \(K ,\) for \(E = H_1 , H_2 ,\) with inner product dented by \(|| \cdot || .\) Then \(\mathbb {M}^{2}\) is a Hilbert space with respect to the norm \(\left\| \cdot \right\| _{\mathbb {M}^{2}}\) given, for \(\varLambda _{\cdot }=\left( x_{\cdot },Y_{\cdot },z_{\cdot },Z_{\cdot }, \xi _{\cdot } \right) ,\) by
We close this section by providing an extended martingale representation theorem.
Theorem 1
Let \(\rho \) and \(g\) be elements of \(L^2(\varOmega , \mathcal {F}_T , \mathbb {P} ; K) \) and \(\mathcal {M}^{2}(0,T ; L_2 (H_1 , K) ) ,\) respectively. If \(M\) is the martingale
where \( \mathcal {E}_t := \mathcal {F}_{t}^{W}\vee \mathcal {F}_{T}^{B}\vee \mathcal {F}_{t}^{\eta } ,\) then there exist unique elements \((\phi , \kappa )\) of \(\mathcal {M}^{2} (0,T; L_2(H_2 , K) ) \times \mathcal {V}_{\eta }^{2}\left( 0,T ;K\right) \) such that
Here the integral with respect to \(\overleftarrow{dB}\) is a backward Itô integral, while the integral with respect to \(dW\) is a standard forward Itô integral.
This result is known in finite dimensions (i.e. when all Hilbert spaces are Euclidean spaces), as it can be seen easily by combining the well known martingale representation theorem for Brownian motions and Poisson random measure (e.g. see [10, Lemma 4.2] or [8]) and [11, Proposition 1.2]. The proof of this infinite dimensional version can be gleaned by mimicking the ideas of proofs in [11, Proposition 1.2], [2, Theorem 3.1] and [10, Lemma 4.2].
Such a theorem is in fact essential for finding solutions to BDSDEs and decoupled (or coupled) FBDSDEs; see e.g. [9] for using martingale representation theorem to show the existence of solutions to FBSDEs in continuous situations.
3 Statement of the Control Problem
Let \(\mathcal {O}\) be a separable Hilbert space and \(U\) be a nonempty convex of \(\mathcal {O} .\) We say that \(v_{\cdot } : [0 , T]\times \varOmega \rightarrow \mathcal {O}\) is admissible if \(v_{\cdot } \in \mathcal {M}^{2}(0,T; \mathcal {O} )\) and \(v_{t} \in U \; \; a.e. \; t, \; a.s.\) The set of admissible controls will be denoted by \(\mathcal {U}_{ad} .\) Consider the following controlled \(K\)-valued fully coupled FBDSDE with jumps:
where the coefficients
are measurable and \(v_{\cdot } \in \mathcal {U}_{ad} .\) More conditions will be assumed in Sect. 3. The mapping \(h\) is defined, for \((\omega , x) \in \varOmega \times K ,\) by \(h(\omega , x) := c \, x + \zeta (\omega ) , \) where \(c \ne 0\) is a constant and \(\zeta \) is a fixed arbitrary element of \(L^{2}( \varOmega ,\mathcal {F}_{T},\mathbb {P}; K) .\)
Definition 1
A solution of (1) is a quintuple \((x,Y,z,Z,\xi )\) of stochastic processes such that \((x,Y,z,Z, \xi )\) belongs to \(\mathbb {M}^{2}\) and satisfies the following two integral equations:
In Sect. 4 we shall discuss the existence and uniqueness of (1).
Let us now introduce a cost functional:
with
being measurable functions such that (2) is defined. See assumption (A3) below for precise assumptions.
The control problem of system (1) is to minimize \(J\) over \(\mathcal {U}_{ad} .\) Thus an admissible control \(u_{\cdot }\) is called an optimal control if
In this case we shall say that \((x,Y,z,Z,\xi ,u_{\cdot })\) is an optimal solution of the control problem (1)–(3).
Further details on this control problem will be the main purpose of Sect. 5. We discuss next the existence and uniqueness of (1).
4 Forward-Backward Doubly Stochastic Differential Equations
We shall be interested here in the existence and uniqueness of the solution to FBDSDE (1). Keeping the notations in Sect. 3 denote
and
for \(X = (x,Y,z,Z,\xi ) \in K \times K \times L_{2}(H_2;K)\times L_2(H_1 ; K) \times L_{\nu }^{2}(K)\) and \( (t, v) \in [ 0,T ] \times \mathcal {O} .\) The following three assumptions on the coefficients of system (1) and (2) are our main assumptions.
(A1) \(\forall \, X=( x,Y,z,Z,\xi ) ,\bar{X}=( \bar{x},\bar{Y},\bar{z},\bar{Z},\bar{\xi }) \in K \times K \times L_{2}(H_2;K)\times L_2(H_1 ; K) \times L_{\nu }^{2}(K) , \; \forall \, t\in [ 0,T ] , \; \forall \, v \in \mathcal {O},\)
and
or
(A1)’
and
for some \(\lambda > 0 .\)
(A2) For each \(X \in K \times K \times L_{2}(H_2;K)\times L_2(H_1 ; K) \times L_{\nu }^{2}(K) \) and \(v \in \mathcal {O},\) we have \(A( \cdot ,X , v) \in \mathbb {M}^2 .\)
(A3) We have
for some constant \(C > 0 .\)
Remark 1
The condition \(c > 0\) in (A1) guarantees the following monotonicity condition of the mapping \(h\):
A similar thing happens also for the case \(c <0\) in (A1)’.
Theorem 2
If (A1)–(A3) (or (A1)’, (A2)–(A3)) hold, then there exists a unique solution \(( x,Y,z,Z,\xi )\) of the FBDSDE (1).
By making use of the extended martingale representation theorem (Theorem 1), the proof is standard and can be achieved directly by following the outline of the proofs in [13, 14]. So we omit it.
This theorem in its infinite dimensional setting is new. In fact, as far as know, this is the first appearance of such an infinite dimensional result as well as Theorem 1.
5 Stochastic Maximum Principle
To derive the maximum principle we define the Hamiltonian \(\mathcal {H}\) from \([0,T]\times \varOmega \times K \times K\times L_{2}(H_2;K)\times L_{2}(H_1;K)\times L_{\nu }^{2}(K)\times \mathcal {O}\times K\times K\times L_{2}(H_2;K)\times L_{2}(H_1;K)\times L_{\nu }^{2}(K)\) to \(\mathbb {R}\) by the formula:
Theorem 3
Let \(v_{\cdot }\) be an arbitrary element of \(\mathcal {U}_{ad} .\) Assume (A1)–(A3). Let \(\{(y_t,Y_t,z_t,Z_t,k_t) , \; t \in [0, T] \}\) be the corresponding solution of (1). Then there exists a unique solution \((p,P,q,Q,\varUpsilon )\) of the following adjoint equations of (1):
where \(\mathcal {H}_x (t)\) is the gradient \(\nabla _x \mathcal {H} ( t , x , Y_t, z_t, Z_t, \xi _t , v_t,p_t,P_t,q_t,Q_t,\varUpsilon _t ) \in K , \ldots \) etc.
Proof
Thanks to assumptions (A1)–(A3) this linear FBDSDE satisfy (A1)’, (A2) and (A3). In fact the monotonicity condition follows from the definition of Gâteaux derivatives (as limits) and the fact that the corresponding mappings satisfy originally the monotonicity condition in (A1). Hence the result follows from Theorem 2.
We are now ready to state the stochastic maximum principle for the optimal control problem (1)–(3).
Theorem 4
Suppose that (A1)–(A3) hold. Given \(u_{\cdot } \in \mathcal {U}_{ad}\), let \((x^{u_{\cdot }},Y^{u_{\cdot }},z^{u_{\cdot }},Z^{u_{\cdot }},\xi ^{u_{\cdot }})\) and \((p^{u_{\cdot }},P^{u_{\cdot }},q^{u_{\cdot }},Q^{u_{\cdot }},\varUpsilon ^{u_{\cdot }})\) be the corresponding solutions of FBDSDEs (1) and (5), respectively. Assume that the following assumptions hold.
(i) \(\varphi \) and \(\psi \) are convex;
(ii) For all \(t \in [0 , T] , \; \mathbb {P}\) - a.s., the function \(\mathcal {H}( t, \cdot , \cdot , \cdot , \cdot , \cdot , \cdot ,p^{u_{\cdot }},P^{u_{\cdot }},q^{u_{\cdot }},Q^{u_{\cdot }},\varUpsilon ^{u_{\cdot }}) \) is convex;
(iii) We have
for a.e. \(t ,\) \(\mathbb {P}\) - a.s.
Then \((x^{u_{\cdot }},Y^{u_{\cdot }},z^{u_{\cdot }},Z^{u_{\cdot }},\xi ^{u_{\cdot }},u_{\cdot })\) is an optimal solution of the control problem (1)–(3).
Proof
Let \(v_{\cdot }\) be an arbitrary element of \(\mathcal {U}_{ad} .\) With the help of assumptions (A1)–(A3) let, by using of Theorem 2, \((x^{v_{\cdot }},Y^{v_{\cdot }},z^{v_{\cdot }},Z^{v_{\cdot }},\xi ^{v_{\cdot }})\) be the corresponding solution of FBDSDE (1). Applying (2), the convexity of \(\varphi \) and \(\psi ,\) the adjoint equations (5) and system (1) it follows that
Next, by applying a suitable Itô’s formula for infinite dimensional SDEs driven by Wiener processes on Hilbert spaces and Poisson measures to compute \(\left\langle p_{t}^{u_{\cdot }},Y_{t}^{v_{\cdot }}-Y_{t}^{u_{\cdot }}\right\rangle _{K} \) and \(\left\langle P_{t}^{u_{\cdot }}, x_{t}^{v_{\cdot }}-x_{t}^{u_{\cdot }}\right\rangle _{K} ,\) we derive with the help of assumptions (A2) and (A3) that
On the hand, from the formula \(h(\omega , x) := c \, x + \xi (\omega ) , x \in K ,\) one gets easily the cancelation:
Therefore, by applying (8) and (9) in (7), using the formula of \(\mathcal {H}\) in (4) and then the convexity of \(\mathcal {H}\) in condition (ii) we obtain
But the minimum condition (iii) yields
Consequently (10) becomes
Since \(v_{\cdot }\) is an arbitrary element of \(\mathcal {U}_{ad},\) then \(u_{\cdot }\) is an optimal control, and so the proof is complete.
Remark 2
Condition (A1) assumed in Theorem 4 is only needed to guarantee the existence and uniqueness of the solutions of (1) and (5), and so if one can get such solutions without assuming (A1) there will not any necessity to assume it in advance in this theorem.
References
Ahmed, N.U., Charalambous, C.D.: Stochastic minimum principle for partially observed systems subject to continuous and jump diffusion processes and driven by relaxed controls. arXiv:1302.3455v1 [math.OC] (2013)
Al-Hussein, A.: Martingale representation theorem in infinite dimensions. Arab. J. Math. Sci. 10(1), 1–18 (2004)
Al-Hussein, A.: Backward stochastic differential equations in infinite dimensions and applications. Arab. J. Math. Sci. 10(2), 1–42 (2004)
Al-Hussein, A.: Sufficient conditions of optimality for backward stochastic evolution equations. Commun. Stoch. Anal. 4(3), 433–443 (2010)
Al-Hussein, A., Gherbal, B.: Maximum principle for optimal control of forward-backward doubly stochastic differential equations with jumps. arXiv:1301.1948v4 [math.OC] (2013, submitted)
Hu, Y., Peng, S.: Maximum principle for semilinear stochastic evolution equation control systems. Stochastics 33, 159–180 (1990)
Hu, Y., Peng, S.: Solutions of forward-backward stochastic differential equations. Probab. Theor. Relat. Fields 103, 273–283 (1995)
Ikeda, N., Watanabe, S.: Stochastic Differential Equations and Diffusion Processes. North Holland/Kodansha, Amsterdam/Tokyo (1981)
Ma, J., Yong, J.: Forward-backward Stochastic Differential Equations and Their Applications. Lecture Notes in Mathematics, vol. 1702. Springer, Berlin (1999)
Øksendal, B., Proske, F., Zhang, T.: Backward stochastic partial differential equations with jumps and application to optimal control of random jump fields. Stochastics 77(5), 381–399 (2005)
Pardoux, E., Peng, S.: Backward doubly stochastic differential equations and systems of quasilinear SPDEs. Probab. Theor. Relat. Fields 98, 209–227 (1994)
Peng, S., Shi, Y.: A type-symmetric forward-backward stochastic differential equations. C. R. Acad. Sci. Paris Ser. I 336(1), 773–778 (2003)
Peng, S., Wu, Z.: Fully coupled forward-backward stochastic differential equations and applications to optimal control. SIAM J. Control Optim. 37, 825–843 (1999)
Zhu, Q., Shi, Y.: Forward-backward doubly stochastic differential equations with random jumps and stochastic partial differential-integral equations, [OL].[201001-1044]. http://www.paper.edu.cn/index.php/default/en-releasepaper/downPaper/201001-1044
Shi, J.T., Wu, Z.: Maximum principle for partially-observed optimal control of fully-coupled forward-backward stochastic systems. J Optim. Theor. Appl. 145, 543–578 (2010)
Situ, R.: On solutions of backward stochastic differential equations with jumps and with non-Lipschitzian coefficients in Hilbert spaces and stochastic control. Stat. Probab. Lett. 60(4), 279–288 (2002)
Tessitore, G.: Existence, uniqueness and space regularity of the adapted solutions of a backward SPDE. Stoch. Anal. Appl. 14(4), 461–486 (1996)
Wang, X., Wu, Z.: FBSDE with Poisson process and its application to linear quadratic stochastic optimal control problem with random jumps. Acta Automatica Sinica 29, 821–826 (2003)
Yin, J., Wang, Y.: Hilbert space-valued forward-backward stochastic differential equations with Poisson jumps and applications. Math. Anal. Appl. 328, 438–451 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Al-Hussein, A., Gherbal, B. (2014). Stochastic Maximum Principle for Hilbert Space Valued Forward-Backward Doubly SDEs with Poisson Jumps. In: Pötzsche, C., Heuberger, C., Kaltenbacher, B., Rendl, F. (eds) System Modeling and Optimization. CSMO 2013. IFIP Advances in Information and Communication Technology, vol 443. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45504-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-662-45504-3_1
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-45503-6
Online ISBN: 978-3-662-45504-3
eBook Packages: Computer ScienceComputer Science (R0)