Abstract
In this paper, we study a class of singular stochastic optimal control problems for systems described by mean-field forward-backward stochastic differential equations, in which the coefficient depend not only on the state process but also its marginal law of the state process through its expected value. Moreover, the cost functional is also of mean-field type. The control variable has two components, the first being absolutely continuous and the second singular control. Necessary conditions for optimal control for this systems in the form of a Pontrygin maximum principle are established by means convex perturbation techniques for both continuous and singular parts. Our stochastic maximum principle differs from the classical one in the sense that here the adjoint equation has a mean-field type. The control domain is assumed to be convex. As an illustration of our results, we consider a mean-variance portfolio selection mixed with a recursive utility functional optimization problem involving singular control. The explicit expression of the optimal portfolio selection strategy is obtained in the state feedback form involving both state process and its marginal distribution, via the solutions of Riccati ordinary differential equations with time-inconsistent solution.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
In the present paper, we discuss stochastic singular optimal control problem for a systems governed by controlled nonlinear mean-field forward-backward stochastic differential equations (FBSDEs) of the form:
where \(f,\sigma ,g,h,\mathcal {C}\) and \(\mathcal {D}\) are given maps and the initial condition \(a\) is an \(\mathcal {F}_{0}-\)measurable random variable.The special mean-field FBSDEs-(1) which is also called McKean–Vlasov systems are obtained as a limit approach, by the mean-square limit, when \(n \rightarrow +\infty \) of a system of interacting particles of the form
where \((W^{j}(\cdot ):j\ge 1)\) is a collection of independent Brownian motions, and \(\xi (\cdot )\) is the singular part of the control. Noting that mean-field FBSDEs-(1) occur naturally in the probabilistic analysis of financial optimization problems and the optimal control of dynamics of the McKean–Vlasov type. Moreover, the above mathematical mean-field approaches play an important role in different fields of economics, finance, physics, chemistry and game theory.
The expected cost on the time interval \(\left[ 0,T\right] \) is defined by
where \(\ell ,\phi ,\varphi \) and \(\mathcal {L}\) are an appropriate functions. This cost functional is also of mean-field type, as the functions \(\ell ,\phi ,\varphi \) depend on the marginal law of the state process through its expected value.
It worth mentioning that since the cost functional \(J\) is possibly a nonlinear function of the expected value stands in contrast to the standard formulation of a control problem. This leads to a so-called time-inconsistent control problem where the Bellman dynamic programming does not hold. The reason for this is that one cannot apply the law of iterated expectations on the cost functional. Noting that in most cases, the classical singular control problem was studied through dynamic programming principle.
Any admissible control \((u^{*}(\cdot ),\xi ^{*}(\cdot ))\) satisfying
is called an optimal control. The corresponding state processes, solution of mean-field FBSDE-(1), is denoted by \(\big ( x^{*}(\cdot ), y^{*}(\cdot ),z^{*}(\cdot )\big ) =(x^{u^{*},\xi ^{*}}(\cdot ),y^{u^{*},\xi ^{*}}(\cdot ),z^{u^{*},\xi ^{*}}(\cdot )).\)
The stochastic singular control problems have received considerable research attention in recent years due to wide applicability in a number of different areas, see for instance [1–15] . In most classical cases, the optimal singular control problem was investigated through dynamic programming principle. It was shown in particular that the value function is a solution of some quasi-variational inequalities. Some applications of singular and impulse stochastic control in financial mathematics, a cash management problem, optimal control of an exchange rate, and portfolio optimization under transaction costs have been investigated in Korn [16]. Stochastic maximum principle for optimal control problems of forward backward systems involving impulse controls has been studied in Wu and Zhang [3, 12]. The stochastic maximum principle for singular control was considered by many authors, see for instance [1, 2, 4–10]. The first version of maximum principle for singular stochastic control problems was obtained by Cadenillas and Haussmann [9]. In Dufour and Miller [10], the authors derived stochastic maximum principle where the singular part has a linear form. The necessary and sufficient conditions for near-optimal singular control was obtained by Hafayed Abbas and Veverka [5]. For this type of problem, the reader may consult the papers by Haussmann and Suo [4] and the list of references therein. The necessary and sufficient conditions of near-optimality for singular control for jump diffusion processes have been investigated in Hafayed and Abbas [6]. Necessary and sufficient conditions of near-optimal singular control for mean-field SDE have been established by Hafayed and Abbas [7]. More interestingly, mean-field type stochastic maximum principle for optimal singular control, where the control domain is assumed to be convex, has been studied in Hafayed [8].
The stochastic maximum principle of optimality for classical FBSDEs has been studied by many authors, see e.g. [17–26]. The necessary conditions of optimality for FBSDEs in global form, with uncontrolled diffusions coefficient was derived by Xu [17]. However, Shi and Wu [18] first derived stochastic maximum principle for fully coupled forward-backward stochastic control system in global form.In recent paper by Yong [23], the author completely solved the problem of maximum principle of optimality for fully coupled FBSDEs. He considered an optimal control problem for general coupled FBSDEs with mixed initial-terminal conditions and derived the necessary conditions for optimality when the control variable appears in the diffusion coefficients of the forward equation and the control domain is not necessarily convex. More recently, the general maximum principle for controlled forward-backward stochastic systems has been studied by Wu [22]. This type of maximum principle has broad applications in mathematical finance and economics such as the recursive mean–variance portfolio choice problems. The maximum principles for stochastic recursive optimal control problems under partial information have been investigated in Wang and Wu [20]. Necessary and sufficient conditions for near-optimality for recursive problems have been established by Hui, Huang, Li, and Wang [21]. We refer the readers to [26–28] and the references cited therein, for some other relevant results of optimal controls and FBSDEs. Stochastic forward–backward linear quadratic optimal control problem with delay has been studied in Huang, Li and Shi [24].
The stochastic differential equations of mean-field type was introduced by Kac [34] as a stochastic model for the Vlasov-kinetic equation of plasma and the study of which was initiated by McKean model. Since then, many authors made contributions on mean-field stochastic control and applications, see for instance, [7, 8, 29–39] . Mean-field stochastic maximum principle of optimality was considered by many authors, see for instance [7, 30, 33, 36–40]. Mean-field singular stochastic control problems have been investigated in Hafayed and Abbas [7]. The mean-field stochastic maximum principle for forward-backward stochastic differential equations with jump poisson processes has been investigated in Hafayed [29]. He derived the necessary conditions for optimality when the control variable not appear in the diffusion coefficient of the forward equation and the control domain is not necessarily convex by means spike variational method. In Lazry and Lions [35] the authors introduced a general mathematical modeling approach for high-dimensional systems of evolution equations corresponding to a large number of particles (or agents). They extended the field of such mean-field approaches also to problems in economics, finance and game theory. In Buckdahn, Djehiche, Li and Peng [32] a general notion of mean-field BSDE associated with a mean-field SDE is obtained in a natural way as a limit of some high dimensional system of FBSDEs governed by a \(d-\)dimensional Brownian motion, and influenced by positions of a large number of other particles. In Buckdahn, Djehiche and Li [33] a general maximum principle was introduced for a class of stochastic control problems involving SDEs of mean-field type. However, sufficient conditions of optimality for mean-field SDE have been proved in Shi [40]. In Mayer-Brandis, \(\emptyset \) ksendal and Zhou [38] a stochastic maximum principle of optimality for systems governed by controlled Itô-Levy process of mean-field type was proved by using Malliavin calculus. Under the conditions that the control domains are convex, a various local maximum principle have been studied in [36, 37, 39]. The linear-quadratic optimal control problem for mean-field SDEs has been studied by Shi [40]. The second-order mean-field stochastic maximum principle for jump diffusion processes has been investigated in Hafayed and Abbas [30].
Our main goal in this paper is to establish a stochastic maximum principle for optimal singular stochastic control of mean-field FBSDEs, where the coefficient of the system depend not only on the state process but also its marginal law of the state process through its expected value. The cost functional is also of mean-field type. The mean-field problem under consideration is not simple extension from the mathematical point of view, but also provide interesting models in many applications such as mathematical finance, optimal control for mean-field systems. The proof of our main result is based on convex perturbation method. These necessary conditions are described in terms two adjoint processes, corresponding to the mean-field forward and backward components involving singular controls and a maximum conditions on the Hamiltonian. At the end, as an application to finance, mean-variance portfolio selection mixed with a recursive utility optimization problem is given. To streamline the presentation of this paper, we only study the one dimensional case. This paper extends the results obtained in Wu and Zhang [3] to mean-field singular control problem for systems described by mean-field FBSDEs and generalize the necessary conditions of optimality obtained in Hafayed [8] to mean-field forward-backward systems. This mean-field problem is not simple extension from the mathematical point of view, but also provide interesting models in many applications such as mathematical finance.
The rest of this paper is structured as follows. In Sect. 2 we formulate the mean-field singular stochastic control problem and describe the assumptions of the singular stochastic model. Section 3 is devoted to prove our main result which is a mean-field type stochastic maximum principle for optimal singular control where the system evolves according to mean-field FBSDE. As an illustration, using these results, mean-variance portfolio selection problem: time inconsistent solution is discussed in the last section.
2 Assumptions and problem formulation
We study in this paper stochastic singular optimal control problems of mean-field type of the following kind. Let \(T>0\) be a fixed time horizon and \((\Omega ,\mathcal {F},\mathbb {P})\) be a probability space equipped with a filtration \(\left( \mathcal {F}_{t}\right) _{t\in \left[ 0,T \right] }\) satisfying the usual conditions on which one-dimensional standard Brownian motion \(W(\cdot )=\left\{ W(t):t\in \left[ 0,T\right] \right\} \) is defined. We assume \(\mathcal {F}_{t}=\sigma \left\{ W(s):0\le s\le t\right\} \).
2.1 Notations
For convenience, we will use the following notation in this paper
-
1.
In the sequel, \(\mathbb {L}_{\mathcal {F}}^{2}\left( \left[ 0,T\right] ;\mathbb {R}\right) \) denotes the Hilbert space of \( \mathcal {F}_{t}-\)adapted processes \((\varkappa (t))_{t\in [0,T]}\) such that \(\mathbb {E} \left[ \int _{0}^{T}\left| \varkappa (t)\right| ^{2}dt\right] <+\infty \).
-
2.
For a differentiable function \(\Phi \) we denote by \(\Phi _{\varkappa }(t)\) its gradient with respect to the variable \(\varkappa \),
-
3.
We set
$$\begin{aligned} \delta f(t)&= f\left( t,x^{*}(t),\widetilde{x}^{*}(t),u(t)\right) -f(t,x^{*}(t),\widetilde{x}^{*}(t),u^{*}(t)).\\ \delta \sigma (t)&= \sigma \left( t,x^{*}(t),\widetilde{x}^{*}(t),u(t)\right) -\sigma (t,x^{*}(t),\widetilde{x}^{*}(t),u^{*}(t)).\\ \delta g(t)&= g\left( t,x^{*}(t),\widetilde{x}^{*}(t),y^{*}(t),\widetilde{y}^{*}(t),z^{*}(t),\widetilde{z}^{*}(t),u(t)\right) \\&-g(t,x^{*}(t),\widetilde{x}^{*}(t),y^{*}(t),\widetilde{y} ^{*}(t),z^{*}(t),\widetilde{z}^{*}(t),u^{*}(t)).\\ \delta \ell (t)&= \ell \left( t,x^{*}(t),\widetilde{x}^{*}(t),y^{*}(t),\widetilde{y}^{*}(t),z^{*}(t),\widetilde{z}^{*}(t),u(t)\right) \\&-\ell (t,x^{*}(t),\widetilde{x}^{*}(t),y^{*}(t), \widetilde{y}^{*}(t),z^{*}(t),\widetilde{z}^{*}(t),u^{*}(t)). \end{aligned}$$ -
4.
In what follows, \(C\) represents a generic constants, which can be different from line to line.
Since the objective of this technical note is to study optimal singular stochastic control, we give here the precise definition of the singular part of an admissible control.
Definition 2.1
An admissible control is a pair \( \left( u(\cdot ),\xi (\cdot )\right) \) of measurable \(\mathbb {A}_{1}\times \mathbb {A}_{2}-\)valued, \(\mathcal {F}_{t}-\) adapted processes, such that
-
(i)
\(\xi (\cdot )\) is of bounded variation, non-decreasing continuous on the left with right limits and \(\xi (0)=0.\)
-
(ii)
\(\mathbb {E}\left[ \sup _{t\in \left[ 0,T\right] }\left| u(t)\right| ^{2}+\left| \xi (T)\right| ^{2}\right] <\infty .\)
We denote \(\mathcal {U}_{1}\times \mathcal {U}_{2}\) the set of all admissible controls. We note that since \(d\xi (t)\) may be singular with respect to Lebesgue measure \(dt,\) we call \(\xi (\cdot )\) the singular part of the control and the process \(u(\cdot )\) its absolutely continuous part.
2.2 Assumptions
Throughout this paper, we also assume that the coefficients \(f,\sigma ,g,\ell ,h,\varphi ,\phi ,\mathcal {C}, \mathcal {D}\) and \(\mathcal {L}\) satisfy the following standing assumptions
Assumption (H1) The functions \(f,\sigma :\left[ 0,T\right] \times \mathbb {R}\times \mathbb {R}\times \mathbb {A}_{1}\rightarrow \mathbb {R}.\) \( g,\ell :\left[ 0,T\right] \times \mathbb {R}\times \mathbb {R}\times \mathbb {R} \times \mathbb {R}\times \mathbb {\mathbb {R}}\times \mathbb {\mathbb {R}}\times \mathbb {A}_{1}\rightarrow \mathbb {R},\) and \(h,\varphi ,\phi :\mathbb {R}\times \mathbb {R\rightarrow R},\) are continuous and continuously differentiable in their variables including \((x,\widetilde{x},y,\widetilde{y},z,\widetilde{z} ,u)\).
Assumption (H2) The derivatives of \(f,\sigma ,g\) and \(h\) with respect to their variables including \((x,\widetilde{x},y,\widetilde{y} ,z,\widetilde{z},u)\) are bounded. Further,
-
1.
The derivatives of \(\phi \) with respect to \(x\) and \( \widetilde{x}\) are bounded by \(C\left( 1+\left| x\right| +\left| \widetilde{x}\right| \right) .\)
-
2.
The derivatives of \(\varphi \) with respect to \(y, \widetilde{y}\) are bounded by \(C\left( 1+\left| y\right| +\left| \widetilde{y}\right| \right) .\)
-
3.
The derivatives of \(\ell \) are bounded by \( C(1+\left| x\right| +\left| \widetilde{x}\right| +\left| y\right| \) \(+\left| \widetilde{y}\right| +\left| z\right| +\left| \widetilde{z}\right| +\left| u\right| ).\)
Assumption (H3) The functions \(\mathcal {C}:\left[ 0,T \right] \rightarrow \mathbb {R},\) \(\mathcal {D}:\left[ 0,T\right] \rightarrow \mathbb {R}\) and \(\mathcal {L}:\left[ 0,T\right] \rightarrow \mathbb {R}^{+}\) are continuous and bounded.
Under the assumptions (H1)–(H3), FBSDE-(1) has an unique solution \(\left( x(t),y(t),z(t)\right) \in \) \( \mathbb {L}_{\mathcal {F}}^{2}(\left[ 0,T\right] ;\mathbb {\mathbb {R)}}\times \) \(\mathbb {L}_{\mathcal {F}}^{2} \left( \left[ 0,T\right] ;\mathbb {\mathbb {R}} \right) \) \(\times \mathbb {L}_{\mathcal {F}}^{2}\left( \left[ 0,T\right] ; \mathbb {\mathbb {R}}\right) \) such that
and for \(t\in \left[ 0,T\right] \)
See Hafayed [29], Buckdahn, Li and Peng [33] for the solutions of mean-field Backward SDEs. See also Wu and Zhang ([3] Proposition 2.1 and Proposition 2.2).
2.3 Adjoint equations of mean-field type
We introduce the new adjoint equations involved in the stochastic maximum principle for our singular mean-field control problem. So for any \(\left( u(\cdot ),\xi (\cdot )\right) \in \mathcal {U}_{1}\times \mathcal {U}_{2}\) and the corresponding state trajectory \(\left( x\left( \cdot \right) ,y\left( \cdot \right) ,z\left( \cdot \right) \right) =(x^{u,\xi }\left( \cdot \right) ,y^{u,\xi }\left( \cdot \right) ,z^{u,\xi }\left( \cdot \right) )\), we consider the following adjoint equations of mean-field type, which are independent to singular control:
Note that the first adjoint equation (backward) corresponding to the forward component turns out to be a linear mean-field backward SDE, and the second adjoint equation (forward) corresponding to the backward component turns out to be a linear mean-field forward SDE.
We define the Hamiltonian function
associated with the singular stochastic control problem (1)- (2) as follows
If we denote by
then the adjoint eq. (4) can be rewritten as the following stochastic Hamiltonian system’s type
It is a well known fact that under assumptions (H1) and (H2 ), the adjoint eqs. (4), (6) admits a unique solution \( \left( \Psi (t),Q(t),K(t)\right) \) such that
Moreover, since the derivatives of \(f,\sigma ,g,h,\varphi ,\phi \) with respect to \(\left( x,\widetilde{x},y,\widetilde{y},z,\widetilde{z}\right) \) are bounded, we deduce from standard arguments that there exists a constant \(C>0\) such that
3 Necessary conditions for optimal singular control of mean-field FBSDEs
In this section, we establish a set of necessary conditions of Pontraygin’s type for a stochastic singular control to be optimal where the system evolves according to nonlinear controlled mean-field FBSDEs. Convex perturbation techniques for singular and continuous parts are applied to prove our mean-field stochastic maximum principle.
The following theorem constitutes the main contribution of this paper.
Let \((x^{*}(\cdot ),y^{*}(\cdot ),z^{*}(\cdot ))\) be the trajectory of the mean-field FBSDE-(1) and \(\left( \Psi ^{*}(\cdot ),Q^{*}(\cdot ),K^{*}(\cdot )\right) \) be the solution of adjoint eq. (4) corresponding to the optimal singular control \(\left( u^{*}(\cdot ),\xi ^{*}(\cdot )\right) .\)
Theorem 3.1
(Maximum principle for optimal singular control of mean-field FBSDEs in integral form). Let Conditions (H1), (H2) and (H3) hold. If \(\left( u^{*}(\cdot ),\xi ^{*}(\cdot )\right) \) and \(\left( x^{*}(\cdot ),y^{*}(\cdot ),z^{*}(\cdot )\right) \) is an optimal solution of the mean-field singular control problem (1)–(2). Then the maximum principle holds, that is for all \(\left( u,\xi \right) \in \mathbb {A}_{1}\times \mathbb {A}_{2}\)
where \((\lambda ^{*}(t),\mathbb {E(}\lambda ^{*}(t)))=(x^{*}(t),\mathbb {E}(x^{*}(t)),y^{*}(t),\)
Corollary 3.1
Under Conditions of Theorem 3.1. Then there exists a unique \(\mathcal {F}_{t}\mathcal {-}\) adapted processes \((\Psi ^{*}(\cdot ),Q^{*}(\cdot ),\) \(K^{*}(\cdot ))\) solution of mean-field FBSDE-(6) such that for all \(\left( u,\xi \right) \in \mathbb {A}_{1}\times \mathbb {A}_{2}:\)
To prove Theorem 3.1 we need some preliminary results given in the following Lemmas. We derive the variational inequality (8) in several steps, from the fact that
where \((u^{\epsilon }(\cdot ),\xi ^{\epsilon }(\cdot ))\) is the so called convex perturbation of optimal control \((u^{*}(\cdot ),\xi ^{*}(\cdot ))\) defined as follows
where \(\epsilon \in \left[ 0,1\right] \) is sufficiently small, \( (u(\cdot ),\xi (\cdot ))\) is an arbitrary element of \(\mathcal {F}_{t}-\) measurable random variable with values in \(\mathbb {A}_{1}\times \mathbb {A} _{2}\) which we consider as fixed from now on.
We emphasize that the convexity of \(\mathbb {A}_{1}\times \mathbb {A} _{2}\) has the consequence that \((u^{\epsilon }(\cdot ),\xi ^{\epsilon }(\cdot ))\in \mathcal {U}_{1}\times \mathcal {U}_{2}\) where
Let \((\lambda ^{\epsilon }(t),\mathbb {E(}\lambda ^{\epsilon }(t)))=(x^{\epsilon }(t),\mathbb {E}(x^{\epsilon }(t)),y^{\epsilon }(t),\mathbb {E }(y^{\epsilon }(t)),\) \(z^{\epsilon }(t),\mathbb {E}(z^{\epsilon }(t)))\) be the solution of state eq. (1) and \(\Lambda ^{\epsilon }(t)=\left( \Psi ^{\epsilon }\left( t\right) ,Q^{\epsilon }\left( t\right) ,K^{\epsilon }\left( t\right) \right) \) be the solution of the adjoint eq. (4) corresponding to perturbed control \(\left( u^{\epsilon }(\cdot ),\xi ^{\epsilon }(\cdot )\right) .\)
3.1 Variational equations
Now, we introduce the following variational equations which have a mean-field type. For simplicity of notation, we will still use \(f_{x}(t)=\dfrac{\partial f}{\partial x}(t,x^{*}(t),\mathbb {E(}x^{*}(t)),u^{*}(t))\) etc,. Let \(\left( x_{1}^{\epsilon }(\cdot ),y_{1}^{\epsilon }(\cdot ),z_{1}^{\epsilon }(\cdot )\right) \) be the solution of the following mean-field FBSDEs:
3.2 Duality relations
Our first Lemma below deals with the duality relations between \(\Psi ^{*}(t),\) \( x_{1}^{\epsilon }(t)\) and \(K^{*}(t),\) \(y_{1}^{\epsilon }(t)\). This Lemma is very important for the proof of Theorem 3.1.
Lemma 3.1
For \(\forall (u(\cdot ),\xi (\cdot ))\in \mathcal {U}_{1}\times \mathcal {U}_{2}\) such that \((u^{*}(t), \xi ^{*}(t))+(u(t),\xi (t))\in \mathcal {U}_{1}\times \mathcal {U}_{2},\) \(u^{*}(t)+u(t)\in \mathcal {U}_{1}\) and \(\xi ^{*}(t)+\xi (t)\in \mathcal {U} _{2} \) we have
similarly,
and
Proof of duality relation (11). By applying integration by parts formula to \(\Psi ^{*}(t)x_{1}^{\epsilon }(t)\), and since \(x_{1}^{\epsilon }(0)=0\) we get
A simple computation shows that
and
By standard arguments we get
the duality relation (11) follows immediately from combining (15)–(17) and (14).
Proof of duality relation (12). By applying integration by parts formula to \(K^{*}(t)y_{1}^{\epsilon }(t)\) we get
From (11) we obtain
from (4) we obtain
and
Since
the duality relation (12) follows immediately from combining (19)–(21) and (18).
Proof of (13). Combining (11) and ( 12) we get
From (6) and (10) in which \(\Psi ^{*}(T)=\phi _{x}(T)\) \(+ \mathbb {E(}\phi _{\widetilde{x}}(T))\)
\(-\left\{ h_{x}\left( T\right) K^{*}(T)+\mathbb {E}\left[ \left( h_{\widetilde{x}}\left( T\right) \right) K^{*}(T)\right] \right\} \) and
\(y_{1}^{\epsilon }(T)=-\left[ h_{x}(T)+\mathbb {E}\left( h_{ \widetilde{x}}(T)\right) )\right] x_{1}^{\epsilon }(T)\) we get
Since
we get
This completes the proof of (13). \(\square \)
To this end we give the following estimations.
3.3 Some prior estimates
The second Lemma present the estimates of the perturbed state process \((x^{\epsilon }(\cdot ),y^{\epsilon }(\cdot ),\) \(z^{\epsilon }(\cdot )),\) \(x_{1}^{\epsilon }(t),\) \(y_{1}^{\epsilon }(t)\) and \(z_{1}^{\epsilon }(t).\)
Lemma 3.2
Under assumptions (H1), (H2) and (H3) the following estimations holds
and
Let us also point out that the above estimates can be proved by using similar arguments developed in Hafayed ([29] Lemma 3.3 (without jump term)), ([3] Lemma 3.1) or ([19] Lemma 2.2, Lemma l2.3) and ([17] Lemma 1, Lemma 2), so we omit its proofs.
Lemma 3.3
Let assumptions (H1), (H2), and (H3) hold. The following variational inequality holds
Proof
From (9) we have
by applying Lemma 3.2, we have
From estimate (25), we get
Similarly, we have
and
The desired result follows by combining (26)–(29). This complete the proof of Lemma 3.3.\(\square \)
3.4 Proof of Theorem 3.1.
The desired result follows immediately by combining (13) and Lemma 3.3. \(\square \)
4 Application: mean-variance portfolio selection with a recursive utility functional involving singular control; time inconsistent problem
The mean-variance portfolio selection theory, which was first introduced by Markowitz [41], is a millstone in mathematical finance and has laid down the foundation of modern finance theory. By using sufficient maximum principle, the authors in Framstad, \(\emptyset \)ksendal and Sulem [42] gave the expression for the optimal portfolio selection in a jump diffusion market with time consistent solutions. Optimal portfolio and consumption decision problems for a small investor in a market model have been investigated in Jeanblanc–Picqué and Pontier [43]. The continuous time mean-variance portfolio selection problem has been studied in Zhou and Li [44]. The mean-variance portfolio selection problem where the state governed by SDE has been studied by Anderson and Djehiche [37]. Optimal dividend, harvesting rate and optimal portfolio for systems governed by jump diffusion processes have been investigated by Meyer–Brandis, \(\emptyset \)ksendal and Zhou [38]. Mean-variance portfolio selection problem for mean-field SDEs with jumps has been studied in [39]. Mean-variance portfolio selection problem mixed with a recursive utility functional,where the state process driven by FBSDEs with jumps has been studied by Shi and Wu [25], under the condition that \(\mathbb {E}[x(T)]=a\) is a fixed given real positive number. The mean-variance portfolio selection problem mixed with a recursive utility functional ”time-consistent approach”, where the system governed by classical FBSDEs with singular control has been investigated by Wu and Zhang [3].
In this section, we will apply our mean-field stochastic maximum principle of optimal singular control for a system governed by mean-field FBSDEs to study mean-variance portfolio selection problem mixed with a recursive utility functional optimization in a financial market. Explicit expression of the optimal portfolio selection strategy is obtained in the state feedback form involving both state process \(x(\cdot )\) and its marginal distribution \(\mathbb {E(}x(\cdot ))\), via the solutions of Riccati ordinary differential equations.
Suppose that we are given a mathematical market consisting of two investment possibilities:
(i) Bond: the first asset is a risk-free security whose price \(P_{0}(t)\) evolves according to the ordinary differential equation
where \(\rho :[0,T]\rightarrow \mathbb {R}_{+}\) is a locally bounded continuous deterministic function.
(ii) Stock: a risky security where the price \(P_{1}\left( t\right) \) at time \(t\) is given by
where \(\varsigma :[0,T]\rightarrow \mathbb {R}\) and \(\sigma :[0,T]\rightarrow \mathbb {R}\) are bounded continuous deterministic functions such that \(\varsigma _{t},\sigma _{t}\ne 0\) and \(\varsigma _{t}-\rho _{t}>0,\ \forall t\in [0,T]\).
The wealth dynamics with singular control: Let \(x^{u,\xi }(0)=\zeta >0\) be an initial wealth and \(G\ge 0\). By combining (30) and (31) we introduce the wealth dynamics
Let \(\mathbb {A}_{1}\mathbb {\times A}_{2}\) be a compact convex subset of \(\mathbb {R\times R}\). We denote \(\mathcal {U}_{1}\times \mathcal {U} _{2}\) the set of admissible \(\mathcal {F}_{t}-\)predictable portfolio strategies \(\left( u\left( \cdot \right) ,\xi (\cdot )\right) \) valued in \( \mathbb {A}_{1}\mathbb {\times A}_{2}\).
Time inconsistent control problem: We consider the following expected utility functional involving singular control
which implies that
where \(y^{u,\xi }(\cdot )\) is a solution of the Backward SDEs
We assume that \(\alpha >0\) and \(\beta \ge 0.\) We note that this cost functional is nonlinear function of the expected value stands in contrast to the standard formulation of a control problem. This leads to a so called time inconsistent control problem in the sense that Bellman’s dynamic programming does not hold.
Now, since
then the Hamiltonian functional (5) gets the form
According to the maximum condition ((8), Theorem 3.1), and since \((u^{*}(\cdot ),\xi ^{*}(\cdot ))\) is optimal we immediately get
By using (35) where ”\(h_{x}\left( T\right) =1,\) \( h_{\widetilde{x}}(T)=0,\) \(\phi _{x}(T)=x^{u,\xi }(T)-1,\) \(\phi _{\widetilde{x }}(T)=-\mathbb {E}(x(T))),\) \(g_{y}\left( t\right) =\alpha ,\) \(g_{\widetilde{y} }\left( t\right) =g_{z}(t)=g_{\widetilde{z}}(t)=\ell _{z}(t)=\ell _{ \widetilde{z}}(t)=0,\) \(\varphi _{y}\left( y(0),\mathbb {E}\left( y(0)\right) \right) =-1,\) and \(\varphi _{\widetilde{y}}\left( y(0),\mathbb {E}\left( y(0)\right) \right) =0\)” the mean-field adjoint eq. ( 4) being
Now, in order to solve the above eq. (37) and to find the expression of optimal portfolio strategy \(u^{*}(\cdot )\) we conjecture a process \(\Psi ^{*}(t)\) of the form
where \(\Phi _{1}(\cdot ),\Phi _{2}(\cdot )\) and \(\Phi _{3}(\cdot )\) are deterministic differentiable functions. (See Hafayed and Abbas [7], Shi and Wu [25], Shi [40], Anderson and Djehiche [37], Framstad, \(\emptyset \)ksendal and Sulem [43], Ma and Yong [26] and Li [36], for other models of conjecture).
From last eq. in (37), which is a simple ordinary differential equation (ODE), we get immediately
From (32), we get
by a simple computations and since \(\xi (0)=0,\) we get
Applying Itô’s formula to (38) in virtue of SDE- (32) and (40), we get
which implies that
where \(\Phi _{1}^{\prime }(t),\) \(\Phi _{2}^{\prime }(t),\) and \(\Phi _{3}^{\prime }(t)\) denotes the derivatives with respect to \(t\).
Next, comparing (41) with (37), we get
Looking at the terminal condition of \(\Psi ^{*}(t)\), in (41) and (37), it is reasonable to get
A simple computations, (42) gives
Comparing (45) and (38), together with (39) we obtain
from (46) and (44) we deduce that \(\Phi _{1}(\cdot ),\Phi _{2}(\cdot )\) and \(\Phi _{3}(\cdot )\) satisfying the following Riccati ordinary differential equation
By solving the first two ODEs in (47) we obtain \(t\in \left[ 0,T\right] \)
Using the method of Integrating factors for the third linear ODE in ( 47), we get
where the integrating factor \(\mu (t)\) is given by
Combining (36), (43) and (39), we obtain
and by taking expectation we deduce
Let us turn to singular part. Applying to the maximum condition ((8 ), Theorem 3.1), and since \((u^{*}(\cdot ),\xi ^{*}(\cdot )) \) is optimal we get
where (\(\Psi ^{*}(t),K^{*}(t))\) is the adjoint processes corresponding to optimal control.
Now, we define a set
and let \(\xi (\cdot )\in \mathcal {U}_{2}\) such that
By a simple computations it is easy to see that
this implies that \(\xi ^{*}(\cdot )\) satisfies for any \(t\in \left[ 0,T\right] \)
Finally, from (51) and (52) we can easy shows that \(\xi ^{*}(t)\) has the form:
which is in \(\mathcal {U}_{2}\), where \(\overline{\mathbf {\Theta }}\) is the complement of the set \(\mathbf {\Theta }.\)
Theorem 4.1
The optimal portfolio \((u^{*}(t),\xi ^{*}(t))\) of our mean-variance portfolio selection problem (33)–( 34), when the wealth dynamics evolves according to FBSDE-(32) is given in feedback form by
and
where \(\mathbf {\Theta ,}\) \(\Phi _{1}(t)\) and \(\Phi _{3}(t)\) are given by ( 51), (48) and (49) respectively.
Concluding Remarks In this paper, we have proved a mean-field type maximum principle for optimal stochastic singular control for systems governed by mean-field forward-backward stochastic differential equations, where the coefficients depend not only on the state process but also its marginal distribution of the state process through it expected value. The cost functional is also of mean field type. Our mean-field maximum principle was applied to a mean-variance portfolio selection mixed with a recursive utility functional optimization problem involving singular control. The optimal portfolio selection strategy was obtained in the state feedback form involving both state process and its marginal distribution, via the solutions of Riccati ordinary differential equations with time-inconsistent solution.
References
Alvarez LHR (1999) A class of solvable singular stochastic control problems. Stoch Stoch Rep 67:83–122
Alvarez LHR (2001) Singular stochastic control linear diffusion and optimal stopping: a class of solvable problems. SIAM J Control Optim 39:1697–1710
Wu Z, Zhang F (2011) Stochastic maximum principle for optimal control problems of forward-backward systems involving impulse controls. IEEE Trans Autom Control 6(56):1401–1406
Haussmann UG, Suo W (1995) Singular optimal control I, II. SIAM J Control Optim 33(3):916–959
Hafayed M, Abbas S, Veverka P (2013) On necessary and sufficient conditions for near-optimal singular stochastic controls. Optim Lett 7(3):949–966
Hafayed M, Abbas S (2013) Stochastic near-optimal singular controls for jump diffusions: necessary and sufficient conditions. J Dyn Control Sys 19(4):503–517
Hafayed M, Abbas S (2013) On near-optimal mean-field stochastic singular controls: necessary and sufficient conditions for near-optimality. J Optim Theory Appl. doi:10.1007/s10957-013-0361-1
Hafayed M (2014) A mean-field necessary and sufficient conditions for optimal singular stochastic control. Commun Math Stat. doi:10.1007/s40304-014-0023-0
Cadenillas A, Haussmann U (1994) The stochastic maximum principle for singular control problem. Stoch Stoch Rep 49(3–4):211–217
Dufour F, Miller B (2006) Maximum principle for singular stochastic control problem. SIAM J Control Optim 2(45):668–698
Bahlali S, Chala A (2005) The stochastic maximum principle in optimal control of singular diffusions with non linear coefficients. Random Oper Stoch Equ 13:1–10
Wu Z, Zhang F (2012) Maximum principle for stochastic recursive optimal control problems involving impulse controls, abstract and applied analysis 2012:16. doi:10.1155/2012/70968
Bensoussan A, Lions JL (1984) Impulse control and quasi-variational inequalities. Gauthier-Villars, Paris
Cadenillas A, Zapatero F (2000) Classical and impulse stochastic control of the exchange rate using interest rates and reserves. Math Finance 2(10):141–156
Jeanblanc-Piqué M (1993) Impulse control method and exchange rate. Math Finance 3:161–177
Korn R (1999) Some applications of impulse control in mathematical finance. Math Methods Oper Res 3(50):493–518
Xu W (1995) Stochastic maximum principle for optimal control problem of forward and backward. J Austral Math Soc Ser B 37:172–185
Shi J, Wu Z (2006) The maximum principle for fully coupled forward-backward stochastic control system. Acta Automatica sinica 2(32):161–169
Shi J, Wu Z (2010) Maximum principle for partially-observed optimal control of fully-coupled forward-backward stochastic systems. J Optim Theory Appl Vol 3(145):543–578
Wang G, Wu Z (2009) The maximum principles for stochastic recursive optimal control problems under partial information. IEEE Trans Autom Control 6(54):1230–1242
Huia E, Huang J, Li X, Wang G (2011) Near-optimal control for stochastic recursive problems. Sys Control Lett 60:161–168
Wu Z (2013) A general maximum principle for optimal control of forward-backward stochastic systems. Automatica 49:1473– 1480
Yong J (2010) Optimality variational principle for controlled forward-backward stochastic differential equations with mixed intial-terminal conditions. SIAM J Control Optim 6(48):4119–4156
Huang J, Li X, Shi J (2012) Forward-backward linear quadratic stochastic optimal control problem with delay. Sys Control Lett 61(5):623–630
Shi J, Wu Z (2010) Maximum principle for Forward-backward stochastic control system with random jumps and application to finance. J Sys Sci Complex 23:219–231
Ma J, Yong J (1999) Forward-backward stochastic differential equations and their applications., Lecture notes in mathematicsSpringer, Berlin
Øksendal B, Sulem A (2005) Applied stochastic control of jump diffusions. Springer, Berlin
Fleming W, Soner M (1993) Controlled markov processes and viscosity solutions. Springer, New York
Hafayed M (2013) A mean-field maximum principle for optimal control of forward-backward stochastic differential equations with poisson jump processes. Int J Dyn Control 4(1):300–315
Hafayed M, Abbas S (2013) A general maximum principle for stochastic differential equations of mean-field type with jump processes. arXiv:1301.7327v4.
Hafayed M, Abba A, Abbas S (2013) On mean-field stochastic maximum principle for near-optimal controls for Poisson jump diffusion with applications. Int J Dyn Control. doi:10.1007/s40435-013-0040-y
Buckdahn R, Li J, Peng S (2009) Mean-field backward stochastic differential equations and related partial differential equations. Stoch Process Appl 119:3133–3154
Buckdahn R, Djehiche B, Li J (2011) A general stochastic maximum principle for sdes of mean-field type. Appl Math Optim 64:197–216
Kac M (1956) Foundations of kinetic theory. In: Proceedings of the 3rd Berkeley symposium on Math Stat Prob, vol 31, pp 171–197
Lazry JM, Lions PL (2007) Mean field games. Japan J Math 2:229–260
Li J (2012) Stochastic maximum principle in the mean-field controls. Automatica 48:366–373
Andersson D, Djehiche B (2011) A maximum principle for SDEs of mean-field type. Appl Math Optim 63:341–356
Meyer-Brandis T, Øksendal B, Zhou XY (2012) A mean-field stochastic maximum principle via Malliavin calculus. Stochastics 84:643–666
Shen Y, Siu TK (2013) The maximum principle for a jump-diffusion mean-field model and its application to the mean-variance problem. Nonlinear Anal 86:58–73
Shi J (2012) Sufficient conditions of optimality for mean-field stochastic control problems. In: Proceedings of the 12th international conference on control, automation, robotics & vision Guangzhou, China, 5–7th December 2012, pp 747–752
Markowitz H (1952) Portfolio selection. J Finance 7:77–91
Framstad NC, Øksendal B, Sulem A (2004) Sufficient stochastic maximum principle for the optimal control of jump diffusions and applications to finance. J Optim Theory Appl 121:77–98
Jeanblanc-Picqué M, Pontier M (1990) Optimal portfolio for small investor in a market model with discontinuous prices. Appl Math Optim 22:287–310
Zhou XY, Li D (2000) Continuous time mean-variance portfolio selection: a stochastic LQ framework. Appl Math Optim 42:19–33
Acknowledgments
The author would like to thank the editor, the associate editors and anonymous referees for their constructive corrections and valuable suggestions that improved the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hafayed, M. Singular mean-field optimal control for forward-backward stochastic systems and applications to finance. Int. J. Dynam. Control 2, 542–554 (2014). https://doi.org/10.1007/s40435-014-0080-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40435-014-0080-y