Abstract
In this paper, we use risk-sensitive control methods to solve a jump-diffusion asset–liability management (ALM) problem. We show that the ALM problem admits a unique classical (\(C^{1,2}\)) solution under two different sets of assumptions.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Effective asset and liability management (ALM) models are crucial not only for funded investors such as endowment funds and pension funds, but also for investors who have the ability to grow their asset base by borrowing such as banks and hedge funds. In this paper, we solve an ALM problem in a jump-diffusion setting under two sets of assumptions. Under both sets of assumptions, the asset prices and liability value depend on a random factor process \(X_t\), the components of which can be interpreted either as macroeconomic factors or simply as a statistical representation of the uncertainty of asset returns. Under the first set of assumptions, the growth rate of assets and liabilities is an affine function of the factors, while the diffusions are constant. The factors are modelled as Gaussian diffusion processes. Under the second set of assumptions, both the growth rate and diffusion depend on the factors, making it possible to incorporate stochastic volatility. The factors are modelled as jump-diffusion processes. We also consider investment constraints in our model.
We formulate the ALM problem as a risk-sensitive control problem: the investor’s objective is to jointly select an optimal amount of leverage \(\rho (t)\) and an optimal asset allocation \(h(t)\) to maximize the criterion
where \(R_T(h,\rho )\) is a reward function at a fixed final time \(T\) corresponding to a pair of control processes \((h,\rho )\), and the exogenous parameter \(\theta >0\) represents the decision maker’s degree of risk aversion. In optimal investment problems (as in Bielecki and Pliska 1999 or Kuroda and Nagai 2002), it is customary to take \(R_T=\ln V_T\), where \(V_T\) is the value of the investment portfolio corresponding to an asset allocation strategy \(h\). For the ALM problem discussed here, we use \(R_T = \ln E_T = \ln (V_T - L_T)\) to measure the investor’s return on equity or on surplus.
The solution technique presented in this paper extends the approaches proposed by Davis and Lleo (2011, 2013a) in an investment management context and by Davis and Lleo (2013b) for benchmarked investment management. The first step is to use a change-of-measure, an idea introduced by Kuroda and Nagai (2002) that reduces the risk-sensitive optimization problem to a stochastic control problem in the factor process. Under the first set of assumptions, affine asset growth rates with constant volatility, the factor process \(X_t\) has no jumps and the associated Bellman equation is a partial differential equation (PDE) which can be shown to admit a unique classical \((C^{1,2})\) solution.
Under the second set of assumptions, we have a fully nonlinear controlled jump-diffusion, and the Bellman equation is a partial integro-differential (PIDE) for which no analytical solution exists. In such situation, viscosity solutions are generally used to show that the value function is the unique continuous solution of the Hamilton Jacobi Bellman (HJB) PIDE; see in particular Crandall et al. (1992), Barles and Imbert (2008) for an overview of viscosity solutions and Fleming and Soner (2006), Øksendal and Sulem (2005) or Touzi (2002) for a discussion of their application to stochastic control, as well as Davis and Lleo (2010) for a viscosity approach to risk-sensitive asset management. In the context of optimal control, a limitation of viscosity solutions is that they are weak solutions. Proving that the HJB PIDE admits a unique strong \((C^{1,2})\) solution requires the development of a more sophisticated argument combining viscosity solutions and classical solutions. The key references are due to Pham (1998), Davis et al. (2009) and Davis and Lleo (2013a).
Our model is in three main respects a generalisation of the works by Rudolf and Ziemba (2004) and Benk (2012). First, the jump-diffusion setting we propose in this paper permits the implementation of a wide range of jump specifications as well as factor-dependent stochastic drift and volatility. Second, we take the degree of leverage into account explicitly by modelling it as a control variable. Third, we consider investment constraints.
The paper is organised as follows. We introduce the analytical setting in Sect. 2 before formulating the control problem in Sect. 3. The main result, Theorem 4.4, which addresses the questions of the existence of classical solution to the HJB P(I)DE under both sets of assumptions, is stated in Sect. 4 and proved in the next two sections: in Sect. 5 under affine assumptions and in Sect. 6 under standard control assumptions.
2 Analytical setting
In our model, the investor selects an asset allocation and a degree of leverage with the objective of maximising a given measure of their equity, that is, the difference between the value of the investor’s asset and the value of the liability. The three key components of the model are an asset market comprising \(m\) risky securities \(S_i, \; i=1,\ldots m\) and a money market account process \(S_0\), an exogenous liability \(L\) and \(n\) factors \(X_1(t), \ldots , X_n(t)\).
Let \((\Omega , \mathcal {F},\mathbb {P})\) be the underlying probability space and define an \(\mathbb {R}^M\)-valued \(\left( \mathcal {F}_t\right) \)-Brownian motion \(W(t)\) with components \(W_k(t)\), \(k=1,\ldots ,M\), and \(M:=m+n+1\). Moreover, let \(N\) be a \(\left( \mathcal {F}_t\right) \)-Poisson point process on \((0,\infty )\times \mathbf {Z}\), independent of \(W(t)\), where \((\mathbf {Z},\mathcal {B}_{\mathbf {Z}})\) is a given Borel space. Define
We fix throughout the paper a set \(\mathbf {Z}_0 \in \mathcal {B}_{\mathbf {Z}}\) such that \(\nu (\mathbf {Z} \backslash \mathbf {Z}_0)<\infty \) and define, as in Øksendal and Sulem (2005)
where \(\nu \) is the Levy measure.
For \(t\in [0,T]\), let \(\mathcal {F}_{t}\) be the \(\sigma \)-field generated by the Brownian motions \(W_k(s)\) and Poisson processes \(N(s,A)\) for \(k=1,\ldots , M\), \(A\in \mathcal {B}_{\mathbf {Z}}\) and \(0\le s\le t\), completed with all null sets of \(\mathcal {F}_T\). It is well known that the filtration \(\{\mathcal {F}_{t}\}_{t\in [0,T]}\) satisfies the ‘usual conditions’.
2.1 Asset market dynamics
Let \(S_0\) denote the wealth invested in the money market account with dynamics given by the equation:
Denote by \(S_{i}(t)\) the price at time \(t\) of the \(i\)th risky security, with \(i = 1, \ldots , m\). The dynamics of \(S(t)\) is:
Throughout this paper, we consider two different sets of standing assumptions: (1) affine drift and constant diffusion with no jumps in the factor, and (2) standard stochastic control assumptions of bounded, Lipschitz continuous drift and diffusion, with jumps in both assets and factors. These assumptions are standard (see for example Davis and Lleo 2011, 2013a).
Assumption 2.1
(Affine drift and constant diffusion)
-
(i)
\(a_0(t,x) = a_0+A_0x\) where \(a_0 \in \mathbb {R}\), \(A_0 \in \mathbb {R}^{n}\)
-
(ii)
\(a(t,x) = a+Ax\) where \(a \in \mathbb {R}^m\), \(A \in \mathbb {R}^{m\times n}\)
-
(iii)
\(\Sigma (t,x)=\Sigma \) with \(\Sigma \in \mathbb {R}^{m\times M}\)
-
(iv)
\(\Sigma \Sigma ' >0\)
-
(v)
\(\gamma (t,z) = \gamma (z) \in \mathbb {R}^m\) satisfies:
$$\begin{aligned} \int \limits _{\mathbf {Z}_0} |\gamma (z)|^2 \nu (dz) < \infty \end{aligned}$$(2.5)
Assumption 2.2
(Standard control assumptions)
-
(i)
the function \(a_0\) defined as \(a_0: [0,T]\times \mathbb {R}^n\rightarrow \mathbb {R}\) is bounded, of class \(C^{1,1}\left( [0,T]\times \mathbb {R}^n\right) \) and is Lipschitz continuous
$$\begin{aligned} |a_0(t,y)-a_0(s,x)| \le K_0\left( |t-s|+|y-x|\right) \end{aligned}$$(2.6)for some constant \(K_0>0\).
-
(ii)
the function \(a: [0,T]\times \mathbb {R}^n \rightarrow \mathbb {R}^m\) is bounded, of class \(C^{1,1}\left( [0,T]\times \mathbb {R}^n\right) \) and Lipschitz continuous:
$$\begin{aligned} |a(t,y)-a(s,x)| \le K_a\left( |t-s|+|y-x|\right) \end{aligned}$$(2.7)for some constant \(K_a>0\).
-
(iii)
The function \(\Sigma : [0,T]\times \mathbb {R}^n\rightarrow \mathbb {R}^{m \times M}\) is bounded, of class \(C^{1,1}\left( [0,T]\times \mathbb {R}^n\right) \) and Lipschitz continuous, i.e.
$$\begin{aligned} |\Sigma (t,y)-\Sigma (s,x)| \le K_{\Sigma }\left( |t-s|+|y-x|\right) \end{aligned}$$(2.8)for some constant \(K_{\Sigma }>0\).
-
(iv)
There exists \(\psi _{\Sigma } > 0\) such that
$$\begin{aligned} \zeta '\Sigma \Sigma '(t,x)\zeta \ge \psi _{\Sigma } |\zeta |^2 \end{aligned}$$(2.9)for all \(\zeta \in \mathbb {R}^m\)
-
(v)
The function \(\gamma : [0,T]\times \mathbf {Z}\rightarrow \mathbb {R}^m\) is bounded, continuous and satisfies the growth condition
$$\begin{aligned} |\gamma (t,z)-\gamma (s,z)| \le K_{\gamma }\left( |t-s|\right) \end{aligned}$$(2.10)for some constant \(K_{\gamma }>0\).
-
(vi)
The vector valued function \(\gamma (t,z)\) satisfies:
$$\begin{aligned} \int \limits _{\mathbf {Z}_0} |\gamma (t,z) |^2 \nu (\mathrm{d}z) < \infty , \qquad \forall (t,x) \in [0,T]\times \mathbb {R}^n \end{aligned}$$(2.11) -
(vii)
\(|\Lambda \Sigma '(t,y)-\Lambda \Sigma '(s,x)| \le K_{\Lambda \Sigma }\left( |t-s|+|y-x|\right) \) for some constant \(K_{\Lambda \Sigma }>0\)
2.2 Liability modelling
We model the dynamics of the liability \(L(t)\) using the same type of geometric jump-diffusion process as for the asset prices. Specifically,
where \(c\) is a scalar, \(\varsigma \) is a \(n\)-element column vector, and \(\eta \) is a \(N\)-element column vector. The standing assumptions for the affine model and for the standard stochastic control model are presented below.
Assumption 2.3
(Affine drift and constant diffusion)
-
(i)
\(c(t,x) = c+Cx\) where \(c \in \mathbb {R}\), \(C \in \mathbb {R}^{n}\)
-
(ii)
\(\varsigma (t,x)=\varsigma \) with \(\varsigma \in \mathbb {R}^{M}\)
-
(iii)
\(\eta (t,z) = \eta (z) \in \mathbb {R}\) satisfies:
$$\begin{aligned} \int \limits _{\mathbf {Z}_0} |\eta (z)|^2 \nu (dz) < \infty \end{aligned}$$(2.12)
Assumption 2.4
(Standard control assumptions)
-
(i)
The function \(c: [0,T]\times \mathbb {R}^n \rightarrow \mathbb {R}^m\) is bounded, of class \(C^{1,1}\left( [0,T]\times \mathbb {R}^n\right) \) and Lipschitz continuous:
$$\begin{aligned} |c(t,y)-c(s,x)| \le K_c\left( |t-s|+|y-x|\right) \end{aligned}$$(2.13)for some constant \(K_c>0\).
-
(ii)
The function \(\varsigma : [0,T]\times \mathbb {R}\rightarrow \mathbb {R}^{M}\) is bounded, of class \(C^{1,1}\left( [0,T]\times \mathbb {R}^n\right) \) and Lipschitz continuous, i.e.
$$\begin{aligned} |\varsigma (t,y)-\varsigma (s,x)| \le K_{\varsigma }\left( |t-s|+|y-x|\right) \end{aligned}$$(2.14)for some constant \(K_{\varsigma }>0\).
-
(iii)
\(\varsigma (t,x)>0 \forall (t,x) \in [0,T] \times \mathbb {R}^n\)
-
(iv)
The function \(\eta : [0,T]\times \mathbf {Z}\rightarrow \mathbb {R}\) is bounded, continuous and satisfies the growth condition
$$\begin{aligned} |\eta (t,z)-\eta (s,z)| \le K_{\eta }\left( |t-s|\right) \end{aligned}$$(2.15)for some constant \(K_{\eta }>0\).
-
(v)
The vector valued function \(\eta (t,z)\) satisfies:
$$\begin{aligned} \int \limits _{\mathbf {Z}_0} |\eta (t,z) |^2 \nu (\mathrm{d}z) < \infty , \qquad \forall (t,x) \in [0,T]\times \mathbb {R}^n \end{aligned}$$(2.16) -
(vi)
\(|\Lambda \varsigma '(t,y)-\Lambda \varsigma '(s,x)| \le K_{\Lambda \varsigma }\left( |t-s|+|y-x|\right) \) for some constant \(K_{\Lambda \varsigma }>0\)
Assumption 2.5
\( \gamma (t,z)\xi '(t,x,z) = \eta (t,z) \xi '(t,x,z) = 0\quad \forall (t,x,z) \in [0,T]\times \mathbb {R}^n\times \mathfrak {S}.\)
This implies that there are no simultaneous jumps in the factor process and the asset price processor in the factor process and the liability process. This imposes some restriction, but appears essential to identify an optimal control.
2.3 Factor dynamics
The factor process \(X(t)\in \mathbb {R}^{n}\) is allowed to have a full jump-diffusion dynamics, satisfying the stochastic differential equation:
Assumption 2.6
(Affine drift and constant diffusion)
-
(i)
\(b(t,x) = b+Bx\) where \(b \in \mathbb {R}^n\), \(B \in \mathbb {R}^{n\times n}\)
-
(ii)
\(\Lambda \in \mathbb {R}^{n\times n}\),
-
(iii)
\(\Lambda \Lambda ' >0\)
-
(iv)
\(\xi (t,x,z) = 0\)
Assumption 2.7
(Standard control assumptions)
-
(i)
The function \(b: [0,T]\times \mathbb {R}^n\rightarrow \mathbb {R}^n\) is bounded, of class \(C^{1,1}\left( [0,T]\times \mathbb {R}^n\right) \) and Lipschitz continuous
$$\begin{aligned} |b(t,y)-b(s,x)| \le K_b\left( |t-s|+|y-x|\right) \end{aligned}$$(2.18)for some constant \(K_b>0\).
-
(ii)
The function \(\Lambda : [0,T]\times \mathbb {R}^n\rightarrow \mathbb {R}^{n \times M}\) is bounded, of class \(C^{1,1}\left( [0,T]\times \mathbb {R}^n\right) \) and Lipschitz continuous,
$$\begin{aligned} |\Lambda (t,y)-\Lambda (s,x)| \le K_{\Lambda }\left( |t-s|+|y-x|\right) \end{aligned}$$(2.19)for some constant \(K_{\Lambda }>0\).
-
(iii)
There exists \(\eta _{\Lambda } > 0\) such that
$$\begin{aligned} \zeta '\Lambda \Lambda '(t,x)\zeta \ge \eta _{\Lambda } |\zeta |^2 \end{aligned}$$(2.20)for all \(\zeta \in \mathbb {R}^n\)
-
(iv)
The function \(\xi : [0,T]\times \mathbb {R}^n\times \mathbf {Z}\rightarrow \mathbb {R}\) is bounded and Lipschitz continuous:
$$\begin{aligned} |\xi (t,y,z)-\xi (s,x,z)| \le K_{\xi }\left( |t-s|+|y-x|\right) \end{aligned}$$(2.21)for some constant \(K_{\xi }>0\).
-
(v)
The vector valued function \(\xi (t,x,z)\) satisfies:
$$\begin{aligned} \int \limits _{\mathbf {Z}} |\xi (t,x,z) |\nu (\mathrm{d}z) < \infty , \qquad \forall (t,x) \in [0,T]\times \mathbb {R}^n \end{aligned}$$(2.22)and for some constant \(c\)
$$\begin{aligned} \int \limits _\mathbf {Z}|\xi (t,x,z)|^2\nu (\mathrm{d}z)<c(1+|x|)^2. \end{aligned}$$(2.23)
The minimal condition on \(\xi \) under which the factor equation (2.17) is well posed is
see Definition II.4.1 in Ikeda and Watanabe (1981). As discussed by Davis et al. (2009) and Davis and Lleo (2013a, b), we need the stronger condition (2.22) to connect the viscosity solution of the HJB PIDE to the viscosity solution of a related parabolic PDE.
3 Formulation of the asset and liability management problem
3.1 Asset portfolio dynamics
Let \(\mathcal {G}_t := \sigma ((S(s), X(s)), L(s), 0 \le s \le t)\) be the sigma field generated by the security, factor and liability processes up to time \(t\). The investment strategy \(h(t) \in \mathbb {R}^{m}\) is represented by a vector containing the percentage of assets allocation to each of the \(m\) risks securities. The exact definition of the investment strategy \(h(t)\) is closely related to the following assumptions on the functions \(\gamma \) and \(\eta \) used to parametrize the jumps in asset price and liability value.
Assumption 3.1
Define
where \(\mathrm {supp}(\cdot )\) denotes the support of the measure, and let \(\prod _{i=1}^{m} [\gamma _{i}^\mathrm{min}, \gamma _{i}^\mathrm{max}]\) be the smallest closed hypercube containing \(\tilde{\mathfrak {S}}\). We assume that \(\gamma (t,z) \in \mathbb {R}^m\) satisfies
We also assume that \(\eta (t,z) \in \mathbb {R}\) satisfies
Furthermore, define the set \(\mathcal {J}_0\) as
For a given \(z\in \mathfrak {S}\), the equation \(h'\gamma (t,z)= -1\) describes a hyperplane in \(\mathbb {R}^m\). Under Assumption 3.1, \(\mathcal {J}_0\) is a convex subset of \(\mathbb {R}^m\) for all \((t,x) \in [0,T] \times \mathbb {R}^n\).
The investment strategy \(h(t)\) is defined as follows:
Definition 3.2
(Class \(\mathcal {H}_0\)) An \(\mathbb {R}^m\)-valued control process \(h(t)\) is in class \(\mathcal {H}_0\) if the following conditions are satisfied:
-
(i)
\(h(t)\) is progressively measurable with respect to \(\left\{ \mathcal {B}([0,t]) \otimes \mathcal {G}_t\right\} _{t \ge 0}\) and is càdlàg;
-
(ii)
\(h(t)\in \mathcal{J}_0 \quad \forall t \mathrm a.s. \)
Under Assumption 3.1, a control process \(h(t)\) satisfying (ii) is bounded.
By the budget equation, the proportion invested in the money market account equals \(h_0(t)=1-\sum _{i=1}^{m} h_i(t)\). Thus, the wealth \(V(t)\) of the investor in response to an investment strategy \(h(t) \in \mathcal {H}_0\) follows the dynamics
where \(V(0) = v_0\) is the initial endowment and \(\tilde{a} := a - a_0\mathbf {1}\), \(\mathbf {1} \in \mathbf {R}^m\) denotes the \(m\)-element unit column vector.
3.2 Equity dynamics and leverage ratio
Next, we define the equity at time \(t\), \(E(t)\), defined as the difference between the investor’s asset and liabilities and representing the wealth belonging directly to the investor. In the ALM literature, the equity is also referred to as surplus.
In the rest of the paper, we assume that \(e_0 =1\) WLOG. The dynamics of the equity is given in differential form by
The time \(t\) degree of leverage, or leverage ratio, \(\rho (t)\), is defined as the ratio of asset value to equity value, i.e.
As a result, \(V(t) = \rho (t) E(t)\) and \(L(t) = (\rho (t)-1) E(t)\) and we can simplify the SDE for the equity \(E(t)\) as:
where
In this model, the leverage ratio is a control variable: the investor’s objective is to choose both an optimal level of leverage and an optimal investment strategy. The leverage ratio \(\rho (t)\) is defined as:
Definition 3.3
A leverage process \(\rho (t)\) is in class \(\mathcal {R}_{0}\) if the following conditions are satisfied:
-
1.
\(\rho (t) \in \mathbb {R}\);
-
2.
\(\rho (t)\) is progressively measurable with respect to \(\left\{ \mathcal {B}([0,t]) \otimes \mathcal {G}_t\right\} _{t \ge 0}\);
-
3.
\(P\left( \int _{0}^{T} \left| \rho (s) \right| ^2 ds < +\infty \right) =1\);
3.3 Constraints on investment and leverage
To limit risk taking, the Asset and Liability Committee usually sets investment constraints defining the minimum and maximum proportion of assets and limits the amount of leverage. To model the investment constraints, we consider \(r \in \mathbb {N}\) fixed constraints expressed in the form
where \(\Upsilon \in \mathbb {R}^m \times \mathbb {R}^r\) is a matrix and \(\upsilon \in \mathbb {R}^r\) is a column vector. For the constrained control problem to be sensible, we need \(\Upsilon \) and \(\upsilon \) to satisfy the following condition:
Assumption 3.4
The system
for the variable \(y \in \mathbb {R}^m\) admits at least two solutions.
We define the feasible region \(\mathcal {J}\) as
The feasible region \(\mathcal {J}\) is a convex subset of \(\mathbb {R}^m\) and as a result of Assumption 3.4, \(\mathcal {J}\) has at least one interior point. The leverage limits are modelled through the following constraint:
where \(\rho _{-}, \rho ^{+}\) are two real constants.
3.4 The ALM stochastic control problem
The investor’s objective is to maximise the risk-sensitive criterion \(J(h,\rho ;\theta )\)
where \(\ln E_T(h)\) can be interpreted as the log return on equity. From (3.2) and the general Itô formula, we find that the term \(e^{-\theta \ln E(T)}\) can be expressed as
where
and the Doléans exponential \(\chi ^{\pi }(T)\) is defined for \(t\in [0,T]\) by
with
The maximisation of the risk-sensitive criterion \(J(h,\rho ;\theta )\) is performed over the class of admissible control \(\mathcal {A}\), which is defined as follows:
Definition 3.5
(Admissible controls) A control process \(\pi (t)=(h(t),\rho (t))\) is in class \(\mathcal {A}\) if the following conditions are satisfied:
-
(i)
\(h\in \mathcal {H}\), where
$$\begin{aligned} \mathcal {H} := \left\{ h(t) \in \mathcal {H}_0: h(t)\in \mathcal{J}\,\,\forall t\in [0,T],\mathrm { a.s.} \right\} \end{aligned}$$(3.12) -
(ii)
\(\rho \in \mathcal {R}\), where
$$\begin{aligned} \mathcal {R} := \left\{ \rho (t) \in \mathcal {R}_{0}: \rho _{-} \le \rho (t) \le \rho ^{+} \,\, \forall t\in [0,T] \right\} \end{aligned}$$(3.13) -
(iii)
\(\mathbf {E} \chi ^{\pi }(T)= 1\) where \(\chi ^{\pi }(t)\) is the Doléans exponential defined in (3.10)
Remark 3.6
For a given, fixed \(h\), the functional \(g\) is bounded and Lipschitz continuous in the state variable \(x\). This follows easily by boundedness and Lipschitz continuity of the coefficients \(a_0\), \(a\), \(\Sigma \) and \(\gamma \).
For \(h\in \mathcal{A}\), \(\rho \in \mathcal {R}\) and \(\theta >0\), let \(\mathbb {P}^{\pi }\) be the measure on \((\Omega ,\mathcal {F}_T)\) defined via the Radon–Nikodým derivative
and let \(\mathbf {E}^{\pi }\) denote the corresponding expectation. Then from (3.8), we see that the criterion \(J\) is given by
Moreover, under \(\mathbb {P}^{\pi }\),
is a standard Brownian motion and the \(\mathbb {P}^{\pi }\)-compensated Poisson random measure is given by
Under \(\mathbb {P}^{\pi }\) the factor process \(X(s), \; 0 \le s \le t\) satisfies the SDE:
where
and \(b\) is the \(\mathbb {P}\)-measure drift of the factor process (see (2.17)).
Remark 3.7
The drift function \(f\) is Lipschitz continuous with coefficient \(K_f = K_b + \theta (K_{\Lambda \Sigma }+K_{\Lambda \varsigma })+K_{\xi }K_0\) where \(K_0>0\) is a constant.
The generator of the state process \(X(t)\) for a constant control \(h\) is
So far, we have shown that the risk-sensitive asset allocation problem is equivalent to the stochastic control problem of minimizing the cost criterion
over the control set \(\mathcal{A}\) for a controlled process \(X_t\) satisfying (in ‘weak solution’ form) the jump-diffusion SDE (3.16). The next three sections of the paper, Sects. 4, 5 and 6, are devoted to solving this stochastic control problem.
4 Dynamic programming and the value function
We solve the control problem by studying the Hamilton–Jacobi–Bellman (HJB) dynamic programming equation, which involves embedding the original problem in a family of problems indexed by time-space points \((s,x)\), the starting time and position of the controlled process \(X_t\). The following description is in the same spirit as Bouchard and Touzi (2011).
For fixed \(s\in [0,T]\), we define the filtration \(\{\mathcal{F}^s_t, t\in [s,T]\}\) by
and note that \(\mathcal{F}^s_t\) is independent of \(\mathcal{F}_t\). \(X(t)\) denotes the solution of (2.17) on \([s,t]\) with initial condition \(X(s)=x\) and \(\mathbb {P}_{s,x}\) the measure on \(\mathcal{F}^s_T\) such that \(\mathbb {P}_{s,x}[X_s=x]=1\). The class of admissible controls \(\mathcal{A}^s\) is defined analogously to \(\mathcal{A}\) above with \(h\) adapted to \(\mathcal{F}^s_t\), leading to a change of measure on \(\mathcal{F}^s_T\) defined by the Radon–Nikodým derivative
The next step is to introduce two auxiliary criterion functions under the measure \(\mathbb {P}^{\pi }_{s,x}\):
The value functions associated with these auxiliary criterion are
By Remark 2, page 958 of Bouchard and Touzi (2011), \(\tilde{\Phi }(s,x)=\inf _{(\rho ,h)\in \mathcal{A}} \tilde{I}(s,x,h)\). That is, the infimum is unchanged if the class \(\mathcal{A}^s\) is replaced by the larger class \(\mathcal{A}\).
We will show that the value function \(\Phi \) defined in (4.3) satisfies the HJB PIDE
subject to terminal condition \(\Phi (T, x) = 0\). Condition (2.22) ensures that \(\mathcal {I}_{NL}\) is well defined, at least for bounded \(u\). The HJB PIDE for \(\tilde{\Phi }\) is
subject to terminal condition \(\tilde{\Phi }(T, x) = 1\) where for \(r \in \mathbb {R}\), \(p \in \mathbb {R}^n\)
Remark 4.1
The function \(H\) satisfies a Lipschitz condition as well as the linear growth condition
The value functions \(\Phi \) and \(\tilde{\Phi }\) are related through the strictly monotone continuous transformation \(\tilde{\Phi }(t,x) = \exp \left\{ -\theta \Phi (t,x) \right\} \). Thus, an admissible (optimal) strategy for the exponentially transformed problem is also admissible (optimal) for the risk-sensitive problem. As a result, it is enough to solve the exponentially transformed control problem for the HJB PIDE related to the value function \(\tilde{\Phi }\). The equivalent results for the risk-sensitive control problem for HJB PIDE related to the value function \(\Phi \) follow directly.
The value function has the following properties:
Proposition 4.2
The exponentially transformed value function \(\tilde{\Phi }\) is positive and bounded, i.e. there exists \(M>0\) such that
Moreover, the value function \(\tilde{\Phi }\) is Lipschitz continuous in the state variable \(x\).
Proof
The proof follows closely Propositions 3.4 and 3.5 in Davis and Lleo (2013a). \(\square \)
Proposition 4.3
Under either Assumption 2.1 (v) or both Assumption 2.2 (v) and Assumption 2.5, the supremum in (4.4), (4.5) admits a unique Borel measurable maximizer \(\tilde{h}(t,x,p)\) for \((t,x,p) \in [0,T]\times \mathbb {R}^n\times \mathbb {R}^n\).
Proof
We present the proof under Assumption 2.2 (v) and Assumption 2.5. The proof under Assumption 2.1 (v) follows as a special case.
The supremum in (4.4) can be expressed as
where
for \(h \in \mathbb {R}^m\), \(x \in \mathbb {R}^n\), \(p \in \mathbb {R}^n\) and \(\theta \in (0,\infty )\). Under Assumption (2.9) and 2.5, for any \(p \in \mathbb {R}^n\) \(\ell \) is strictly convex in \(h\) and \(\rho \) \(\forall (t,x,z) \in [0,T]\times \mathbb {R}^n\times \mathbf {Z}\) a.s. \(\mathrm{d}\nu \).
As a function of the variables \(h\) and \(\rho \), \(\ell (h,\rho ;x,p)\) can be defined more precisely as a map from the vector space \(\mathbb {R}^{m+1}\) into \(\mathbb {R}\). Moreover, \(\ell \) is continuous in \(h\) and \(\rho \) \(\forall (h,\rho ) \in \mathbb {R}^{m+1}\), twice differentiable and with continuous derivatives in both variables. Holding \(h\) (\(\rho \)) constant, \(\ell \) attains a finite infimum in \(\rho \) (\(h\)). Looking at the constraints, the matrix \(\Upsilon \) defines a map from the vector space \(\mathbb {R}^m\) into the normed space generated by associating to the constraint vector space \(\mathcal {U}\) the Euclidian norm. Under Assumption 3.4, there exists an \(h_1\) such that \(\Upsilon ' h_1 < \upsilon \). Similarly, \(\rho _{-} \le \rho \le \rho ^{+}\). As a result, the auxiliary constrained optimization problem
is a convex programming problem satisfying the assumptions of Lagrange Duality (see for example Theorem 1 in Section 8.6 in Luenberger (1969)). We conclude that the supremum is reached for a unique pair of maximizers \((\tilde{h}(t,x,p),\tilde{\rho }(t,x,p))\), which is an interior point of the set \(\mathcal {J}\cap \mathcal {K}\) defined in Eqs. (3.5) and (3.6), and the supremum evaluated at \((\tilde{h}(t,x,p),\tilde{\rho }(t,x,p)) \in \mathbb {R}^{n+1}\) is finite. By measurable selection, \(\tilde{h}\) and \(\tilde{\rho }\) can be taken as Borel measurable functions on \([0,T]\times \mathbb {R}^n\times \mathbb {R}^n\) and \([0,T]\times \mathbb {R}^n\times \mathbb {R}\), respectively. \(\square \)
The main result of this paper is the following:
Theorem 4.4
Under either of
-
1.
Affine drift Assumptions 2.6, 2.1, 2.5 and 3.4; or
-
2.
Standard control assumptions 2.7, 2.2, 2.5, 3.1 and 3.4;
the following hold:
-
1.
The exponentially transformed value function \(\tilde{\Phi }\), defined at (4.3), is the unique \(C^{1,2}\left( [0,T]\times \mathbb {R}^n\right) \) solution of the RS HJB PIDE (4.6) with terminal condition \(\tilde{\Phi }(T,x) = 1\).
-
2.
The value function \(\Phi \), also defined at (4.3), is the unique \(C^{1,2}\left( [0,T]\times \mathbb {R}^n\right) \) solution of the RS HJB PIDE (4.4) subject to the terminal condition \(\Phi (T, x) = 0\).
-
3.
The asset allocation \(h^*(t) = \tilde{h}(t,X_t,D\Phi (t,X_t))\) and the leverage ratio \(\rho ^*(t) = \tilde{\rho }(t,X_t,D\Phi (t,X_t))\), where \(\tilde{h}\) and \(\tilde{\rho }\) are the functions introduced in Proposition 4.3, are optimal in the class \(\mathcal{A}\) of admissible controls.
Proof
1. Proof under affine drift assumptions 2.6, 2.1, 2.5 and 3.4
Existence of a classical (\(C^{1,2}\)) solution: the key points of the proof are discussed in Sect. 5.
Existence of an optimal control: by Proposition 4.3, the supremum in (4.4) admits a unique Borel measurable maximizer. By Proposition 5.3 and Theorem 6.1, this maximizer is admissible and corresponds to the controls \((h^*,\rho ^*)\).
Verification and uniqueness of the classical solution: \(\tilde{\Phi }\) is bounded by Proposition 4.2. Choosing as optimal control the unique maximizer of the supremum (4.8), we can apply a standard verification theorem (see for example Davis and Lleo (2013a)) to show that \(\tilde{\Phi }\) is the unique classical solution.
2. Proof under standard control assumptions 2.7, 2.2, 2.5, 3.1 and 3.4
Existence of a classical (\(C^{1,2}\)) solution: Section 6 presents an outline of the approach developed to prove that \(\tilde{\Phi }\) is a \(C^{1,2}\left( [0,T]\times \mathbb {R}^n\right) \) solution of the RS HJB PDE (4.6) with terminal condition \(\tilde{\Phi }(T, x) = 1\).
Existence of an optimal control: by Proposition 4.3, the supremum in (4.4) admits a unique Borel measurable maximizing/minimizing pair \(\left( h^*(t,X_t),\rho ^*(t,X_t)\right) \). By Proposition 6.1, this pair of controls is admissible, i.e. belongs to the class \(\mathcal{A}\). Theorem 6.1 shows that this control is optimal. \(\square \)
5 Solving the ALM problem under affine drift assumptions
The problem reduces to solving a stochastic control problem in the factor process, which has no jumps. The HJB equation is a PDE rather than a PIDE:
subject to terminal condition \(\tilde{\Phi }(T, x) = 1\), where for \(r \in \mathbb {R}\), \(p \in \mathbb {R}^n\)
The proof of existence of a classical solution follows a similar argument to those developed by Fleming and Rishel (1975) (Theorem 6.2 and Appendix E) based on PDE results from Ladyzenskaja et al. (1968). Namely, we can use an approximation in policy space alongside results on linear parabolic partial differential equations to prove that the exponentially transformed value functions \(\tilde{\Phi }\) are of class \(C^{1,2}((0,T)\times \mathbb {R}^n)\). The approximation in policy space algorithm was originally proposed by Bellman in the 1950s (see Bellman (1957) for details) as a numerical method to compute the value function.
The approach proposed by Davis and Lleo (2011) in an asset management context was extended to take into account the investment benchmarks (see Davis and Lleo (2013b)). We can also use it, with minor modifications to the definition of zero beta policies, to solve an ALM problem.
Theorem 5.1
(Existence of a classical solution for the exponentially transformed control problem) The RS HJB PDE (5.1) with terminal condition \(\tilde{\Phi }(T,x) = 1\) has a solution \(\tilde{\Phi } \in C^{1,2}\left( (0,T)\times \mathbb {R}^n\right) \) with \(\tilde{\Phi }\) continuous in \([0,T]\times \mathbb {R}^n\).
Proof
The proof follows along the same line as the proof of Theorem 7.2 in Davis and Lleo (2011). \(\square \)
Proposition 5.2
The process \(\left( h^*(t),\rho ^*(t)\right) \) is admissible: \(\left( h^*(t),\rho ^*(t)\right) \in \mathcal {A}(T)\).
Proof
The proof is a slight extension of Proposition 5.3 in Davis and Lleo (2011). The class of admissible controls is presented in Definition 3.5. \(\square \)
Applying Proposition 5.2, we deduce that the pair of controls \(\left( h^*(t),\rho ^*(t)\right) \) is optimal for the auxiliary problems (4.3) resulting from the change of measure. However, this proposition is not sufficient to conclude that \(\left( h^*(t),\rho ^*(t)\right) \) is optimal for the original problem (1.1) set under the \(\mathbb {P}\)-measure. The next result shows that this is indeed the case.
Proposition 5.3
The optimal control \(\left( h^*(t),\rho ^*(t)\right) \) for the auxiliary problem
where \(I\) is defined in (4.1) is also optimal for the initial problem \(\sup _{h \in \mathcal {A}(T)}J(x,t,h,\rho )\) where \(J\) is defined in (3.7).
Proof
This proposition follows from the Appendix in Davis and Lleo (2011). \(\square \)
6 Solving the ALM problem under standard control assumptions
In this section, we prove that the value function \(\tilde{\Phi }\) is smooth under standard control assumptions. The process involves the six steps proposed by Davis and Lleo (2013a) for an asset management problem.
Step 1: \(\tilde{\Phi }\) is a Lipschitz Continuous Viscosity Solution (VS-PIDE) of (4.6). Following Theorem 4.4 in Davis and Lleo (2013a), we can show that \(\tilde{\Phi }\) is a (possibly discontinuous) viscosity solution of the PIDE (4.6). However, we know a priori from Proposition 4.2 that \(\tilde{\Phi }\) is Lipschitz.
Step 2: From PIDE to PDE. Assumption 1(vi) (2.22) implies that we can write the non-local term in (4.6) as
Change notation to rewrite the HJB PIDE as a PDE à la Pham (1998):
subject to terminal condition \(u(T, x) = 1\) and with
for \(r \in \mathbb {R}\), \(p \in \mathbb {R}^n\) and where
Step 3: Viscosity Solution to PDE (6.1). We consider viscosity solutions \(u\) of the semi-linear PDE (6.1) (interpreted as an equation for ‘unknown’ \(u\) with the last term prespecified, with \(\tilde{\Phi }\) defined as in Step 1.) The key point is that \(\tilde{\Phi }\) is a viscosity solution of the PDE (6.1). Indeed, due to definition (6.4), PIDE (4.6) and PDE (6.1) are in essence the same equation. Hence, if \(\tilde{\Phi }\) satisfies the PIDE in the viscosity sense, which from Step 1 we know that it does, then \(u=\tilde{\Phi }\) is a viscosity solution of the PDE (6.1). This last statement depends crucially on the Definition of ‘viscosity solution’ for the PIDE suggested by Pham (1998) and formalised by Davis et al. (2009).
Step 4: Uniqueness of the Viscosity Solution to the PDE (6.1). If a function \(u\) solves the PDE (6.1) it does not mean that \(u\) also solves the PIDE (4.6) because the term \(d_a\) in the PDE (4.6) depends on \(\tilde{\Phi }\) regardless of the choice of \(u\). Thus, if we were to show the existence of a classical solution \(u\) to PDE (6.1), we would not be sure that this solution is the value function \(\tilde{\Phi }\) unless we can show that PDE (6.1) admits a unique solution. This only requires applying a “classical” comparison result for viscosity solutions (see Theorem 8.2 in Crandall et al. (1992)) provided appropriate conditions on \(f_a\) and \(d_a^{\tilde{\Phi }}\) are satisfied.
Step 5: Existence of a Classical Solution to the HJB PDE (4.6). The proof in Davis and Lleo (2013a) uses an argument similar to that Fleming and Rishel (1975) (Appendix E) together with a result from Davis et al. (2009) to show the existence of a classical solution to the PDE (6.1) with \(d_{a}^{\tilde{\Phi }}(t,x)\) regarded as an autonomous term.
Step 6: Existence of a Classical Solution to the HJB PIDE (4.6). Combining Steps 4 and 5, we conclude that \(\tilde{\Phi }\) is a classical (\(C^{1,2}\)) solution of (4.6).
All that remains now is to show that the controls derived from the maximiser \(\tilde{h}\) of Proposition 4.3 correspond to the optimal policy.
Theorem 6.1
The pair of controls
is admissible, meaning \(\left( h^*(t,X_t),\rho ^*(t,X_t)\right) \in \mathcal {A}\), and it is optimal. In particular, \(\tilde{\Phi }(t,x) =\tilde{I}(t,x,h^*,\rho ^*;T;\theta )\).
Proof
The proof follows closely Propositions 5.3 and Theorem 5.5 in Davis and Lleo (2013a). \(\square \)
7 Conclusion
In this paper, we have used risk-sensitive control methods to solve an ALM problem in a general jump-diffusion setting where asset prices and the value of the liability are influenced by a number of valuation factors. The investor’s objective is to jointly select an optimal amount of leverage \(\rho (t)\) and an optimal asset allocation \(h(t)\) to maximise a function of the investor’s equity or surplus, defined as the difference between the investor’s assets and liabilities. To solve the problem, we extended the solution techniques proposed by Davis and Lleo (2011, 2013a) to show that the Bellman equation for the control problem admits a unique classical \((C^{1,2})\) solution.
References
Barles G, Imbert C (2008) Second-order elliptic integro-differential equations: viscosity solutions’ theory revisited. Annales de l’Institut Henri Poincaré 25(3):567–585
Bellman R (1957) Dynamic programming. Princeton University Press, Princeton
Benk M (2012) Intertemporal surplus management with jump risk. In: Gassmann HI, Ziemba WT (eds) Stochastic programming: applications in finance, energy, planning and logistics, vol 4. World Scientific Publishing Company, World Scientific Series in Finance, pp 69–96
Bielecki T, Pliska S (1999) Risk-sensitive dynamic asset management. Appl Math Optim 39:337–360
Bouchard B, Touzi N (2011) Weak dynamic programming principle for viscosity solutions. SIAM J Control Optim 49:948–962
Crandall M, Ishii H, Lions PL (1992) User’s guide to viscosity solutions of second order partial differential equations. Bull Am Math Soc 27(1):1–67
Davis M, Lleo S (2010) Risk-sensitive asset management and affine processes. In: Kijima M, Hara C, Tanaka K, Muromachi Y (eds) KIER-TMU International Workshop on Financial Engineering 2009, World Scientific, pp 1–43
Davis M, Lleo S (2011) Jump-diffusion risk-sensitive asset management I: diffusion factor model. SIAM J Financ Math 2:22–54
Davis M, Lleo S (2013a) Jump-diffusion risk-sensitive asset management II: jump-diffusion factor model. SIAM J Control Optim (forthcoming)
Davis M, Lleo S (2013b) Jump-diffusion risk-sensitive benchmarked asset management. In: Gassmann H, Ziemba W (eds) Stochastic programming: applications in finance, energy, planning and logistics, World, no 4 in World Scientific Series in Finance, pp 97–128
Davis M, Guo X, Wu G (2009) Impulse control of multi-dimensional jump diffusions. SIAM J Optim Control (to appear)
Fleming W, Rishel R (1975) Deterministic and stochastic optimal control. Springer, Berlin
Fleming W, Soner H (2006) Controlled Markov processes and viscosity solutions, stochastic modeling and applied probability, vol 25, 2nd edn. Springer, New York
Ikeda N, Watanabe S (1981) Stochastic differential equations and diffusion processes. North-Holland Publishing Company, Amsterdam, New York
Kuroda K, Nagai H (2002) Risk-sensitive portfolio optimization on infinite time horizon. Stoch Stoch Re 73:309–331
Ladyzenskaja O, Solonnikov V, Uralceva O (1968) Linear and quasilinear equations of parabolic type. American Mathematical Society
Luenberger D (1969) Optimization by vector space methods. Wiley, New York
Øksendal B, Sulem A (2005) Applied stochastic control of jump diffusions. Springer, Berlin, Heidelberg, New York
Pham H (1998) Optimal stopping of controlled jump diffusion processes: a viscosity solution approach. J Math Syst Estim Control 8(1):1–27
Rudolf M, Ziemba WT (2004) Intertemporal surplus management. J Econ Dyn Control 28:975–990
Touzi N (2002) Stochastic control and application to finance. Special research Semester on Financial Mathematics, Scuola Normale Superiore, Pisa, April 29–July 15 2002. http://www.cmap.polytechnique.fr/~touzi/pise02
Author information
Authors and Affiliations
Corresponding author
Additional information
We thank the participants to the XIII International Conference on Stochastic Programming (ICSP2013) for helpful suggestions and comments. Part of this paper was written while the second author was visiting at the Hausdorff Institute of Mathematics, University of Bonn, during the Trimester Program “Stochastic Dynamics in Economics and Finance”. The second author gratefully acknowledges support from Région Champagne Ardennes and the European Union through the RiskPerform Grant.
Rights and permissions
About this article
Cite this article
Davis, M.H.A., Lleo, S. Jump-diffusion asset–liability management via risk-sensitive control. OR Spectrum 37, 655–675 (2015). https://doi.org/10.1007/s00291-014-0371-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00291-014-0371-x