Abstract
We consider a stochastic autonomous Hamiltonian system for which the flow preserves the symplectic structure. Numerical simulations show that for stochastic Hamiltonian systems symplectic schemes produce more accurate results for long term simulations than non-sysmplectic numerical schemes. We study the approximation error corresponding to a symplectic weak scheme of order one. A backward error analysis is done at the level of the Kolmogorov equation associated with the initial stochastic Hamiltonian system. We obtain an expansion of the error in terms of powers of the discretization step size and the solutions of the modified Kolmogorov equation.
Access provided by CONRICYT-eBooks. Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Numerical simulations [5, 9, 11] show that for stochastic Hamiltonian systems (SHS) symplectic schemes give more accurate results for long term simulation that non-symplectic schemes, but, to the best of our knowledge, no theoretical proof was done in the stochastic case. For a SHS and a first weak order symplectic scheme, in [2] we present an expansion of the global approximation error in powers of the discretization step size. Comparing this expansion with the global error expansion obtained in [13] for the Euler scheme (which has also weak order one), we justify the superior performance of the symplectic scheme for the simple linear SHS corresponding to the Kobo oscillator [2]. However, this justification can not be easily extended for general non-linear SHSs. Here we use backward error analysis to find an expansion of error for the symplectic scheme in terms of the powers of the discretization step size and the solutions of the modified Kolmogorov equation [3].
Backward error analysis was successfully applied to study long term behavior of deterministic Hamiltonian systems [4]. Recently, backward error analysis was extended to stochastic differential equations (SDE). Modified SDEs associated with various numerical schemes are presented in [1, 10, 14]. A SDE defined on the n-dimensional torus and its approximation by the explicit Euler scheme are studied using backward error analysis in [3].
We follow the same approach as in [3], and we construct the modified equation not at the level of the SDE, but at the level of the associated Kolmogorov equation. Compared with [3] we consider a fully implicit scheme instead of an explicit one, and we consider a SHS with additive or multiplicative noise defined on \(\mathrm {R}^{2n}\) instead of the compact n dimensional torus. Implicit numerical schemes are also considered in [6, 7], but for Langevin SDEs on \(\mathrm {R}^n\) with additive noise. Studying the multiplicative noise case is more difficult, especially for a fully implicit numerical scheme.
In the next section we present some preliminary results regarding the solution of the SHS and the approximate solution given by the numerical scheme. The steps followed for the backward error analysis are included in Sect. 3. The last section contains the conclusions.
2 Assumptions and Preliminary Results
We introduce a few definitions and notations. We denote \(\mathrm {N}=\{1,2,\ldots \}\), \(N^*=\{1,2,\ldots \}\) and for any \(x=(x_1,\ldots ,x_n)^T\in \mathrm {R}^n\), |x| represents the Euclidean norm.
For any multi-index \(\alpha =(\alpha _1,\ldots ,\alpha _r)\in \mathrm {N}^{r}\) with length \(|\alpha |=\alpha _1+\cdots +\alpha _r\), let \(\partial _{\alpha }=\frac{\partial ^{|\alpha |}}{\partial _1^{\alpha _1}\cdots \partial _r^{\alpha _r}}\) denote the partial derivative of order \(|\alpha |\).
We define the following space of functions with polynomial growth:
For any \(k, l\in \mathrm {N}\), we denote
On \(C_k^l(\mathrm {R}^{2n})\) we define [7] the norm \(\Vert \cdot \Vert _{l,k}\) and the semi norm \(|\cdot |_{l,k}\):
Notice that if \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n})\), then for all \(d\in \mathrm {N}\), there exists \(r_d\in \mathrm {N}\) such that \(\phi \in C_{r_d}^d(\mathrm {R}^{2n})\).
We consider the following stochastic Hamiltonian system
where P, Q, p, q are n-dimensional column vectors, \(w_t^r, r= 1,\ldots ,m\) are independent standard Wiener processes, and for any function f defined on \(\mathrm {R}^n\times \mathrm {R}^n\), \(\partial _P f\) and \(\partial _Q f\) denote the column vectors with components \((\partial f/\partial P_i), 1\le i\le n\) and \((\partial f/\partial Q_i), 1\le i\le n\), respectively. The stochastic flow \((p,q) \longrightarrow (P,Q)\) of the SHS (2) preserves the symplectic structure [9]: \(dP \wedge dQ = dp \wedge dq\), where the differential 2-form \(dp \wedge dq = dp_1 \wedge dq_1 + \dots + dp_n \wedge dq_n\).
The system (2) can be re-written in the Ito formulation:
where
Here everywhere the arguments are (P, Q), and a, b, \(\sigma ^r\), \(\gamma ^r\), \(r=1,\ldots ,m\) are \(n-\)dimensional column vectors.
The Kolmogorov generator \(L(p,q,\partial _p, \partial _q)\) associated with the SHS (3)–(4) has the following form [12]
Throughout the paper we make the same assumptions as in [12, 13]:
-
A1.
The derivatives of any order of \(H_i\in C^{\infty }\), \(i=1,\ldots , m\) are bounded, and the derivative of any order \(k\ge 2\) of \(H_0\in C^{\infty }\) are bounded.
-
A2.
The operator L is uniformly elliptic: there exists a constant \(\alpha >0\) such that for all \(x=(p,q)^T\in \mathrm {R}^{2n}\) we have
$$\begin{aligned} \alpha |x|^2\le \sum _{r=1}^m\sum _{i,j=1}^n \left( \sigma _i^r\sigma _j^r p_ip_j+\gamma _i^r\gamma _j^r q_iq_j+2\sigma _i^r\gamma _j^r p_iq_j\right) \end{aligned}$$(5) -
A3.
There exists a constant \(\beta >0\) and a compact set K such that for all \(x=(p,q)^T\) \(\in \mathrm {R}^{2n}-K\) we have \(p\cdot a(x)+q\cdot b(x)\le -\beta |x|^2\).
Notice that assumption A1 implies that we have a Lipschitz condition, i.e. there exists \(L_1>0\) such that for all \(X=(P,Q)^T\), \(x=(p,q)^T\in \mathrm {R}^{2n}\) we have
2.1 Results Regarding the Solution of the Stochastic Hamiltonian System
Proceeding as in Proposition 3.1 in [12], under the assumptions A1-A3 we can prove the following result regarding the solution \(\left( X^{0,x_0}(t)\right) =\left( (P(t,p_0,q_0),Q(t,p_0,q_0))^T\right) \) of the SHS (2) with the initial condition \(x_0=(p_0,q_0)^T\in \mathrm {R}^{2n}\).
Lemma 1
The Markov process \(\left( X^{0,x_0}(t)\right) \) is ergodic. The unique invariant probability measure \(\mu \) has finite moments of any order and a density \(\rho \ge 0\). Moreover, for any \(k\in \mathrm {N}\) there exist \(C_k,\gamma _k>0\) such that for any \(x_0=(p_0,q_0)^T\in \mathrm {R}^{2n}\), and any \(t\ge 0\) we have:
We consider any function \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n})\), and for all \(x=(p,q)^T \in \mathrm {R}^{2n}\) and all \(t>0\) we define \(u(t,p,q):=E[\phi (X^{0,x}(t)]\). Notice that Lemma 1 implies that u is well defined. It is well known [12] that u(t, p, q) is a classical solution of the Kolmogorov equation
For any function \(f\in C_{pol}^\infty (\mathrm {R}^{2n})\) we denote the average
The results included in the following lemma show the exponential convergence of u and its derivatives and are essential for the backward error analysis presented in this paper. The proof is an extension of the proof of Theorem 3.4 in [12], based on Theorem 2.5 in [8].
Lemma 2
Let \(k\in \mathrm {N}\), \(k\ge 1\), and \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n}) \cap C_{r_{k+n+1}}^{k+n+1}(\mathrm {R}^{2n})\), \( r_{k+n+1} \in \mathrm {N.}\) Then there exist \(\gamma _k>0\), \(C_k>0\) and \(l_k\in \mathrm {N}\) such that \(l_k>r_{k+n+1}\) and for any \(0<\gamma <\gamma _k\) and all \(t\ge 0\) we have
2.2 Results Regarding the Symplectic Scheme
We consider the following one-step approximation [9] for the system (2):
where \(G_{(r,r)}=\sum _{i=1}^n \frac{\partial H_r}{\partial Q_i}\frac{\partial H_r}{\partial P_i}\), the random variables \(\varsigma _{rk}\) are mutually independent identically distributed according to the law, \(\mathrm {P}(\varsigma _{rk}=\pm 1)=1/2\), and everywhere the arguments are \(({P}_{k+1},{Q}_k)\).
Notice that the first equation (11) is implicit. Let denote \(\delta :=\sqrt{h}\) and \(F(p,q)=\left( H_0(p,q)+\frac{1}{2}\sum _{r=1}^mG_{(r,r)}(p,q)\right) \). Then we can reformulate the scheme (11)–(12) as follows:
Using the Lipschitz condition (6) and proceeding as in the proof of Theorem 4.6.1 in [9] we can show that the scheme (13)–(14) is well defined:
Lemma 3
There exist \(h_{01}>0\), \(C>0\) such that for any \(0<h\le h_{01}\) and any \((p,q)^t\in \mathrm {R}^{2n} \) there exists a unique \(z\in \mathrm {R}^{n} \) such that \( z=p-h\partial _q F(z,q)-\sqrt{h}\sum _{r=1}^m\varsigma _{rk}\partial _q H_r (z,q)\) which satisfies \(|z-p|\le C(1+|p|)\sqrt{h}.\)
Moreover, Theorem 4.6.1 in [9] shows that implicit method (13)–(14) is symplectic and of first weak order: for any \(T>0\), and any \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n})\) we have
We define the function \(\phi _\delta \) which associate to \((q,p)\in \mathrm {R}^{2n}\) the solution \(z=(z_1,z_2)^T\in \mathrm {R}^{2n}\) of \(f(\delta ,q,p,z_1,z_2)=0\), where
where the random variables \(\varsigma _{r}\) are mutually independent identically distributed according to the law, \(\mathrm {P}(\varsigma _{r}=\pm 1)=1/2\), Since the scheme (13)–(14) is well defined, the function \(\phi _\delta \) is also well defined for any \(\delta \in (0, \sqrt{h_{01}})\). Using A1 it is easy to show that there exists \(h_{03}\le h_{01}\) such that \(\partial _z f(\delta ,q,p,z)=I-B(\delta ,p,q,z)\) where \(\Vert B(\delta ,p,q,z)\Vert <1\) for any \((\delta , p,q,z)\in (0, \sqrt{h_{03}})\times \mathrm {R}^{2n}\,{\times }\, \mathrm {R}^{2n}\). Thus, \(\partial _z f(\delta ,q,p,z)\) is invertible, and from the Implicit Functions Theorem we obtain that the function defined by \((\delta ,p,q)\rightarrow \phi _\delta (p,q)\) is \(C^\infty \) on a neighborhood of each point of \((0, \sqrt{h_{03}})\times \mathrm {R}^{2n}\).
Following the same approach as in the proof of Proposition 7.1 in [12] we can show that the moments of the approximating process \((P_k,Q_k)\) satisfy a similar property with (7):
Lemma 4
There exist \(0<h_{02}\le h_{01}\) such that the symplectic scheme (11)–(12) with any initial condition \((p,q)^t\in \mathrm {R}^{2n}\) and any \(0<h\le h_{02}\) satisfies for any \(l\in \mathrm {N}^*\)
3 Asymptotic Expansion of the Weak Error
Using a Taylor expansion and the fact that u is a solution of the Kolmogorov equation (8) we obtain the following expansion.
Proposition 1
Let consider any \(N\in \mathrm {N}\) and any \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n}) \cap C_{r_{2N+n+3}}^{2N+n+3}(\mathrm {R}^{2n})\), \( r_{2N+n+3} \in \mathrm {N}\). There exist \(c(N)>0\) and \( l_N\in \mathrm {N}\), \(l_N>r_{2N+n+3}\) such that for all \(h>0\) and \((p,q)^T\in \mathrm {R^{2n}}\) we have
Let \(h_0=\min \{h_{02},h_{03}\}\). We study the first step of the approximating process \((P_k,Q_k)\), and later we will use the Markov property to extend the results at all steps. The following result gives an expansion for the symplectic scheme, similar with the expansion (18).
Proposition 2
For any \(k\in \mathrm {N}\) there exists an operator \(A_k\) of order 2k with coefficients in \( C_{pol}^\infty (\mathrm {R^{2n}})\) such that for any \(N\in \mathrm {N}\) and any \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n}) \cap C_{r_{2N+2}}^{2N+2}(\mathrm {R}^{2n})\), \( r_{2N+2} \in \mathrm {N}\), there exist \(C_N>0\) and \(l_N\in \mathrm {N}\) such that for all \(0<h\le h_0\) and \((p,q)^T\in \mathrm {R^{2n}}\) we have \(A_0=I\), \(A_1=L\), and
Proof
Firstly we use Taylor expansions to obtain expansions for \(P_1\) and \(Q_1\) (see also the proof of Lemma 3.4 in [6]). Then the proof can be done using the same approach as in the proof of Proposition 3.2 in [6].
3.1 The Modified Generator
Following the same approach as in [3], we want to construct a formal series \(\mathscr {L}=L+hL_1+\cdots +h^kL_k+\cdots \) such that formally the solution v(h, p, q) of the equation
coincides in the sense of asymptotic expansion with the transition semigroup \(E(\phi (P_1\), \(Q_1))\) studied in Proposition 2. In order to have
we define the \(L_k\) operator as
\(B_l\) are the Bernoulli numbers and \(L_k\) is an operator of order \(2k+2\) with coefficients in \(C_{pol}^\infty (\mathrm {R}^{2n})\) and \(L_k 1=0\). We also have
We define the modified generator
Since we do not know if the modified equation
has a solution, we construct an approximate solution associated to (21).
Proposition 3
Let \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n})\). For all \(k\in \mathrm {N}\) there exist functions \(v_k(t,\cdot )\in C_{pol}^\infty (\mathrm {R}^{2n})\) defined for all \(t\ge 0\) such that \(v_0(0,\cdot )=\phi (\cdot )\), \(v_k(0,\cdot )=0\), \(k\ge 1\), and
Moreover, for all \(k\in \mathrm {N}\), \(j\in \mathrm {N}^*\) there exist \(\gamma _{k,j}>0\) and positive integers \(\alpha _{k,j}\) and \(l_{k,0}\) such that for all \(t\ge 0\) we have
Here \(Q_{k,j}:[0,\infty )\rightarrow [0,\infty )\) are polynomial functions with positive coefficients and the constants \(C_{0,k}\) do not depend on t.
Proof
The proof is similar with the proof of Theorem 4.1 in [6]. Inequalities (23)–(24) are a consequence of the results presented in Lemma 2.
For any \(N\ge 0\), we define the approximate solution of the modified flow as:
We can easily show that for all \(t\ge 0\) we have
where
is of order \(O(h^{N+1})\). The following result can be proved similarly with Theorem 4.1 in [3].
Proposition 4
Let \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n})\). For any \(N\in \mathrm {N}^*\) there exist \(C_N>0\) and \(l_N\), \(k_{2N+2} \in \mathrm {N}\) such that for all \(t\ge 0\), \(0<h\le h_0\), \((p,q)\in \mathrm {R}^{2n}\) we have
3.2 Main Result
We now study the long time behavior of the numerical solution. We obtain an expansion similar with the one for the exact solution, given in Proposition 1.
Theorem 1
Let \(N\in \mathrm {N}\) be fixed, and let \((P_k,Q_k)\) be the discrete process defined by the symplectic scheme. Let \(0<h\le h_0\), \(\alpha _N=6N+8+(n+1)(N+2)\) and \(\phi \in C_{pol}^\infty (\mathrm {R}^{2n})\cap C_{r_{\alpha _N}}^{\alpha _N}\) . Then there exist \(C_N>0\) and \(l_N\in \mathrm {N}\) such that for all \(k\in \mathrm {N}\)
Proof
Let \(t_k=kh\). By the Markov property of \((P_k,Q_k)\) we have
where \(\left( P_1(p,q), Q_1(p,q)\right) \) is the first step of the scheme (11)–(12) when the initial condition is (p, q). Using inequalities (17), (23), and (28), with \(t=t_j\), \(j=0,\ldots , k-1\), we deduce that there exist positive integers \(l_N\), \(k_N\) such that
where \(c>0\), \(0<\tilde{\lambda }_{2N+4}<\lambda _{2N+4}\) and \(Q_{2N+4}\) is a polynomial function with positive coefficients. Notice that for a fixed constant \(\lambda >0\) we have
where the constant \(c_1\) depends on \(\lambda \) and \(h_0\). Hence, using the previous inequality and (24) we get
4 Conclusions and Future Work
We have presented a weak backward error analysis for a SHS system and a symplectic scheme of first weak order. The main tools are the exponential convergence to equilibrium of the solution of the Kolmogorov equation, and the uniform ellipticity of the associated operator. We plan to do a backward error analysis under less restrictive assumptions. The main difficulty is that the symplectic schemes are fully implicit, and for SDEs with multiplicative noise and unbounded coefficients, methods from Malliavin calculus are needed.
References
Abdulle, A., Cohen, D., Vilmart, G., Zygalakis, K.: High weak order methods for stochastic differential equations based on modified equations. SIAM J. Sci. Comput. 34(3), 1800–1823 (2012)
Anton, C., Wong, Y., Deng, J.: On global error of symplectic schemes for stochastic Hamiltonian systems. Int. J. Numer. Anal. Model. Ser. B 4(1), 80–93 (2013)
Debussche, A., Faou, E.: Weak backward error analysis for SDEs. SIAM J. Numer. Anal. 50(3), 1735–1752 (2012)
Hairer, E., Lubich, C., Wanner, G.: Geometric Numerical Integration: Structure-Preserving Algorithms for Ordinary Differential Equations. Springer, Berlin (2006)
Hong, J., Sun, L., Wang, X.: High order conformal symplectic and ergodic schemes for the stochastic Langevin equation via generating functions. SIAM J. Numer. Anal. 55(6), 3006–3029 (2017)
Kopec, M.: Weak backward error analysis for Langevin process. BIT Numer. Math. 55(4), 1057–1103 (2015)
Kopec, M.: Weak backward error analysis for overdamped Langevin processes. IMA J Numer. Anal. 35(2), 583–614 (2015)
Mattingly, J., Stuart, A., Higham, D.J.: Ergodicity for SDEs and approximations: locally Lipschitz vector fields and degenerate noise. Stochast. Process. Appl. 2(101), 185–232 (2002)
Milstein, G.N., Tretyakov, M.V.: Stochastic Numerics for Mathematical Physics. Springer, Berlin (2004)
Shardlow, T.: Modified equations for stochastic differential equations. BIT Numer. Math. 46(1), 111–125 (2006)
Sun, L., Wang, L.: Stochastic symplectic methods based on the Pade approximations for linear stochastic Hamiltonian systems. J. Comp. Appl. Math. 311, 439–456 (2017)
Talay, D.: Second order discretization schemes of stochastic differential systems for the computation of the invariant law. Stochast. Stochast. Rep. 29(1), 13–36 (1990)
Talay, D., Tubaro, L.: Expansion of the global error for numerical schemes solving stochastic differential equations. Stochast. Anal. Appl. 8(4), 483–509 (1990)
Wang, L., Hong, J., Sun, L.: Modified equations for weakly convergent stochastic symplectic schemes via their generating functions. BIT Numer. Math. 56, 1131–1162 (2016)
Acknowledgements
This work is supported by the NSERC grant DDG-2015-00041.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Anton, C. (2018). Error Expansion for a Symplectic Scheme for Stochastic Hamiltonian Systems. In: Kilgour, D., Kunze, H., Makarov, R., Melnik, R., Wang, X. (eds) Recent Advances in Mathematical and Statistical Methods . AMMCS 2017. Springer Proceedings in Mathematics & Statistics, vol 259. Springer, Cham. https://doi.org/10.1007/978-3-319-99719-3_51
Download citation
DOI: https://doi.org/10.1007/978-3-319-99719-3_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99718-6
Online ISBN: 978-3-319-99719-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)