Abstract
Positive recurrence of one-dimensional diffusion with switching, with an additive Wiener process, and with one recurrent and one transient regime is established under suitable conditions on the drift in both regimes and on the intensities of switching. The approach is based on an embedded Markov chain with alternating jumps: one jump increases the average of the square norm of the process, while the next jump decreases it, and under suitable balance conditions this implies positive recurrence.
Access provided by Autonomous University of Puebla. Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
On a probability space \((\varOmega ,\mathcal {F},(\mathcal {F}_t),\mathbb P)\) with a one-dimensional \((\mathcal {F}_t)\)-adapted Wiener process \(W=(W_{t})_{t\ge 0}\) on it, a one-dimensional SDE with switching is considered,
where \(Z_t\) is a continuous-time Markov process on the state space \(S= \{0,1\}\) with (positive) intensities of respective transitions \( \lambda _{01} =: \lambda _0, \, \& \, \lambda _{10} =: \lambda _1\); the process Z is assumed to be independent of W and adapted to the filtration \((\mathcal {F}_t)\). We assume that these intensities are constants; this may be relaxed. Under the regime \(Z=0\) the process X is assumed positive recurrent, while under the regime \(Z=1\) its modulus may increase in the square mean with the rate comparable to the decrease rate under the regime \(Z=0\). This vague wording will be specified in the assumptions. Denote
The problem addressed in this paper is to find sufficient conditions for the positive recurrence (and, hence, for convergence to the stationary regime) for solutions of stochastic differential equations (SDEs) with switching in the case where not for all values of the modulating process the SDE is recurrent, and where it is recurrent, this property is assumed to be “not very strong”. Earlier a similar problem was tackled in [2] in the exponential recurrent case; its method apparently does not work for the weaker polynomial recurrence. A new approach is offered. Other SDEs with switching were considered in [1, 4, 5, 7], see also the references therein. Neither of these works address exactly the problem which is attacked in this paper: some of them tackled an exponential recurrence, some other study the problem of a simple recurrence versus transience.
2 Main Result: Positive Recurrence
The existence and pathwise uniqueness of the solution follows easily from [9], or from [6], or from [8], although, neither of these papers tackles the case with switching. The next theorem is the main result of the paper.
Theorem 1
Let the drift b be bounded and let there exist \(r_-, r_+,M>0\) such that
and
Then the process (X, Z) is positive recurrent; moreover, there exists \(C>0\) such that for all \(M_1\) large enough and all \(x \in \mathbb R\)
where
Moreover, the process \((X_t,Z_t)\) has a unique invariant measure, and for each nonrandom initial condition x, z there is a convergence to this measure in total variation when \(t\rightarrow \infty \).
3 Proof
Denote \(\Vert b\Vert = \sup _x|b(x)|\). Let \(M_1 \gg M\) (the value \(M_1\) will be specified later); denote
and
where each \(T_{n}\) is defined as the next moment of switch of the component Z; let
It suffices to evaluate from above the value \(\mathbb E_x\tau \) because \(\tau \ge \tau _{M_1}\). Let us choose \(\epsilon >0\) such that
with some \(q<1\) (see (2)). Note that for \(|x|\le M\) there is nothing to prove; so assume \(|x| > M\).
Lemma 1
Under the assumptions of the theorem for any \(\delta >0\) there exists \(M_1\) such that
Proof
Let \(X^i_t, \, i=0,1\) denote the solution of the equation
Let \(Z_0=0\); then \(T_0=0\). The processes X and \(X^0\) coincide a.s. on \([0,T_1]\) due to uniqueness of solution. Therefore, due to the independence of Z and W, and, hence, of Z and \(X^0\), we obtain
Let us take t such that
Now, by virtue of the boundedness of b, it is possible to choose \(M_1>M\) such that for this value of t we have
The bound for the second term in (5) follows by using the process \(X^1\) and the intensity \(\lambda _1\) in the same way. QED
Lemma 2
If \(M_1\) is large enough, then under the assumptions of the theorem for any \(|x|>M_1\) for any \(k=0,1,\ldots \)
Proof
1. Recall that \(T_0=0\) under the condition \(Z_0=0\). We have,
In other words, the moment \(T_{2k+1}\) may be treated as “\(T_{1}\) after \(T_{2k}\)”. Under \(Z_0=0\) the process \(X_t\) coincides with \(X^0_t\) until the moment \(T_1\). Hence, we have on \([0,T_1]\) by Ito’s formula
on the set \((|X_t|> M)\) due to the assumptions (1). Further, since \(1(|X_t| > M) = 1 - 1(|X_t| \le M)\), we obtain
Thus, always for \(|x|>M_1\),
For our fixed \(\epsilon >0\) let us choose \(\delta = \lambda _0^{-1}\epsilon / (2M \Vert b\Vert + 2r_-) \). Then, since \(|x|>M_1\) implies \(T_1\wedge \tau = T_1\) on \((Z_0=0)\), we get
Substituting here \(X_{T_{2k}}\) instead of x and writing \(\mathbb E_x(\cdot |{\mathcal F}_{T_{2k}})\) instead of \(\mathbb E_x(\cdot )\), and multiplying by \(1(\tau > T_{2k})\), we obtain the bound (6), as required.
2. The condition \(Z_0=1\) implies the inequality \(T_0>0\). We have,
In other words, the moment \(T_{2k+2}\) may be treated as “\(T_{0}\) after \(T_{2k+1}\)”. Under \(Z_0=1\) the process \(X_t\) coincides with \(X^1_t\) until the moment \(T_0\). Hence, we have on \([0,T_0]\) by Ito’s formula
on the set \((|X_t|> M)\) due to the assumptions (1). Further, since \(1(|X_t| > M) = 1 - 1(|X_t| \le M)\), we obtain
Thus, always for \(|x|>M_1\),
For our fixed \(\epsilon >0\) let us choose \(\delta = \lambda _0^{-1}\epsilon / (2M \Vert b\Vert ) \). Then, since \(|x|>M_1\) implies \(T_0\wedge \tau = T_0\) on \((Z_0=1)\), we get
Substituting here \(X_{T_{2k+1}}\) instead of x and writing \(\mathbb E_x(\cdot |{\mathcal F}_{T_{2k+1}})\) instead of \(\mathbb E_x(\cdot )\), and multiplying by \(1(\tau > T_{2k+1})\), we obtain the bound (7), as required. QED
Lemma 3
If \(M_1\) is large enough, then under the assumptions of the theorem for any \(k=0,1,\ldots \)
and
Proof
Let \(Z_0=0\); recall that it implies \(T_0=0\). If \(\tau \le T_{2k+1}\), then (8) is trivial. Let \(\tau > T_{2k+1}\). We will substitute x instead of \(X_{T_{2k}}\) for a while, and will be using the solution \(X^1_t\) of the equation
For \(M_1\) large enough, since \(|x|\wedge |X_{T_1}|>M_1\) implies \(T_2\le \tau \), and due to the assumptions (1) we guarantee the bound
in the same way as the bound (7) in the previous lemma. In particular, it follows that for \(|x|>M_1\)
since \(|X_{T_1}|\le M_1\) implies \(\tau \le T_1\) and \(\mathbb E_{X_{T_1}} X_{T_2\wedge \tau }^2 - X_{T_1\wedge \tau }^2=0\). So, on the set \(|x|>M_1\) we have,
Now substituting back \(X_{T_{2k}}\) in place of x and multiplying by \(1(\tau > T_{2k+1}) \), we obtain the inequality (8), as required.
For \(Z_0=1\) we have \(T_0>0\), and the bound (9) follows in a similar way. QED
Now we can complete the proof of the theorem. Consider the case \(Z_0=0\) where \(T_0=0\). Note that the bound (6) of the Lemma 2 together with the bound (8) of the Lemma 3 can be equivalently rewritten as follows:
and
We have the identity
Therefore,
Since \(T_n\uparrow \infty \), by virtue of the monotonic convergence in both parts and due to Fubini theorem we obtain,
By virtue of Fatou’s lemma we get
Note that \(1(\tau> T_{2k+1}) \le 1(\tau > T_{2k})\). So, \(\mathbb P(\tau> T_{2k}) \ge \mathbb P(\tau > T_{2k+1})\). Hence,
Thus,
Therefore, we estimate
So, (13) implies that
Denoting \(\displaystyle c:= \min \left( \frac{1-q}{2q}\, ((2r_++1)+ \epsilon ), \frac{1-q}{2}\, ((2r_--1)- \epsilon )\right) \), we conclude that
So, as \(m\uparrow \infty \), by the monotone convergence theorem we get the inequality
Due to (12), it implies that (in the case \(T_0=0\))
as required. Recall that this bound is established for \(|x|>M_1\), while in the case of \(|x|\le M_1\) the left hand side in this inequality is just zero.
In the case of \(Z_0=1\) (and, hence, \(T_0>0\)), we have to add the value \(\mathbb E_x T_0 = \lambda _1^{-1}\) to the right hand side of (14), which leads to the bound (3), as promised.
In turn, this bound implies existence of the invariant measure, see [3, Section 4.4]. Convergence to it in total variation follows due to the coupling method in a standard way. So, this measure is unique. The details and some extensions of this issue will be provided in another paper. QED
References
Anulova, S.V., Veretennikov, A.Y.: Exponential convergence of degenerate hybrid stochastic systems with full dependence. In: Korolyuk, V., Limnios, N., Mishura, Y., Sakhno, L., Shevchenko, G. (eds.) Modern Stochastics and Applications. SOIA, vol. 90, pp. 159–174. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-03512-3_10
Cloez, B., Hairer, M.: Exponential ergodicity for Markov processes with random switching. Bernoulli 21(1), 505–536 (2015)
Khasminskii, R.Z.: Stochastic Stability of Differential Equations, 2nd edn. Springer, Berlin (2012). https://doi.org/10.1007/978-3-642-23280-0
Khasminskii, R.Z.: Stability of regime-switching stochastic differential equations. Probl. Inf. Transm. 48, 259–270 (2012). https://doi.org/10.1134/S0032946012030064
Mao, X., Yin, G., Yuan, C.: Stabilization and destabilization of hybrid systems of stochastic differential equations. Automatica 43, 264–273 (2007)
Nakao, S.: Comparison theorems for solutions of one-dimensional stochastic differential equations. In: Maruyama, G., Prokhorov, Y.V. (eds.) Proceedings of the Second Japan-USSR Symposium on Probability Theory. LNM, vol. 330, pp. 310–315. Springer, Heidelberg (1973). https://doi.org/10.1007/BFb0061496
Shao, J., Yuan, C.: Stability of regime-switching processes under perturbation of transition rate matrices. Nonlinear Anal. Hybrid Syst. 33, 211–226 (2019)
Veretennikov, A.Y.: On strong solutions and explicit formulas for solutions of stochastic integral equations. Math. USSR-Sb. 39(3), 387–403 (1981). https://doi.org/10.1070/SM1981v039n03ABEH001522
Zvonkin, A.K.: A transformation of the phase space of a diffusion process that removes the drift. Math. USSR-Sb. 22(1), 129–149 (1974)
Acknowledgments
The author is deeply indebted to S. Anulova who made useful comments to the first versions of the manuscript and with whom the author started studying the theme of switched diffusions some years ago. This article is devoted to her memory. The article was prepared within the framework of the HSE University Basic Research Program in part which includes Lemmata 1 and 2; the Proof of Lemma 3 and Theorem 1 was funded by Russian Foundation for Basic Research grant 20-01-00575a.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Veretennikov, A. (2021). On Positive Recurrence of One-Dimensional Diffusions with Independent Switching. In: Shiryaev, A.N., Samouylov, K.E., Kozyrev, D.V. (eds) Recent Developments in Stochastic Methods and Applications. ICSM-5 2020. Springer Proceedings in Mathematics & Statistics, vol 371. Springer, Cham. https://doi.org/10.1007/978-3-030-83266-7_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-83266-7_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-83265-0
Online ISBN: 978-3-030-83266-7
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)