Summary
The basic problem considered in this paper is that of determining conditions for recurrence and transience for two dimensional irreducible Markov chains whose state space is Z 2+ =Z+xZ+. Assuming bounded jumps and a homogeneity condition Malyshev [7] obtained necessary and sufficient conditions for recurrence and transience of two dimensional random walks on the positive quadrant. Unfortunately, his hypothesis that the jumps of the Markov chain be bounded rules out for example, the Poisson arrival process. In this paper we generalise Malyshev's theorem by means of a method that makes novel use of the solution to Laplace's equation in the first quadrant satisfying an oblique derivative condition on the boundaries. This method, which allows one to replace the very restrictive boundedness condition by a moment condition and a lower boundedness condition, is of independent interest.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Baccelli, F.: Exponential martingales and Wald's formulas for two queue networks. J. Appl. Probab.23,812–819 (1986)
Fayolle, G., King, P.J.B., Mitrani, I.: The solution of certain two dimensional Markov Models. Adv. Appl. Probab.14, 295–308 (1982)
Foster, F.G.: On the Stochastic Matrices associated with certain queueing processes. Ann. Math. Stat.24, 355–360 (1953)
Harrison, J.M., Williams, R.J.: Brownian models of open queueing networks with homogeneous customer populations. Stochastics22, 77–115 (1987)
Kingman, J.F.C.: The ergodic behaviour of random walks. Biometrika48, 391–396 (1961)
Lamperti, J.: Criteria for the recurrence or transience of stochastic processes. I. J. Math. Anal. Appl.1, 314–330 (1960)
Malysev, V.A.: Classification of two-dimensional positive random walks and almost linear semimartingales. Sov. Math., Dokl.13, 136–139 (1972)
Varadhan, S.R.S., Williams, R.: Brownian motion in a wedge with oblique reflection. Commun. Pure Appl. Math,38, 405–443 (1985)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Rosenkrantz, W.A. Ergodicity conditions for two-dimensional Markov chains on the positive quadrant. Probab. Th. Rel. Fields 83, 309–319 (1989). https://doi.org/10.1007/BF00964367
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00964367