Abstract
An approximation of a general V-ergodic semi-Markov game with Borel state space by discrete-state space strongly-ergodic games is studied. The standard expected ratio-average criterion as well as the expected time-average criterion are considered. New theorems on the existence of ∊-equilibria are given.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
NOWAK, A. S., and ALTMAN, ε-Equilibria for Stochastic Games with Uncountable State Space and Unbounded Cost, SIAM Journal on Control and Optimization, Vol. 40, pp. 1821-1839, 2002.
JAŚKIEWICZ, A., Zero-Sum Semi-Markov Games, SIAM Journal on Control and Optimization, Vol. 41, pp. 723-739, 2002.
VEGA-AMAYA, O., Zero-Sum Average Semi-Markov Games: Fixed-Point Solutions of the Shapley Equation, SIAM Journal on Control and Optimization, Vol. 42, pp. 1876-1894, 2003.
KÜENLE, H. U., Equilibrium Strategies in Stochastic Games with Additive Cost and Transition Structure, International Game Theory Review, Vol. 1, pp. 131–147, 1999.
NOWAK, A. S., On a New Class of Nonzero-Sum Discounted Stochastic Games Having Stationary Nash Equilibrium Points, International Journal of Game Theory, Vol. 32, pp. 121–132, 2003.
NOWAK, A. S., and RAGHAVAN, T. E. S., Existence of Stationary Correlated Equilibria with Symmetric Information for Discounted Stochastic Games, Mathematics of Operations Research, Vol. 17, pp. 519–526, 1992.
NOWAK, A. S., and JAŚKIEWICZ, A., Nonzero-Sum Semi-Markov Games with the Expected Average Payoffs, Mathematical Methods of Operations Research. Vol. 62, 2005.
NOWAK, A. S., N-Person Stochastic Games: Extensions of the Finite State Space Case and Correlation, Stochastic Games and Applications, Edited by A. Neyman and S. Sorin, NATO Science Series, Series C: Mathematical and Physical Sciences, Vol. 570, pp. 93–106, 2003.
HERNÁNDEZ-LERMA, O., and LASSERRE, J. B., Further Topics on Discrete-Time Markov Control Processes, Springer Verlag, New York, NY, 1999.
HERNÁNDEZ-LERMA, O., and LASSERRE, J. B., Zero-Sum Stochastic Games in Borel Spaces: Average Payoff Criteria. SIAM Journal on Control and Optimization, Vol. 39, pp. 1520–1539, 2001.
KÜENLE, H. U., and SCHURATH, R., The Optimality Equation and ε-Optimal Strategies in Markov Games with Average Reward Criterion, Mathematical Methods of Operations Research, Vol. 56, pp. 439–449, 2003.
ALTMAN, E., HORDIJK, A., and SPIEKSMA F. M., Contraction Conditions for Average and α-Discount Optimality in Countable State Markov Games with Unbounded Rewards, Mathematics of Operations Research, Vol. 22, pp. 588–618, 1997.
POØWCZUK, W., Nonzero-Sum Semi-Markov Games with Countable State Spaces, Applicationes Mathematicae, Vol. 27, pp. 395–402, 2000.
WHITT, W., Representation and Approximation of Noncooperative Sequential Games, SIAM Journal on Control and Optimization, Vol. 18, pp. 33–48, 1980.
NOWAK, A. S., Existence of Equilibrium Stationary Strategies in Discounted Noncooperative Stochastic Games with Uncountable State Space, Journal of Optimization Theory and Applications. Vol. 45, pp. 591–602, 1985.
JAŚKIEWICZ, A., An Approximation Approach to Ergodic Semi-Markov Control Processes, Mathematical Methods of Operations Research, Vol. 54, pp. 1–19, 2001.
MEYN, S. P., and TWEEDIE, R. L., Computable Bounds for Geometric Convergence Rates of Markov Chains, Annals of Applied Probability, Vol. 4, pp. 981–1011, 1994.
BERTSEKAS, D. P., and SHREVE, S. E., Stochastic Optimal Control: The Discrete Time Case, Academic Press, New York, NY, 1978.
NEVEU, J., Mathematical Foundations of the Calculus of Probability, Holden-Day, San Francisco, California, 1965.
JAŚKIEWICZ, A., On the Equivalence of Two Expected Average Cost Criteria for Semi-Markov Control Processes,Mathematics of Operations Research, Vol. 29, pp. 326–338, 2004.
FEINBERG, E. A., Constrained Semi-Markov Decision Processes with Average Rewards, Mathematical Methods of Operations Research, Vol. 39, pp. 257–288, 1994.
JAŚKIEWICZ, A., On Strong 1-Optimal Policies in Markov Control Processes with Borel State Spaces, Bulletin of the Polish Academy of Sciences, Mathematics Series, Vol. 48, pp. 439–450, 2000.
MEYN, S. P., and TWEEDIE, R. L., Markov Chains and Stochastic Stability, Springer Verlag, New York, NY, 1993.
HERNÁNDEZ-LERMA, O., Adaptive Markov Control Processes, Springer Verlag, New York, NY, 1989.
DUNFORD, N., and SCHWARTZ, J. T., Linear Operators, Part 1: General Theory, Wiley Interscience Publishers, New York, NY, 1958.
WARGA, J., Optimal Control of Differential and Functional Equations, Academic Press, New York, NY, 1977.
NOWAK, A. S., A Generalization of Ueno’s Inequality for n-Step Transition Probabilities, Applicationes Mathematice, Vol. 25, pp. 295–299, 1998.
Author information
Authors and Affiliations
Additional information
Communicated by D. A. Carlson
The authors thank an anonymous referee for constructive comments. This work is supported by MEiN Grant 1P03A 01030.
Rights and permissions
About this article
Cite this article
Jaśkiewicz, A., Nowak, A.S. Approximation of Noncooperative Semi-Markov Games. J Optim Theory Appl 131, 115–134 (2006). https://doi.org/10.1007/s10957-006-9128-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-006-9128-2