Abstract
We study the Nash equilibria of a class of two-person nonlinear, deterministic differential games where the players are weakly coupled through the state equation and their objective functionals. The weak coupling is characterized in terms of a small perturbation parameter ε. With ε=0, the problem decomposes into two independent standard optimal control problems, while for ε≠0, even though it is possible to derive the necessary and sufficient conditions to be satisfied by a Nash equilibrium solution, it is not always possible to construct such a solution. In this paper, we develop an iterative scheme to obtain an approximate Nash solution when ε lies in a small interval around zero. Further, after requiring strong time consistency and/or robustness of the Nash equilibrium solution when at least one of the players uses dynamic information, we address the issues of existence and uniqueness of these solutions for the cases when both players use the same information, either closed loop or open loop, and when one player uses open-loop information and the other player uses closed-loop information. We also show that, even though the original problem is nonlinear, the higher (than zero) order terms in the Nash equilibria can be obtained as solutions to LQ optimal control problems or static quadratic optimization problems.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Başar, T., andOlsder, G. J.,Dynamic Noncooperative Game Theory, Academic Press, New York, New York, 1982.
Bensoussan, A.,Perturbation Methods in Optimal Control, John Wiley and Sons, New York, New York, 1988.
Pervozvanskii, A. A., andGaitsgori, G.,Theory of Suboptimal Decisions, Kluwer Academic Press, Boston, Massachusetts, 1988.
Srikant, R., andBaşar, T.,Optimal Solutions in Weakly Coupled Multiple Decision Maker Markov Chains with Nonclassical Information, Proceedings of the 28th IEEE Conference on Decision and Control, Tampa, Florida, pp. 168–173, 1989.
Başar, T., andSrikant, R.,Approximation Schemes for Stochastic Teams with Weakly Coupled Agents, Proceedings of the 11th IFAC World Congress, Tallinn, USSR, Vol. 3, pp. 7–12, 1990.
Başar, T., andSrikant, R.,Stochastic Differential Games with Weak Spatial and Strong Informational Coupling, Paper Presented at the 9th International Conference on Analysis and Optimization of Systems, Antibes, France, 1990.
Tikhonov, A. N., Vasil'eva, A. B., andSveshnikov, A. G.,Differential Equations, Springer-Verlag, New York, New York, 1985.
Özgüner, ü., andPerkins, W. R.,A Series Solution to the Nash Strategy for Large-Scale Interconnected Systems, Automatica, Vol. 13, pp. 313–315, 1977.
Başar, T.,Time Consistency and Robustness of Equilibria in Noncooperative Dynamic Games, Dynamic Policy Games in Economics, Edited by F. Van Der Ploeg and A. J. Zeeuw, North-Holland, Amsterdam, Holland, pp. 9–54, 1989.
Gajic, Z., Petkovski, D., andShen, X.,Singularly Perturbed and Weakly Coupled Linear Control Systems: A Recursive Approach, Springer-Verlag, New York, New York, 1989.
Başar, T.,Informationally Nonunique Equilibrium Solutions in Differential Games, SIAM Journal on Control and Optimization, Vol. 15, pp. 636–660, 1977.
Author information
Authors and Affiliations
Additional information
Communicated by G. Leitmann
This research was supported in part by the US Department of Energy under Grant DE-FG-02-88-ER-13939.
Rights and permissions
About this article
Cite this article
Srikant, R., Başar, T. Iterative computation of noncooperative equilibria in nonzero-sum differential games with weakly coupled players. J Optim Theory Appl 71, 137–168 (1991). https://doi.org/10.1007/BF00940044
Issue Date:
DOI: https://doi.org/10.1007/BF00940044