Abstract
The paper is devoted to the problem of stabilizing a linear stochastic control system. The quadratic cost functional measures the total loss caused by deviation from the fixed (target) levels and control trajectories, as well as a decision-maker’s time preferences expressed in the discount function. The long-term impacts of the use of decision-making, optimal on average, over an infinite-time horizon are taken as estimates of the deviation of the optimal trajectory from its target in the mean square sense and with the probability of 1.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
C. C. Holt, “Linear decision rules for economic stabilization and growth,” Quart. J. Econ. 76, 20–45 (1962).
S. J. Turnovsky, Macroeconomic Analysis and Stabilization Policy (Cambridge Univ. Press, Cambridge, MA, 1977).
E. S. Palamarchuk, “Risk estimation for linear economic systems under negative time preferences,” Ekon. Mat. Metody 49(3), 99–116 (2013).
J. K. Sengupta, “Optimal stabilization policy with a quadratic criterion function,” Rev. Econ. Studies 37, 127–145 (1970).
T. A. Belkina and E. S. Palamarchuk, “On stochastic optimality for a linear controller with attenuating disturbances,” Autom. Remote Control 74, 628–641 (2013).
R. Neck, “Optimal stabilizing and destabilizing ‘stabilization’ policies,” in Cybernetics and Systems’86, Proceedings of the 8th European Meeting on Cybernetics and Systems Research (Springer, Berlin, 1986).
A. H. Gelb, “Optimal control and stabilization policy: an application to the coffee economy,” Rev. Econ. Studies 44, 95–109 (1977).
T. A. Belkina, Yu. M. Kabanov, and E. L. Presman, “On a stochastic optimality of the feedback control in the LQG-problem,” Theory Probabil. Its Appl. 48, 592–603 (2003).
H. Kwakernaak and R. Sivan, Linear Optimal Control Systems (Wiley-Interscience, New York, 1972).
E. S. Palamarchuk, “Asymptotic behavior of the solution to a linear stochastic differential equation and almost sure optimality for a controlled stochastic process,” Comput. Math. Math. Phys. 54, 83–96 (2014).
M. H. A. Davis, Linear Estimation and Stochastic Control (Chapman and Hall, London, 1977).
V. Dragan, T. Morozan, and A.-M. Stoica, Mathematical Methods in Robust Control of Linear Stochastic Systems (Springer, New York, 2006).
L. V. Adrianova, Introduction to Linear Systems of Differential Equations (American Mathematical Society, Providence, 1995; St.-Peterb. Univ., St.-Petersburg, 1992).
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © E.S. Palamarchuk, 2015, published in Matematicheskoe Modelirovanie, 2015, Vol. 27, No. 1, pp. 3–15.
Rights and permissions
About this article
Cite this article
Palamarchuk, E.S. Stabilization of linear stochastic systems with a discount: Modeling and estimation of the long-term effects from the application of optimal control strategies. Math Models Comput Simul 7, 381–388 (2015). https://doi.org/10.1134/S2070048215040080
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S2070048215040080