Abstract
We consider the optimal control problem for a linear discrete stochastic system. The optimality criterion is the probability for the first coordinate of the system to fall into a given neighborhood of zero in time not exceeding a predefined value. The problem reduces to an equivalent stochastic optimal control problem with probabilistic terminal criterion. The latter can be solved analytically with dynamical programming. We give sufficient conditions for which the resulting optimal control turns out to be also optimal with respect to the quantile criterion.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Malyshev, V.V. and Kibzun, A.I., Analiz i sintez vysokotochnogo upravleniya letatel’nymi apparatami (Analysis and Synthesis of High Accuracy Control for Flying Vehicles), Moscow: Mashinostroenie, 1987.
Zubov, V.I., Lektsii po teorii upravleniya (Lectures in Control Theory), Moscow: Nauka, 1975.
Afanas’ev, V.N., Kolmanovskii, V.B., and Nosov, V.R., Matematicheskaya teoriya konstruirovaniya sistem upravleniya (Mathematical Theory of Constructing Control Systems), Moscow: Vysshaya Shkola, 2003.
Krasovskii, N.N., On Optimal Control under Random Perturbations, Prikl. Mat. Mekh., 1960, vol. 24, no. 1, pp. 64–79.
Kan, Yu.S., Control Optimization by the Quantile Criterion, Autom. Remote Control, 2001, vol. 62, no. 5, pp. 746–757.
Vishnaykov, V.B. and Kibzun, A.I., Deterministic Equivalents for the Problems of Stochastic Programming with Probabilistic Criteria, Autom. Remote Control, 2006, vol. 67, no. 6, pp. 945–961.
Kan, Yu.S. and Kibzun, A.I., Zadachi stokhasticheskogo programmirovaniya s veroyatnostnymi kriteriyami (Stochastic Programming Problems with Probabilistic Criteria), Moscow: Fizmatlit, 2009.
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © V.M. Azanov, 2014, published in Avtomatika i Telemekhanika, 2014, No. 10, pp. 39–51.
Rights and permissions
About this article
Cite this article
Azanov, V.M. Optimal control for linear discrete systems with respect to probabilistic criteria. Autom Remote Control 75, 1743–1753 (2014). https://doi.org/10.1134/S0005117914100038
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0005117914100038