Abstract
In this paper, by introducing the notion of γ-convex set, we distinguish a wider class of discrete control systems in which the global maximum principle holds. A new type of variation of control for such classes of discrete control systems is proposed and stronger global maximum principle and second-order optimality condition expressed in terms of a singular control of new type are obtained. Generalizing the notion of the relative interior of sets, we obtain an optimality condition for discrete systems in the form of an equality, which we call Pontryagin’s equation.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko, Mathematical Theory of Optimal Processes (Nauka, Moscow, 1969) [in Russian].
L. I. Rozonoe´r, “Pontryagin maximum principle in the theory of optimal systems. III,” Avtomat. Telemekh. 20 (12), 1561–1578 (1959) [Automat. Remote Control 20 (12), 1517–1532 (1959)].
A. G. Butkovskii, “Necessary and sufficient optimality conditions for sampled-data control systems,” Avtomat. Telemekh. 24 (8), 1056–1064 (1963).
B. K. Jordan and E. Polak, “Theory of class of discrete optimal control system,” J. Electronics Control 17 (6), 697–711 (1964).
R. F. Gabasov and F. M. Kirillova, Qualitative Theory of Optimal Processes (Nauka, Moscow, 1971) [in Russian].
B. N. Pshenichnyi, Necessary Conditions for an Extremum (Nauka, Moscow, 1969) [in Russian].
A. I. Propoi, Elements of the Theory of Optimal Discrete Processes (Nauka, Moscow, 1973) [in Russian].
B. Sh. Mordukhovich, “Optimal control of discrete systems,” Differ. Uravn. 9 (4), 727–734 (1973).
A. I. Propoi, “The maximum principle for discrete control systems,” Avtomat. Telemekh. 26 (7), 1177–1187 (1965) [Automat. Remote Control 26 (7), 1167–1177 (1965)].
H. Halkin, “A maximum principle of Pontryagin maximum principle type for systems described by nonlinear difference equations,” SIAM J. Control 4 (1), 90–111 (1966).
J. M. Holtzman, “Convexity and the maximum principle for discrete systems,” IEEE Trans. Automatic Control AC-11, 30–35 (1966).
R. F. Gabasov and F. M. Kirillova, “Necessary optimality conditions of equality type in discrete systems,” Differ. Uravn. 9 (3), 542–546 (1973).
V. G. Boltyanskii, Optimal Control of Discrete Systems (Nauka, Moscow, 1973) [in Russian].
L. I. Minchenko, “Necessary optimality conditions for certain classes of discrete control systems,” Differ. Uravn. 12 (7), 1211–1218 (1976).
A. Ya. Dubovitskii, “The discrete principle of the maximum,” Avtomat. Telemekh., No. 10, 55–71 (1978) [Automat. Remote Control 39 (10), 1450–1465 (1979)].
R. B. Vinter, “Optimality and Sensitivity of Discrete Time Processes,” Control Cybernet. 17 (2-3), 191–211 (1988).
A. J. Zazlovski, Stability of the Turnpike Phenomenon in Discrete-Time Optimal Control Problems (Springer, Cham, 2014).
R. Gabasov and F. M. Kirillova, “Theory of necessary conditions for optimality for discrete systems,” Avtomat. Telemekh., No. 12, 39–47 (1969) [Automat. Remote Control, No. 12, 1921–1928 (1969)].
L. T. Ashchepkov, “On necessary conditions for high-order optimality for singular controls of discrete systems,” Differ. Uravn. 8 (10), 1857–1867 (1972).
S. Ya. Gorokhovik, “Necessary conditions for optimality of singular controls in discrete systems with terminal constraints,” Vestsi Akad. Navuk BSSR Ser. Fiz.-Mat. Navuk, No. 3, 35–40 (1985).
M. J. Mardanov, T. K. Melikov, and N. I. Mahmudov, “On necessary optimality conditions in discrete control systems,” Internat. J. Control 88 (10), 2097–2106 (2015).
Z. T. Mingaleeva and I. A. Shvartsman, “Second-order necessary optimality conditions for a discrete optimal control problem,” Differ. Uravn. 50 (12), 1640–1646 (2014) [Differ. Equations 50 (12), 1643–1649 (2014)].
M. J. Mardanov and T. K. Melikov, “A method for studying the optimality of controls in discrete systems,” Proc. Inst.Math.Mech. Natl. Acad. Sci. Azerb. 40 (2), 5–13 (2014).
E. Steinitz, “Bedingt konvergente Reihen und konvexe Systeme,” J. Reine Angew. Math. 143, 128–176 (1913).
T. K. Melikov, Necessary Optimality Conditions for Distributed-Parameter Systems, Available from VINITI, No. 2637–79 (1979) [in Russian].
A. V. Arutyunov and B. Marinkovich, “The necessary optimality conditions in the discrete optimal control problem,” Vestnik Moskov. Univ. Ser. XV Vychisl. Mat. Kibernet., No. 1, 43–48 (2005).
R. Hilscher and V. Zeidan, “Discrete optimal control: second order optimality conditions,” J. Difference Equ. Appl. 8 (10), 875–896 (2002).
B. Marinkovic, “Optimality conditions for discrete optimal control problems,” Optim.Methods Softw. 22 (6), 959–969 (2007).
K. B. Mansimov, “Optimality of quasisingular controls in Goursat-Darboux systems,” Differ.Uravn. 22 (11), 1952–1960 (1986). [Differ. Equations textbf22 (11), 1358–1365 (1986)].
M. J. Mardanov, K. B. Mansimov, and T. K. Melikov, Study of Singular Controls and Necessary Optimality Conditions of Second Order in Delay Systems (Izd. E´lm, Baku, 2013) [in Russian].
Author information
Authors and Affiliations
Corresponding authors
Additional information
Russian Text © The Author(s), 2019, published in Matematicheskie Zametki, 2019, Vol. 106, No. 3, pp. 409–423.
Rights and permissions
About this article
Cite this article
Mardanov, M.J., Melikov, T.K. & Malik, S.T. On the Theory of Optimal Processes in Discrete Systems. Math Notes 106, 390–401 (2019). https://doi.org/10.1134/S0001434619090086
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0001434619090086