Abstract
This paper studies the reliable H∞ control on stochastic delayed Markovian jump systems (SDMJSs) with asynchronous jumped actuator failure and uncertain transition rates (TRs). It is assumed that the actuator failure occurs randomly under a Markov process with its jumping mode different from the system’s one. A generalized functional Itô’s formula for the closed-loop SDMJSs with mixed asynchronous Markovian jump modes (AMJMs) is successfully established. By the generalized functional Itô’s formula and the mixed-mode-dependent Lyapunov functionals, a sufficient delay-dependent condition of the reliable H∞ controller design for the SDMJSs with mixed AMJMs is proposed via matrix manipulation and a relaxation method. Finally, an example on VTOL (vertical take-off and landing) helicopter system is given to demonstrate the feasibility and effectiveness of the presented controller design scheme.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
V. Kolmanovskii and A. Myshkis, Introduction to the Theory and Applications of Functional Differential Equations, Kluwer, 1999.
X. Mao, Stochastic Differential Equations and Applications, 2nd ed., Horwood Publishing, Chichester, UK, 2007.
X. Mao and C. Yuan, Stochastic Differential Equations with Markovian Switching, Imperial College Press, 2006.
X. Zong, G. Yin, L. Y. Wang, T. Li, and J.-F. Zhang, “Stability of stochastic functional differential systems using degenerate Lyapunov functionals and applications,” Automatica, vol. 91, pp. 197–207, 2018.
L. Huang and X. Mao, “Delay-dependent exponential stability of neutral stochastic delay systems,” IEEE Transactions on Automatic Control, vol. 54, no. 1, pp. 147–152, 2009.
B. Dupire, “Functional Itô calculus,” Bloomberg portfolio research paper no. 2009-04-FRONTIERS, 2009. DOI: https://doi.org/10.2139/ssrn.1435551
R. Cont and D.-A. Fournié, “Change of variable formulas for non-anticipative functionals on path space,” Journal of Functional Analysis, vol. 259, no. 4, pp. 1043–1072, 2010.
D. H. Nguyen and G. Yin, “Stability of stochastic functional differential equations with regime-switching: Analysis using dupire’s functional Itô formula,” Potential Analysis, pp. 1–19, 2019.
D. Applebaum, Lévy Processes and Stochastic Calculus, 2nd ed., Cambridge University Press, 2009.
X. Mao, “Exponential stability of stochastic delay interval systems with Markovian switching,” IEEE Transactions on Automatic Control, vol. 47, no. 10, pp. 1604–1612, 2002.
X. Mao, Y. Shen, and C. Yuan, “Almost surely asymptotic stability of neutral stochastic differential delay equations with Markovian switching,” Stochastic Processes & their Applications, vol. 118, no. 8, pp. 1385–1406, 2008.
P. Shi and F. Li, “A survey on Markovian jump systems: modeling and design,” International Journal of Control, Automation and Systems, vol. 13, no. 1, pp. 1–16, 2015.
W. Qi, G. Zong, and H. R. Karim, “Observer-based adaptive SMC for nonlinear uncertain singular semi-markov jump systems with applications to DC motor,” IEEE Transactions on Circuits & Systems I Regular Papers, vol. 65, no. 9, pp. 5251–5273, 2019.
R. Sakthivel, H. R. Karimi, M. Joby, and S. Santra, “Resilient sampled-data control for Markovian jump systems with an adaptive fault-tolerant mechanism,” IEEE Transactions on Circuits & Systems II Express Briefs, vol. 64, no. 11, pp. 1312–1316, 2017.
W. C. Zou, P. Shi, Z. R. Xiang, and Y. Shi, “Consensus tracking control of switched stochastic nonlinear multiagent systems via event-triggered strategy,” IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 3, pp. 1036–1045, 2019.
W. C. Zou, P. Shi, Z. R. Xiang, and Y. Shi, “Finite-time consensus of second-order switched nonlinear multiagent systems,” IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 5, pp. 1757–1762, 2019.
L. W. Li and G. H. Yang, “Stabilisation of Markov jump systems with input quantisation and general uncertain transition rates,” IET Control Theory & Applications, vol. 11, no. 4, pp. 516–523, 2016.
Z. Chen, Z. Cao, Q. Huang, and S. L. Campbell, “Reliable ℌ∞ control on saturated linear Markov jump system with uncertain transition rates and asynchronous jumped actuator failure,” Journal of the Franklin Institute, vol. 355, no. 9, pp. 3853–3872, 2018.
M. Karan, P. Shi, and C. Y. Kaya, “Transition probability bounds for the stochastic stability robustness of continuous-and discrete-time Markovian jump linear systems,” Automatica, vol. 42, no. 12, pp. 2159–2168, 2006.
J. Xiong and J. Lam, “Robust H2 control of Markovian jump systems with uncertain switching probabilities,” International Journal of Systems Science, vol. 40, no. 3, pp. 255–265, 2009.
Y. Guo, “Improved synthesis method for Markov jump systems with uncertain transition rates,” Journal of the Franklin Institute, vol. 352, no. 12, pp. 6011–6018, 2015.
E. Carlos, T. Alexandre, and A. Karina, “Mode-independent ℌ∞ filter for Markovian jump linear systems,” IEEE Trans. Autom. Control, vol. 51, no. 11, pp. 1837–1841, 2006.
Y. Ding and H. Liu, “Stability analysis of continuous-time Markovian jump time-delay systems with time-varying transition rates,” Journal of the Franklin Institute, vol. 353, no. 11, pp. 2418–2430, 2016.
Y. Guo and Z. Wang, “Stability of Markovian jump systems with generally uncertain transition rates,” Journal of the Franklin Institute, vol. 350, no. 9, pp. 2826–2836, 2013.
Y. Kao, J. Xie, and C. Wang, “Stabilization of singular Markovian jump systems with generally uncertain transition rates,” IEEE Transactions on Automatic Control, vol. 59, no. 9, pp. 2604–2610, 2014.
N. K. Kwon, I. S. Park, and P. Park, “ℌ∞ control for singular Markovian jump systems with incomplete knowledge of transition probabilities,” Applied Mathematics and Computation, vol. 295, pp. 126–135, 2017.
B. Jiang, Y. Kao, H. R. Karimi, and C. Gao, “Stability and stabilization for singular switching semi-Markovian jump systems with generally uncertain transition rates,” IEEE Transactions on Automatic Control, vol. 63, no. 11, pp. 3919–3926, 2018.
Z. Yan, Y. Song, and X. Liu, “Finite-time stability and stabilization for Itô-type stochastic Markovian jump systems with generally uncertain transition rates,” Applied Mathematics and Computation, vol. 321, pp. 512–525, 2018.
I. S. Park, N. K. Kwon, and P. Park, “Dynamic outputfeedback control for singular Markovian jump systems with partly unknown transition rates,” Nonlinear Dynamics, vol. 95, no. 4, pp. 3149–3160, 2019.
H. Shen, L. Su, and J. H. Park, “Reliable mixed ℌ∞/passive control for T-S fuzzy delayed systems based on a semi-Markov jump model approach,” Fuzzy Sets and Systems, vol. 314, pp. 79–98, 2017.
J. Cheng, B. Wang, J. H. Park, and W. Kang, “Sampleddata reliable control for T-S fuzzy semi-Markovian jump system and its application to single-link robot arm model,” IET Control Theory & Applications, vol. 11, no. 12, pp. 1904–1912, 2017.
Y. Wei, J. Qiu, H.-K. Lam, and L. Wu, “Approaches to T-S fuzzy-affine-model-based reliable output feedback control for nonlinear Itô stochastic systems,” IEEE Transactions on Fuzzy Systems, vol. 25, no. 3, pp. 569–583, 2016.
D. Zhai, L. An, D. Ye, and Q. Zhang, “Adaptive reliable ℌ∞ static output feedback control against Markovian jumping sensor failures,” IEEE Transactions on Neural Networks & Learning Systems, vol. 29, no. 3, pp. 631–644, 2018.
Y. M. Fu and C. J. Li, “Parametric method for spacecraft trajectory tracking control problem with stochastic thruster fault,” IET Control Theory & Applications, vol. 10, no. 17, pp. 2331–2338, 2016.
X. Yao, L. Wu, and W. X. Zheng, “Fault detection filter design for Markovian jump singular systems with intermittent measurements,” IEEE Transactions on Signal Processing, vol. 59, no. 7, pp. 3099–3109, 2011.
L. Zhang, “ℌ∞ estimation for discrete-time piecewise homogeneous Markov jump linear systems,” Automatica, vol. 45, no. 11, pp. 2570–2576, 2009.
Z. Gu, J. Liu, C. Peng, and E. Tian, “Reliable control for interval time-varying delay systems subjected to actuator saturation and stochastic failure,” Optimal Control Applications and Methods, vol. 33, no. 6, pp. 739–750, 2012.
Z.G. Wu, P. Shi, H. Su, and J. Chu, “Asynchronous l2-l∞ filtering for discrete-time stochastic Markov jump systems with randomly occurred sensor nonlinearities,” Automatica, vol. 50, no. 1, pp. 180–186, 2014.
Z. Xu, H. Su, P. Shi, and Z. G. Wu, “Asynchronous ℌ∞ control of semi-Markov jump linear systems,” Applied Mathematics and Computation, vol. 349, pp. 270–280, 2019.
Y. Y. Cao and J. Lam, “Robust ℌ∞ control of uncertain Markovian jump systems with time-delay,” IEEE Transactions on Automatic Control, vol. 45, no. 1, pp. 77–83, 2000.
W. H. Chen, J. X. Xu, and Z. H. Guan, “Guaranteed cost control for uncertain Markovian jump systems with mode-dependent time-delays,” IEEE Transactions on Automatic Control, vol. 48, no. 12, pp. 2270–2277, 2003.
S. Xu, J. Lam, and X. Mao, “Delay-dependent ℌ∞ control and filtering for uncertain Markovian jump systems with time-varying delays,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 54, no. 9, pp. 2070–2077, 2007.
X. Mao, “Stabilization of continuous-time hybrid stochastic differential equations by discrete-time feedback control,” Automatica, vol. 49, no. 12, pp. 3677–3681, 2013.
P. Shi, E. K. Boukas, and R. K. Agarwal, “Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters,” IEEE Transactions on Automatic Control, vol. 44, no. 8, pp. 1592–1597, 1999.
S. H. Kim, “Stochastic stability and stabilization conditions of semi-Markovian jump systems with mode transition-dependent sojourn-time distributions,” Information Sciences, vol. 385, pp. 314–324, 2017.
A. Skorokhod, Asymptotic Methods in the Theory of Stochastic Differential Equations, American Mathematical Soc., 1989.
M. K. Ghosh and A. Goswami, “Risk minimizing option pricing in a semi-Markov modulated market,” SIAM Journal on Control and Optimization, vol. 48, no. 3, pp. 1519–1541, 2009.
D. R. Baños, F. Cordoni, G. Di Nunno, L. Di Persio, and E. Røse, “Stochastic systems with memory and jumps,” Journal of Differential Equations, vol. 266, no. 9, pp. 5772–5820, 2019.
B. Song, J. H. Park, Z. G. Wu, and X. Li, “New results on delay-dependent stability analysis and stabilization for stochastic time-delay systems,” International Journal of Robust and Nonlinear Control, vol. 24, no. 16, pp. 2546–2559, 2014.
Y. Kao, J. Xie, and C. Wang, “Stabilisation of mode-dependent singular Markovian jump systems with generally uncertain transition rates,” Applied Mathematics and Computation, vol. 245, pp. 243–254, 2014.
Y. Guo, “A convex method of robust controller design for Markovian jump systems with uncertain transition rates,” Asian Journal of Control, vol. 16, no. 3, pp. 928–935, 2014.
G. Zhuang and Y. Wei, “Non-fragile ℌ∞ filter design for uncertain stochastic nonlinear time-delay Markovian jump systems,” Circuits, Systems, and Signal Processing, vol. 33, no. 11, pp. 3389–3419, 2014.
H. Ren, G. Zong, and H. R. Karimi, “Asynchronous finite-time filtering of Markov jump nonlinear systems and its applications,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2019. DOI: https://doi.org/10.1109/TSMC.2019.2899733
B. P. Jiang, Y. G. Kao, H. R. Karimi, and C. C. Gao, “Stability and stabilization for singular switching semi-Markovian jump systems with generally uncertain transition rates,” IEEE Transactions on Automatic Control, vol. 63, no. 11, pp. 3919–3926, 2018.
G. Zong and H. Ren, “Guaranteed cost finite-time control for semi-Markov jump systems with event-triggered scheme and quantization input,” International Journal of Robust and Nonlinear Control, vol. 29, no. 15, pp. 5251–5273, 2019.
G. Zong, W. Qi, and H. R. Karimi, “L1 control of positive semi-Markov jump systems with state delay,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020. DOI: https://doi.org/10.1109/TSMC.2020.2980034
G. Zong, Y. Li, and H. Sun, “Composite anti-disturbance resilient control for Markovian jump nonlinear systems with general uncertain transition rate,” Science China Information Sciences, vol. 62, pp. 022205:1–18, 2019.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Recommended by Associate Editor Guangdeng Zong under the direction of Editor Hamid Reza Karimi. This work was supported by the Fundamental Research Funds for the Central Universities of the Southwest Minzu University (Grant no. 2018NQN03). The authors are truly grateful to the editor and the anonymous reviewers for their valuable suggestions.
Wenpin Luo received her B.S. degree from Sichuan Normal University, Chengdu, China, in 2004 and an M.S. degree from University of Electronic Science and Technology of China, Chengdu, China, in 2007, all in applied mathematics. She is currently an Associate Professor with the Department of Arts and Sciences, Chengdu College of University of Electronic Science and Technology of China, Chengdu, China. From 2018 to 2019, she was a visiting scholar at the University of Waterloo. Her current research interests include neural networks and stochastic control systems.
Jun Yang received his B.S. degree from Leshan Normal University, Leshan, China, in 2004 and a Ph.D. degree from University of Electronic Science and Technology of China, Chengdu, China, in 2009, all in applied mathematics. He is currently a Professor with the College of Electrical and Information Engineering, Southwest Minzu University, Chengdu, China. From 2018 to 2019, he was a visiting scholar at the University of Waterloo. His current research interests include fuzzy and stochastic control systems. He is an active reviewer for many international journals.
Xinzhi Liu received his B.Sc. degree in mathematics from Shandong Normal University, Jinan, China, in 1982, and his M.Sc. and Ph.D. degrees, in applied mathematics, from the University of Texas, Arlington, Texas, USA, in 1987 and 1988, respectively. He was a Post-Doctoral Fellow at the University of Alberta, Edmonton, Alberta, Canada, from 1988 to 1990. He joined the Department of Applied Mathematics, University of Waterloo, Waterloo, Canada, as an Assistant Professor in 1990, where he became an Associate Professor and a Full Professor, in 1994 and 1997, respectively. His research areas include systems analysis, stability theory, hybrid dynamical systems, impulsive control, complex dynamical networks, and communication security. He is the author or coauthor of over 300 research articles and two research monographs and twenty edited books.
Rights and permissions
About this article
Cite this article
Luo, W., Yang, J. & Liu, X. Reliable H∞ Control on Stochastic Delayed Markovian Jump System with Asynchronous Jumped Actuator Failure. Int. J. Control Autom. Syst. 19, 618–631 (2021). https://doi.org/10.1007/s12555-020-0154-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12555-020-0154-x