Abstract
This article aims to investigate the problem of robust finite-time output feedback \( H_\infty \) control for stochastic jump systems with incomplete transition rates. Firstly, for the nominal stochastic jump systems, the sufficient conditions for the finite-time boundedness and finite-time output feedback stabilization are developed, respectively. Then, a robust finite-time \( H_\infty \) output feedback controller is designed by means of linear matrix inequalities. A key point of this work is to relax the special requirement of completely known transition rates to more general form that mixes two cases of completely known and completely unknown transition rates. Finally, a numerical example is given to demonstrate the applicability of the main results.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Owing to the existence of abrupt changes in practical applications, many systems can be effectively modeled as stochastic jump systems, such as manufacturing systems [18], economic systems [4], communication systems [2], and so on. Similar to a switched system [19], a stochastic jump system consists of a family of continuous or discrete time subsystems and a set of Markovian chain that orchestrates the switching between them. Recently, stochastic jump systems have attracted considerable attention and a large number of results have been published. For example, please see [11–13, 15, 23] and references therein. In particular, the problem of \( H_\infty \) filtering for Markovian jump singular system was considered and a weighted gain was reached under a quantisation condition in [15]. After that, more results of filtering for discrete time stochastic Markov jump systems were reported in [6, 7, 27]. Using the linear matrix inequality approach, a number of interesting results on Markovian jump neural networks systems with time delay have appeared in [25, 26].
It is well acknowledged that stochastic stability, defined in an infinite-time interval, is one of the crucial issues in the study of stochastic jump systems [20, 30, 31]. To some extent, the stochastic stability plays a critical role in reality. However, in some cases, the stability property in infinite time is not acceptable. For instance, the control process of a robot arm is not allowed to be beyond some given threshold in a finite-time interval [23]. To deal with this situation, the notion of finite-time stability was presented by Peter Dorato [8]. Later on, the finite-time stability was also extended to stochastic jump systems, and many relevant results have been derived [22]. Moreover, the transition rates determine the performance of systems [9, 14, 28, 29]. Usually, the assumption that the transition rates are completely known or bounded may lead to some conservativeness. Actually, the information of transition rates might not be exactly known in many practical control problems, because it is difficult and expensive to gain precisely the information of transition rates or even the bounds. Thus, in recent years, much attention has been focused on the study of stochastic jump systems with incomplete transition rates [30, 31]. The problem of robust finite-time \( H_\infty \) control for stochastic jump systems was discussed in [16]. It is required that the bounds of transition rates are known. [30] discussed the stochastic stabilization problem of stochastic jump systems with partly unknown transition probabilities by the fixed weighting matrices method. To a certain degree, the results relax the traditional assumptions that all the transition rates or the bounds must be completely known.
In addition, when the state is measurable, the state feedback \(H_{\infty }\) control problem has been widely explored, and a large amount of useful and interesting achievements have been reported in the literature [32, 33]. It should be pointed out that the requirement of the availability of the state at each time in state feedback control is shown to be more conservative because state is immeasurable in real world [5, 10, 24]. Therefore, it is extremely imperative and significant to construct a \(H_{\infty }\) output feedback controller. Meanwhile, it is difficult to obtain the conditions in the form of linear matrix inequalities ensuring the finite-time \( H_\infty \) output feedback stabilization.
To the best of our knowledge, the synthesis issue of robust finite-time output feedback \(H_{\infty }\) control for stochastic jump systems with incomplete transition rates has not been fully investigated so far. This is mainly due to the difficulty in extending the existing results to stochastic jump systems with incomplete transition rates. This motivates the present study.
In this paper, we study the problem of robust finite-time output feedback \( H_\infty \) control for stochastic jump systems with incomplete transition rates. The main contribution lies in three aspects. First, some sufficient conditions are provided to guarantee the finite-time boundedness and finite-time output feedback stabilization. Second, a robust finite-time \( H_\infty \) output feedback controller is designed. Third, we do not introduce any confinement to the unknown transition rates, which is less conservative. Finally, a practical example of a single-link robot arm system is given to demonstrate the applicability of the main results.
Notations For real symmetric matric \(A\), the notation \(A\ge 0\) (\(A>0\)) means that the matrix \(A\) is positive semi-definite (positive definite). \(A^T\) and \(A^{-1}\) denote, respectively, the transpose of a matrix \(A\) and the inverse of a matrix \(A\). \(\lambda _{\max }(B)\) (\(\lambda _{\min }(B)\)) is the maximum (minimum) eigenvalue of a matrix \(B\). diag\(\{A, B\}\) represents the block diagonal matrix of \(A\) and \(B\). \(I \) is the unit matrix with appropriate dimension, and in a matrix, the term of symmetry is stated by the asterisk \(*\). \( \mathbb {R}^n\) stands for the \(n\)-dimensional Euclidean space, \(\mathbb {R}^{n\times m}\) is the set of all \(n\times m\) real matrices, and \(\mathcal {M}=\{1, 2, \ldots , N\}\) means a set of positive numbers. \(\Vert *\Vert \) denotes the Euclidean norm of vectors. \(\ L_2^n[0, +\infty )\) is the space of \(n\)-dimensional square integrable function vector over \([0, +\infty )\). \({ \Omega } \) is the sample space, \(\mathcal {F}\) is the algebra of events, and \(\mathcal {P}\) is the probability measure defined on \(\mathcal {F}\). \(\mathbb {E}\{\cdot \}\) denotes the mathematics expectation of the stochastic process or vector.
2 Problem Formulation and Preliminaries
Consider the following stochastic jump system in the probability space (\({ \Omega }\), \(\mathcal {F}\), \(\mathcal {P}\)):
where \(x(t)\in {\mathbb {R}^{n}}\) is the state vector, \(u(t)\in {\mathbb {R}^{m}}\) is the control input, \(v(t)\in {L_2^n[0, +\infty )}\) is an arbitrary external disturbance, \(y(t)\in {\mathbb {R}^{p}}\) is the measure output, \(z(t)\in {\mathbb {R}^{q}}\) is the control output, \(W(t)\in \mathbb {R}\) is a standard Wiener process, which is independent of the Markovian process, \(x_{0}, r_{0}\), and \(t_{0}\), respectively, represent the initial state, initial mode, and initial time. {\(r_{t}, t\ge 0\)} is a Markovian process which takes values in a finite space \(\mathcal {M}=\{1, 2, \ldots , N\}\) with the transition rate matrix \(\Pi =\{\pi _{ij}\}\) (\(i, j\in \mathcal {M}\) ) given by
where \(\Delta t>0\), and \(\displaystyle {}\lim _{\Delta t\rightarrow \,0}\frac{o(\Delta t)}{\Delta t}=0\). \(\pi _{ij}\ge 0\) (\(i,j\in \mathcal {M}, i\ne j\) ) is the transition rates from mode \(i\) at time \(t\) to mode \(j\) at time \(t+\Delta t\), and \(\displaystyle {}{\sum _{j=1,i\ne j}^{N}}{\pi _{ij}}=-\pi _{ii}\). \(A(r_t)\), \(B(r_t)\), \(E_x(r_t)\), \(C_y(r_t)\), \(C_z(r_t)\), \(D_z(r_t)\), \(E_z(r_t)\) and \(G(r_t)\) are known constant matrices with appropriate dimensions. \(\Delta A(r_t)\) and \(\Delta B(r_t)\) represent the uncertainties in the matrices \(A(r_t)\) and \(B(r_t)\), which satisfy
where \(M_1(r_t)\), \(N_1(r_t)\), \(M_2(r_t)\), and \(N_2(r_t)\) are known matrices with appropriate dimensions, and \(F(t,r_t)\) is the time-varying unknown matrix function with Lebesgue norm measurable elements satisfying
The controller to be designed is described by the following structure
where \(K(r_t)\) is the output feedback gain to be designed. Then the closed-loop system is as follows:
For notational simplicity, when \(r(t)=i, i\in \mathcal {M}\), \(A(r_t)\), \(B(r_t)\), \(K(r_t)\), \(E_x(r_t)\), \(C_y(r_t)\), \(C_z(r_t)\), \(D_z(r_t)\), \(E_z(r_t)\), \(\Delta A(r_t)\), \(\Delta B(r_t)\), \(M_1(r_t)\), \( N_1(r_t)\), \(M_2(r_t)\), \( N_2(r_t)\), and \(G(r_t)\) are respectively denoted as \(A_i\), \(B_i\), \(K_i\), \(E_{xi}\), \(C_{yi}\), \(C_{zi}\), \(D_{zi}\), \(E_{zi}\), \(\Delta A_i\), \(\Delta B_i\), \(M_{1i}\), \( N_{1i}\), \(M_{2i}\), \( N_{2i}\), and \(G_i\).
On the other hand, the transition rates of the Markovian process are assumed to be partly available, i.e., some elements in matrix \(\Pi =\{\pi _{ij}\}\) are unknown. For instance, for the stochastic jump system (1) with four subsystems, the transition rate matrix \(\Pi \) may be as:
where ‘?’ represents the inaccessible transition rate. For \(\forall i\in \mathcal {M}\), seeking describable convenience, we denote \( \mathcal {M}=L_k^i+L_{uk}^i\), and
Moreover, if \(L_k^i \ne \mathbf 0 \), \(L_k^i\) is further described as
where \(k_m^i \in \mathcal {M}\) represents the \(m \hbox {th}\) known transition rate of the set \(L_k^i\) in the \(i \hbox {th}\) row of the transition rate matrix \(\Pi \).
Remark 1
The transition rates are required that all information are completely known (\(L_{uk}^i = \mathbf 0 , L_k^i = \mathcal {M}\)) or completely unknown (\(L_k^i= \mathbf 0 , L_{uk}^i = \mathcal {M}\)) in some existing works. Here, we consider a general form.
We now introduce some assumptions, definitions, and lemmas, which are useful in our later development.
Assumption 1
The external disturbance \(v(t)\) is time-varying and satisfies the condition
Definition 1
(FTS [8]) For a given constant \(T>0\), the stochastic jump system (1) (\(u(t)=0, v(t)=0\)) is said to be finite-time stable with respect to (\(c_1, c_2, T, H_i\)), if
where \(0<c_1<c_2, H_i>0\).
Definition 2
(FTB [1]) For a given constant \(T>0\), the stochastic jump system (1) (\(u(t)=0\)) is said to be finite-time bounded with respect to (\(c_1, c_2, T, H_i,\) \( d\)) for any disturbance satisfying (9), if condition (10) holds with \(0<c_1<c_2, H_i>0\).
Definition 3
(The Finite-Time \(H_\infty \) Control) For the stochastic jump system (1), the finite-time \(H_\infty \) control problem is solvable with disturbance attenuation level \(\gamma >0\), if there exists a output feedback controller in the form of (4), such that the following two conditions are satisfied:
-
1.
The stochastic jump system (1) is finite-time bounded with respect to (\(c_1, c_2, T,\) \( H_i, d\));
-
2.
Under zero initial condition (\(x(t_0)=0, t_0=0\)), for any external disturbance \(v(t)\ne 0\) satisfying condition (9), the control output \(z(t)\) of the stochastic jump system (1) satisfies
$$\begin{aligned} \mathbb {E}\bigg \{\int _{0}^{T}z^T(t)z(t)dt \bigg \} \le \gamma ^2\int _{0}^{T}v^T(t)v(t)dt. \end{aligned}$$(11)
Definition 4
[17] In the Euclidean space\(\{\mathbb {R}^n \times \mathcal {M} \times \mathbb {R^+} \}\), introduce the stochastic Lyapunov function for the stochastic jump system (1) as \(V(x(t),i)\), and the weak infinitesimal operator satisfies
Remark 2
Unlike the classical Lyapunov stability is a system property on an infinite-time interval, the finite-time stability defines in the finite-time interval, that is, a system is said to be finite-time stable, if once we fix a finite-time interval, the state of system does not exceed the prescribed bound during this time interval.
Lemma 1
[21] Let \(T, M, F\), and \(N\) be real matrices of appropriate dimension with \(F^TF\le I\), then for any positive scalar \(\varepsilon >0\), there holds
Lemma 2
Given \(T>0\). The stochastic jump system (1) (\(u(t)=0, v(t)=0\)) under incomplete transition rates is finite-time stable with respect to \((c_1, c_2, T, H_i )\), if there exist a positive constant \(\alpha >0\), symmetric positive definite matrices \(P_i \in \mathbb {R}^{n\times n}, S \in \mathbb {R}^{p\times p}\) and symmetric matrices \(Q_i\in \mathbb {R}^{n\times n}\), such that for every \(i \in \mathcal {M}\)
where \(\tilde{P}_i = {H_i^{-1/2}}P_i{H_i^{-1/2}}\).
Proof
See the Appendix. \(\square \)
Lemma 3
Given \(T>0\). The stochastic jump system (1) \((u=0)\) under incomplete transition rates is finite-time bounded with respect to \((c_1, c_2, T, H_i, d )\), if there exist two positive constants \(\alpha >0, \gamma >0\), symmetric positive definite matrices \(P_i \in \mathbb {R}^{n\times n}, S \in \mathbb {R}^{p\times p}\) and symmetric matrices \(Q_i\in \mathbb {R}^{n\times n}\), such that for every \(i \in \mathcal {M}\)
where \(\tilde{P}_i = {H_i^{-1/2}}P_i{H_i^{-1/2}}\).
Proof
See the Appendix. \(\square \)
3 Main Results
In this section, we firstly give the finite-time \(H_{\infty }\) performance analysis for the nominal system of the stochastic jump system (1) and then investigate the issues of robust finite-time \(H_{\infty }\) control.
3.1 Finite-Time Output Feedback \(H_{\infty }\) Control
In this subsection, we construct a output feedback controller for the nominal system of the stochastic jump system (1) with \(F(t, r_t)=0\) for all \(t \ge 0\), and then give the finite-time \(H_{\infty }\) performance analysis. The nominal system of the stochastic jump system (1) is described as follows
Under the output feedback controller (4), the closed-loop system is
Theorem 1
Consider \(T>0\) and \(v(t)\) satisfying (9). The stochastic jump system (22) under incomplete transition rates is finite-time stabilizable via a output feedback controller (4) with respect to (\(c_1, c_2, T, H_i, d \)) and the inequality (11) is satisfied, if there exist two positive constant \(\alpha >0, \gamma >0\), symmetric positive definite matrices \(P_i \in \mathbb {R}^{n\times n}\) and symmetric matrices \(Q_i\in \mathbb {R}^{n\times n}\), such that for all \(i \in \mathcal {M}\)
where
Proof
By Schur complement lemma, condition (24) can be written as
Moreover, we obtain
Obviously, (24) implies (18). Then based on Lemma 3, the finite-time boundedness of the stochastic jump system (23) can be guaranteed by the above condition.
Then, for the stochastic jump system (23), choose a Lyapunov function candidate as
We have
Due to \(\sum _{j=1}^N{\pi _{ij}Q_i}=0\) for arbitrary symmetric matrices \(Q_i\), we can write the inequality (31) as
Notice that \(\pi _{ij}\ge 0\) for all \(i\ne j\), and \(\pi _{ii}=-{\sum _{j=1,i\ne j}^{N}}{\pi _{ij}}<0\) for all \(i\in \mathcal {M}\), in view of the inequality (24–26), we have
Further, multiplying (33) by \(e^{-\alpha t}\) yields
Under the zero initial condition, integrating the above inequality between \(0\) and \(t\), we have
Thus, the following condition holds
Note that \(t\in [0, T]\), it follows
Therefore, (11) holds with \(\bar{\gamma }=\sqrt{e^{\alpha T}}\gamma \).
This completes the proof. \(\square \)
Remark 3
It is clearly seen that (24) is a nonlinear matrix inequality due to the existence of the nonlinear terms \(K_i^TB_i^TC_{yi}^TP_i\) and \(P_iC_{yi}B_iK_i\). In order to solve the desired controller \(K_i\), we give the following result.
Theorem 2
Consider \(T>0\) and arbitrary \(v(t)\) satisfying (9). The stochastic jump system (22) under incomplete transition rates is finite-time stabilizable via a output feedback controller with respect to \((c_1, c_2, T, H_i, d )\) and the inequality (11) is satisfied, if there exist three positive scalars \(\alpha , \gamma , \lambda \), symmetric positive definite matrices \(X_i \in \mathbb {R}^{n\times n}\) and \(Y_i\in \mathbb {R}^{m\times m}\), symmetric matrices \(R_i\in \mathbb {R}^{n\times n}\) and matrices \(L_i\in \mathbb {R}^{n\times m}\), such that for all \(i \in \mathcal {M}\)
where
with \(k_1^i, k_2^i, \ldots k_m^i\) given in (8) and \(k_r^i=i\). Moreover, the finite-time \(H_{\infty }\) output feedback controller gains are given by \(K_i=L_iY_i^{-1}\).
Proof
If the conditions (24–27) are satisfied, it is easy to achieve that the system (22) is finite-time \(H_{\infty }\) output feedback stabilizable.
Firstly, pre-and post- multiplying the inequality (24) by diag\( \{P_i^{-1} \ \,I \,\,I \}\) and performing a congruence transformation to (24) by \(X_i=P_i^{-1}, K_i=L_iY_i^{-1}, Y_iC_{yi}=C_{yi}X_i, R_i=P_i^{-1}Q_iP_i^{-1}\), we get
where
Since \(\pi _{ii}<0, \forall i\in \mathcal {M}\), inequality (45) is dealt with in the following two cases.
Case I: \(i\in L_k^i\). The inequality (45) becomes
where \( \Xi _{2i} = X_iA_i^T+A_iX_i+C_{yi}^TL_i^TB_i^T+B_iL_iC_{yi}-\sum _{j\in L_k^i}\pi _{ij}R_i-\alpha X_i+\pi _{ii}X_i. \)
Applying Schur complement lemma to (46) immediately gives (38).
Case II: \(i\in L_{uk}^i\). The inequality (45) turns into
where \( \Xi _{3i}= X_iA_i^T+A_iX_i+C_{yi}^TL_i^TB_i^T+B_iL_iC_{yi}-\sum _{j\in L_k^i}\pi _{ij}R_i-\alpha X_i. \)
Using the similar proof, we can see that (39) is true.
Then, pre- and post-multiplying the inequalities (25) and (26) by \(P_i^{-1}\) respectively and letting \(X_i=P_i^{-1}, R_i=P_i^{-1}Q_ iP_i^{-1}\), we have
It is clear that inequality (48) is equivalent to LMI (40). Denoting \(\tilde{X}_i=\tilde{P}_i^{-1}=H_i^{1/2} X_i H_i^{1/2}\) and taking \(\lambda _{\max }(\tilde{X}_i)=\frac{1}{\lambda _{\min }(\tilde{P}_i)}\) into consideration, we conclude that condition (27) holds. Further, the following condition
guarantees that
It is easy to see that condition (50) implies LMI (44) and (51) is equivalent to (43). Therefore, if LMIs (38–44) hold, the closed-loop system (23) is \(H_{\infty }\) finite-time bounded. The stochastic jump system (22) can be stabilized via the output feedback controller (4) with \(K_i=L_iY_i^{-1}\).
This completes the proof. \(\square \)
3.2 Robust Finite-Time \(H_{\infty }\) Control
In this subsection, a robust finite-time \(H_{\infty }\) output feedback controller is designed to guarantee the finite-time output feedback stabilization of the stochastic jump system (1) with disturbance attenuation level \(\gamma >0\).
Theorem 3
Given \(T>0\) and \(v(t)\) satisfying (9). The problem of robust finite-time \(H_{\infty }\) control for the the stochastic jump system (1) with incomplete transition rates is solvable with disturbance attenuation level \(\gamma >0\), if there exist positive scalars \(\alpha , \gamma , \lambda , \varepsilon _{1i}, \varepsilon _{2i} \), symmetric positive definite matrices \(X_i \in \mathbb {R}^{n\times n}\) and \(Y_i\in \mathbb {R}^{m\times m}\), symmetric matrices \(R_i\in \mathbb {R}^{n\times n}\) and matrices \(L_i\in \mathbb {R}^{n\times m}\), such that for all \(i \in \mathcal {M}\), (40–44) and the following inequalities hold
where
with \(k_1^i, k_2^i, \ldots k_m^i\) described as in (8) and \(k_r^i=i\). The controller gains are given by \(K_i=L_iY_i^{-1}\).
Proof
In (38) and (39), by replacing \(A_i\) and \(B_i\) with \((A_i+\triangle A_i)\) and \((B_i+\triangle B_i)\), respectively, the following conditions are obtained
where
We now deal with the uncertainties described as \(\Delta A_i, \Delta B_i\). By Lemma 1, there exist scalars \(\varepsilon _{1i}, \varepsilon _{2i}\) such that
where
Applying Schur complement Lemma to (54) and (55) leads to (52). Then, similar to the derivation of (52), we can easily prove that (53) holds.
Therefore, if LMIs (40–44) and (52–53) hold, the closed-loop system (5) is robust \(H_{\infty }\) finite-time bounded, and the stochastic jump system (1) can be stabilized via the output feedback controller (4) with \(K_i=L_iY_i^{-1}\).
This completes the proof. \(\square \)
Remark 4
Notice that the condition (42) is not in the strictly linear matrix inequality form. In order to deal with this problem, we can replace (42) by the inequality:
When \(\beta \) is a sufficiently small positive scalar, (58) is closed to (42). The linear matrix inequality (58) may be conservative, but we have to notice that the condition (58) can be solved using the LMI toolbox, see [3].
Remark 5
Theorem 3 presents the sufficient condition of designing the robust finite-time \(H_{\infty }\) output feedback controller for stochastic jump systems with incomplete transition rates. Note that the coupled LMIs (52–53) and (40–44) include \(X_i\), \(Y_i\), \(R_i\), \(L_i\), \(H_i\), \(\alpha \), \(\beta \), \(\gamma ^2\), \(\lambda \), \(\varepsilon _{1i}\), \(\varepsilon _{2i}\), \(c_1\), \(c_2\), \(T\), and \(d\). Therefore, for given scalars \(\alpha \), \(\lambda \), \(c_1\), \(c_2\), \(T\), and \(d\), we can take \(\gamma ^2\) as the optimized variable to obtain an optimized robust finite-time \(H_{\infty }\) output feedback controller. The attenuation lever \(\gamma ^2\) can be reduced to the minimum value that satisfies LMIs (52–53) and (40–44). The optimization problem can be described as follows:
Remark 6
By using the MATLAB LMIs Toolbox, it is straightforward to check the feasibility of Theorem 3.
Remark 7
Time delay frequently occurs in various engineering systems, which is usually a source of instability and often causes undesirable performance and even makes the system out of control [25–27]. For stochastic jump systems with time delay, we may look for an appropriate Lyapunov–Krasovskii functions. Then, the sufficient condition, which can be easily tackled in the form of LMIs, can be obtained.
4 Simulation Results
In this section, we provide two examples to show the effectiveness of the main results in this paper.
Example 1
The four-mode uncertain stochastic jump system with paraments are given by
Mode 1
Mode 2
Mode 3
Mode 4
Choose the positive scalars \(c_1=2, c_2=8.8, T=8, d=1, \alpha =0.01\) and the matrices \(H_i=4I, i=1, 2, 3, 4\). The transition rate matrices are given respectively in four cases:
Case I | Completely | known | ||
1 | 2 | 3 | 4 | |
1 | -0.7 | 0.4 | 0.1 | 0.2 |
2 | 0.1 | -1 | 0.3 | 0.6 |
3 | 0.5 | 0.4 | -1.3 | 0.4 |
4 | 0.9 | 0.1 | 0.5 | -1.5 |
Case II | Partially | known | ||
1 | 2 | 3 | 4 | |
1 | ? | 0.4 | ? | 0.2 |
2 | ? | -1 | 0.3 | ? |
3 | 0.5 | ? | -1.3 | ? |
4 | ? | 0.1 | ? | ? |
Case III | Partially | known | ||
1 | 2 | 3 | 4 | |
1 | -0.7 | ? | 0.1 | ? |
2 | 0.1 | ? | ? | 0.6 |
3 | ? | 0.4 | ? | 0.4 |
4 | 0.7 | ? | 0.5 | -1.5 |
Case VI | Completely | unknown | ||
1 | 2 | 3 | 4 | |
1 | ? | ? | ? | ? |
2 | ? | ? | ? | ? |
3 | ? | ? | ? | ? |
4 | ? | ? | ? | ? |
Based on the LMIs (40–44), (52), and (53) in Theorem 3, the robust finite-time \(H_{\infty }\) output feedback controller gains are obtained below:
Case I | Completely known |
Controller gains | \(K_{1}=[-12.7862 \ \ \ 0.4678 ; \ \,\,1.2536 \,-63.9580]\) |
\(K_{2}= [\,48.9090 \,\,\,\,0.6281 ; \,\,\,\,1.5609 \,-27.4897]\) | |
\(K_{3}= [-19.4609 \,-1.2617 ; -0.0442 \,-26.6781]\) | |
\(K_{4}= [-40.6328 \,-0.8940 ; -0.1791 \,-20.4902]\) | |
Case II | Partially known |
Controller gains | \(K_{1}=[-10.2508 \,\,\,\,0.3927 ; \,\,\,1.4609 \,-63.9080]\) |
\(K_{2}= [\,56.2721 \,\,\,\,0.4527 ; \,\,\,\,0.4161 \,-34.2997]\) | |
\(K_{3}= [-25.5304 \,-0.0179 ; -0.0162 \,-15.6604]\) | |
\(K_{4}= [-46.2473 \,-0.8945 ; -0.8522 \,-29.4492]\) | |
Case III | Partially know |
Controller gains | \(K_{1}=[-9.4198 \,\,\,\,2.7156 ; \,\,\,0.0562 \,-51.3098]\) |
\(K_{2}= [\,68.0098 \,\,\,\,0.0805 ; \,\,\,\,0.9362 \,-25.5802]\) | |
\(K_{3}= [-13.5304 \,-0.0179 ; -2.4642 \,-17.1818]\) | |
\(K_{4}= [-33.6230 \,-0.7473 ; -1.6999 \,-20.0095]\) | |
Case VI | Completely unknown |
Controller gains | \(K_{1}=[-18.0008 \,\,\,\,0.8931 ; \,\,\,1.5302 \,-56.2220]\) |
\(K_{2}= [\,50.4821 \,\,\,\,0.0290 ; \,\,\,\,0.2198 \,-30.6413]\) | |
\(K_{3}= [-25.4777 \,-0.3519 ; -0.0602 \,-14.9994]\) | |
\(K_{4}= [-50.2001 \,-0.6600 ; -0.4516 \,-28.4370]\) |
Figures 1–2 show the effectiveness of the design method. Figure 1 describes the state trajectories of the closed-loop system. It can be seen that the stochastic jump system (5) with incomplete transition rates is robust finite-time stable. Figure 2 presents the corresponding control signal, which further shows the effectiveness of the designed controller (4).
Example 2
We consider a single-link robot arm in [16, 23]. To demonstrate the effectiveness of the results, we assume that a white noise interferes with a single-link robot arm system. The dynamic equation is given by
where \(\theta (t)\) is the angle position of the arm, \(u(t)\) is the control input, \(v(t)\) is the external disturbance, and \(W(t)\) is a white noise. \(M\) is the mass of the payload, \(J\) is the moment of inertia, \(g\) is the acceleration of gravity, \(L\) is the length of the arm, and \(D(t)\) is the viscous friction. The values of parameters \(g\), \(D(t)\) and \(L\) are given by \(g=9.81\), \(D(t)=2\) and \(L=0.5\), respectively. The parameters \(M\) and \(J\) have four different modes. The transition rate matrices are given, respectively, in four cases:
Case I | Completely | known | ||
1 | 2 | 3 | 4 | |
1 | -0.7 | 0.2 | 0.2 | 0.3 |
2 | 0.2 | -1 | 0.5 | 0.3 |
3 | 0.8 | 0.4 | -1.3 | 0.1 |
4 | 0.7 | 0.2 | 0.6 | -1.5 |
Case II | Partially | known | ||
1 | 2 | 3 | 4 | |
1 | ? | 0.2 | ? | 0.3 |
2 | ? | -1 | 0.5 | ? |
3 | 0.8 | ? | -1.3 | ? |
4 | ? | 0.2 | ? | ? |
Case III | Partially | known | ||
1 | 2 | 3 | 4 | |
1 | -0.7 | ? | 0.2 | ? |
2 | 0.2 | ? | ? | 0.3 |
3 | ? | 0.4 | ? | 0.1 |
4 | 0.7 | ? | 0.6 | -1.5 |
Case VI | Completely | unknown | ||
1 | 2 | 3 | 4 | |
1 | ? | ? | ? | ? |
2 | ? | ? | ? | ? |
3 | ? | ? | ? | ? |
4 | ? | ? | ? | ? |
The linearized system with four modes systems (59) is represented by
where \(x(t)=[x_1(t)^T \ x_2(t)^T]^T\), \(r=\{1, 2, 3, 4\}\), \(J(r)\) depends on the jump mode \(r\), \(J(1)=1\), \(J(2)=5\), \(J(3)=10\), \(J(4)=15\). We consider the uncertain parameters as follows:
and choose the positive scalars \(c_1=2, c_2=8.8, T=10, d=1, \alpha =0.01\) and the matrices \(H_i=4I, i=1, 2, 3, 4\).
Our purpose is to design a robust finite-time output feedback \( H_\infty \) controller in the form of (4) such that the closed-loop system is finite-time stable with an optimal \( H_\infty \) performance index. Based on the LMIs (40–44), (52), and (53) in Theorem 3, the robust finite-time \(H_{\infty }\) output feedback controller gains are obtained:
Case I | Completely known |
Controller gains | \(K_{1}=-21.9938\) \(K_{2}=-78.6534\) \(K_{3}= -115.6020\) \(K_{4}=-168.7598\) |
Case II | Partially known |
Controller gains | \(K_1=-19.9571\) \(K_{2}= -103.4801\) \(K_{3}= -155.5879\) \(K_{4}=-260.8996\) |
Case III | Partially know |
Controller gains | \(K_{1}=-13.5207\) \(K_{2}=-45.8019\) \(K_{3}=-92.0787\) \(K_{4}=-144.2625\) |
Case VI | Completely unknown |
Controller gains | \(K_{1}=-29.9364\) \(K_{2}=-88.7656\) \(K_{3}=-184.3426\) \(K_{4}=-119.6302 \) |
We take the initial condition \(x_0=[-0.1, 0.1]\). Figure 3 describes the state trajectories of the closed-loop system. It can be seen that the stochastic jump system (5) with incomplete transition rates is robust finite-time stable, which implies that the stochastic jump system (1) is robust finite-time \(H_{\infty }\) output feedback stabilizable via the designed output feedback controller (4). The corresponding control signal is presented in Fig. 4, which further shows the effectiveness of the designed controller (4).
5 Conclusions
This study has concerned with the problem of robust finite-time output feedback \( H_\infty \) control for stochastic jump systems with incomplete transition rates. The sufficient conditions have been developed to ensure the finite-time boundedness and finite-time output feedback stabilization for the given system. We have also designed a robust finite-time \( H_\infty \) output feedback controller, which guarantees the \( H_\infty \) finite-time boundedness of the closed-loop system. Finally, a numerical example has been provided to demonstrate the applicability of the main results.
References
F. Amato, M. Ariola, P. Dorato, Finite-time control of linear systems subject to parametric uncertainties and disturbances. Automatica 37(9), 1459–1463 (2001)
M. Athans, Command and control theory: a challenge to control science. IEEE Trans. Autom. Control 32(4), 286–293 (1987)
E.K. Boukas, Static output feedback control for stochastic hybrid systems: LMI approach. Automatica 42(1), 183–188 (2006)
W.H. Chen, J.X. Xu, Z.H. Guan, Guaranteed cost control for uncertain Markovian jump systems with mode-dependent time-delays. IEEE Trans. Autom. Control 48(12), 2270–2277 (2003)
M. Darouach, M. Chadli, Admissibility and control of switched discrete-time singular systems. Syst. Sci. Control Eng. 1(1), 43–51 (2013)
H.L. Dong, Z.D. Wang, W.C.H. Daniel, H.J. Gao, Robust \(H_\infty \) filtering for Markovian jump systems with randomly occurring nonlinearities and sensor saturation: the finite-horizon case. IEEE Trans. Signal Process. 59(7), 3048–3057 (2011)
H.L. Dong, Z.D. Wang, H.J. Gao, Distributed \(H_\infty \) filtering for a class of Markovian jump nonlinear time-delay systems over lossy sensor networks. IEEE Trans. Ind. Electron. 60(10), 4665–4672 (2013)
P. Dorato, Short time stability in linear time-varying systems, in Proceedings of the IRE International Convention, Record Part 4, pp. 83–87. New York, USA (1961).
Z.Y. Fei, H.J. Gao, P. Shi, New results on stabilization of Markovian jump systems with time delay. Automatica 45(10), 2300–2306 (2009)
H.J. Gao, X.Y. Meng, T.W. Chen, L. James, Stabilization of networked control systems via dynamic output-feedback controllers. SIAM J. Control Optim. 48(5), 3643–3658 (2010)
L.L. Hou, G.D. Zong, W.X. Zheng, Y.Q. Wu, Exponential \(l_2-l_\infty \) control for discrete-time switching Markov jump linear systems. Circuits Syst. Signal Process. 32(2), 2745–2759 (2013)
Z.W. Lin, J.Z. Liu, W.H. Zhang, Y.G. Niu, Stabilization of interconnected nonlinear stochastic Markovian jump systems via dissipativity approach. Automatica 47(12), 2796–2800 (2011)
F. Liu, Y. Cai, Passive analysis and synthesis of Markovian jump systems with norm bounded uncertainty and unknown delay. Dyn. Contin. Discret. Ser. A 13A(1), 157–166 (2006)
M. Liu, D.W.C. Ho, Y.G. Niu, Stabilization of Markovian jump linear system over networks with random communication delay. Automatica 45(2), 416–421 (2009)
R.Q. Lu, B. Lou, A.K. Xue, Mode-dependent quantised \(H_\infty \) filtering for Markovian jump singular system. Int. J. Syst. Sci. (2013). doi:10.1080/00207721.2013.837539
X.L. Luan, F. Liu, P. Shi, Robust finite-time control for a class of extended stochastic switching systems. Int. J. Syst. Sci. 42(7), 1197–1205 (2011)
X.R. Mao, Stability of stochastic differential equations with Markovian switching. Stoch. Process. Appl. 79(1), 45–67 (1999)
L.J. Shen, U. Buscher, Solving the serial batching problem in job shop manufacturing systems. Eur. J. Oper. Res. 221(1), 14–26 (2012)
X.M. Sun, G.P. Liu, D. Reeds, W. Wang, Controller failure analysis for systems with time-varying delay. IEEE Trans. Autom. Control 53(10), 2391–2396 (2008)
Z.D. Wang, H. Qiao, K.J. Burnham, On stabilization of bilinear uncertain time-delay stochasticsystems with Markovian jumping parameters. IEEE Trans. Autom. Control 47(4), 640–646 (2002)
Y.Y. Wang, L.H. Xie, C.E. Souza, Robust control of a class of uncertain nonlinear systems. Syst. Control Lett. 19(2), 139–149 (1992)
L. Weiss, E.F. Infante, Finite-time stability under perturbing forces and on product spaces. IEEE Trans. Autom. Control 12(1), 54–59 (1967)
H.N. Wu, K.Y. Cai, Mode-independent robust stabilization for uncertain Markovian jump nonlinear systems via fuzzy control. Syst. Man Cybern. Part B Cybern. 36(3), 509–519 (2006)
Z.J. Wu, Y.H. Liu, Robust output-feedback control for stochastic nonlinear systems with modeling errors. J. Control Theory Appl. 10(3), 344–348 (2012)
Z.G. Wu, P. Shi, H.Y. Su, J. Chu, Passivity analysis for discrete-time stochastic Markovian jump neural networks with mixed time-delays. IEEE Trans. Neural Netw. 22(10), 1566–1575 (2011)
Z.G. Wu, P. Shi, H.Y. Su, J. Chu, Stochastic synchronization of Markovian jump neural networks with time-varying delay using sampled-data. IEEE Trans. Cybern. 43(6), 1796–1806 (2013)
Z.G. Wu, P. Shi, H.Y. Su, J. Chu, Asynchronous \(l_2-l_\infty \) filtering for discrete-time stochastic Markov jump systems with randomly occurred sensor nonlinearities. Automatica 50(1), 180–186 (2014)
H. Wu, W. Wang, H. Ye, Z.D. Wang, State estimation for Markovian jump linear systems with bounded disturbances. Automatica 49(11), 3292–3303 (2013)
L.G. Wu, X.M. Yao, W.X. Zheng, Generalized fault detection for two-dimensional Markovian jump systems. Automatica 48(8), 1741–1750 (2012)
L.X. Zhang, E.K. Boukas, Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities. Automatica 45(2), 463–468 (2009)
Y. Zhang, Y. He, M. Wu, J. Zhang, Stabilization for Markovian jump systems with partial information on transition probability based on free-weighting matrices. Automatica 47(1), 79–84 (2011)
Y.S. Zhang, S.Y. Xu, J.H. Zhang, Delay-dependent robust \(H_\infty \) control for uncertain fuzzy Markovian jump systems. Int. J. Control Autom. 7(4), 520–529 (2009)
G.D. Zong, D. Yang, L.L. Hou, Q.Z. Wang, Robust finite-time \(H_\infty \) control for Markovian jump systems with partially known transition probabilities. J. Frankl. Inst. 350(6), 1562–1578 (2013)
Acknowledgments
This work was supported by the National Natural Science Foundation of China under Grants 61233002 and 61174073and IAPI Fundamental Research Funds under Grant 2013ZCX03-01.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
1.1 Proof of Lemma 2
Proof
For the stochastic jump system (1) (\(u(t)=0, v(t)=0\), and \(F(t, r_t)=0\)), choose a Lyapunov function candidate as (30). Then, by Definition 4, we obtain
If the transition rates are not accessible completely, the following equation hold for arbitrary symmetric matrices \(Q_i\) due to \(\sum _{j=1}^N{\pi _{ij}}Q_i=0\)
If \(i\in L_k^i\)(the elements of the diagonal are known), by inequalities (14) and (15), the following inequality holds
If \(i\in L_{uk}^i\)(the elements of the diagonal are unknown), according to inequalities (14–16), the inequality (63) holds. Multiplying (63) by \(e^{-\alpha t}\) yields
According to Dynkin’s formula for (64), we get
which shows
This together with \(\tilde{P}_i={H_i^{-1/2}}P_i{H_i^{-1/2}}\) gives rise to
Consider
For \(\forall t\in [0, T]\), we obtain
This completes the proof. \(\square \)
1.2 Proof of Lemma 3
Proof
For the stochastic jump system (1) (\(u = 0\) and \(F(t, r_t)=0\)), choose a Lyapunov function candidate as (30). Based on Definition 4, we have
Since \(\sum _{j=1}^N{\pi _{ij}}Q_i=0\) is always true for arbitrary symmetric matrices \(Q_i\), (70) can be rewritten as
Notice that \(\pi _{ij}\ge 0\) for all \(i\ne j\), and \(\pi _{ii}=-\displaystyle {}{\sum _{j=1,i\ne j}^{N}}{\pi _{ij}}<0\) for all \(i\in \mathcal {M}\), if \(i\in L_k^i\) (the elements of the diagonal are known), by inequalities (18) and (19), the following inequality holds
If \(i\in L_{uk}^i\)(the elements of the diagonal are unknown), according to inequalities (18–20), the inequality (72) holds. Multiplying (72) by \(e^{-\alpha t}\) yields
Using Dynkin’s formula to (73), we obtain
which in turn shows
This together with \(\tilde{P}_i={H_i^{-1/2}}P_i{H_i^{-1/2}}\) gives rise to
Taking into account the fact that
\(\forall t\in [0, T]\), we have
This completes the proof. \(\square \)
Rights and permissions
About this article
Cite this article
Yang, D., Zhao, J. Robust Finite-Time Output Feedback \( H_\infty \) Control for Stochastic Jump Systems with Incomplete Transition Rates. Circuits Syst Signal Process 34, 1799–1824 (2015). https://doi.org/10.1007/s00034-014-9941-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-014-9941-z