Abstract
This paper is concerned with the problem of stability and robust H ∞ control for 2-D stochastic systems with parameter uncertainties and sector nonlinearities. The class of systems under investigation is described by the 2-D state-space Roesser model. Our attention is focused on the design of a state feedback controller for 2-D stochastic system with sector nonlinearity, such that the closed-loop 2-D stochastic system is asymptotically stable and has a prescribed H ∞ disturbance attenuation performance. First, a sufficient condition is established for the 2-D nonlinear stochastic systems to be asymptotically stable. Then, we extend the bounded real lemma for 2-D systems to 2-D stochastic systems with sector nonlinearities. Based on this lemma, solvability conditions for the H ∞ control of 2-D nonlinear stochastic systems in the form of LMIs (linear matrix inequalities) are derived. A numerical example illustrates the effectiveness of the proposed results.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Two-dimensional (2-D) systems have important applications in many fields such as signal and image processing, seismographic data processing, biomedical imaging processing, process control, and iterative learning control [5, 13, 16]. Thus the design of 2-D control systems is of practical significance and has attracted a lot of interest in the past decade. Hinamoto and Lu investigated the stability of 2-D systems through Lyapunov approaches [11, 17], Xie et al. and Du et al. are concerned with controller and filter design problems [4, 19]. It is known that the H ∞ control has been a most active area of control systems in the past two decades [18]. The main advantage of H ∞ control is that its performance specification takes into account the worst case performance of the system in terms of the system energy gain. This is more appropriate for system robustness analysis and robust control under modeling uncertainties and disturbances than the other performance specifications such as the LQ-optimal control specification. Thus the development of the H ∞ control theory has greatly advanced the methods for analysis and design of robust control systems.
In the past few decades, the study of stochastic systems has received much attention over the past few decades due to the extensive application of stochastic systems in biology, economics, mechanical system and other areas [18]. A great number of fundamental results for stochastic systems have been reported in the literature. For example, the analysis of asymptotic behavior can be found in [2, 22], optimal control problems were reported in [10, 18], robust control and filtering results were studied in [6, 10, 12]. Most of the aforementioned results are concerned with 1-D stochastic systems. In the 2-D case, the robust stabilization problem for 2-D systems with stochastic uncertainties was addressed in [9], where stabilizing state feedback controllers were designed via an LMI approach. The problem of H∞ filter design for 2-D systems with stochastic perturbations was presented in [8]. On the other hand, the nonlinearity is another important feature existing in almost all practical systems. Since nonlinearities may cause undesirable dynamic behaviors such as oscillation or even instability, the analysis and synthesis problems for nonlinear systems have been extensively investigated [7, 15, 18, 20]. Due to stochastic and nonlinear phenomena frequently exhibited in many branches of science and engineering applications, growing research interests have been paid to the study of stability and control problems for nonlinear stochastic systems, and a great number of results on this subject were reported in the literature; The stabilization problem was investigated in [9] for nonlinear stochastic systems. In [20], a global decentralized stabilization algorithm was given for a class stochastic nonlinear system with nonlinear interconnections in the drift vector fields. Most recently, in [16], the extended Kalman filtering problem has been investigated for a class of nonlinear systems with multiple missing measurements over a finite horizon. It is worth pointing out that the sector nonlinearity [17] has gained much attention for deterministic systems among different descriptions of the nonlinearities.
Very recently, the problems of stability analysis and stabilization for a class of 2-D nonlinear discrete systems have been studied in [21], in which sufficient conditions for the solvability of this problem were obtained and an LMI approach was proposed. However, the above mentioned results were obtained in the context of 2-D nonlinear discrete systems. When 2-D discrete systems with stochastic and nonlinear uncertainties are concerned, no results on H ∞ control for such systems have been available in the literature so far, which motivates the present study.
In this paper, we consider the problem of stability and robust H ∞ control for 2-D stochastic systems with sector nonlinearities. Our attention is focused on the design of a state feedback controller for a nonlinear discrete time 2-D stochastic system, such that the closed-loop 2-D stochastic system is asymptotically stable and has a prescribed H ∞ disturbance attenuation performance. Similar to the result of 1-D systems [2], the bounded realness property of 2-D stochastic systems with sector nonlinearities plays a key role for the H ∞ control solution. We will first extend the bounded real lemma for 2-D systems to 2-D stochastic systems with nonlinearities. Based on this lemma, solvability conditions for the H ∞ control of 2-D nonlinear stochastic systems in the form of LMIs (linear matrix inequalities) are derived, and the corresponding controller design is cast into a convex optimization problem that can be efficiently handled by using MATLAB LMI Toolbox. A numerical example is provided to illustrate the usefulness of the proposed controller design procedures.
2 Stability Analysis of 2-D Stochastic System with Sector Nonlinearity
In this section, we discuss mean-square asymptotic stability for 2-D discrete stochastic system with sector nonlinearity. Consider the 2-D stochastic system with sector nonlinearity in the following Roesser model [9]:
where \(x^{h} \in R^{n_{1}}\) and \(x^{v} \in R^{n_{2}}\) represent the horizontal and vertical states. The function ψ(•) denotes the standard vector-valued sector nonlinearity (see Definition 2). A is system matrix with compatible dimensions, A 1, M and M 1 are appropriately dimensions matrix, and v i,j is a standard random scalar signal satisfying E{v i,j }=0, where E{•}stands for the mathematical expectation and
Throughout the paper, we make the following assumption on the boundary condition:
Assumption 1
The boundary condition is independent of v i,j and is assumed to satisfy
Similar to [9], we give the following definition which will be used throughout the paper.
Definition 1
([3]) The two-dimensional discrete stochastic system (1) with Assumption 1 is said to be mean-square asymptotically stable if under the zero input and for every initial condition E{∥x 0,0∥2}<∞,
Definition 2
([15]) A memoryless vector nonlinear function ψ:R n→R n is said to satisfy a sector condition if
for some diagonal real matrices K 1,K 2∈R n×n. In this case, we say that ψ belongs to the sector K=[K 1,K 2] and denote it by ψ∈[K 1,K 2].
Lemma 1
(Schur complement)
For matrices Σ 1, Σ 2 and Σ 3 whereΣ 1>0 and \(\varSigma_{3} = \varSigma _{3}^{T}\) then \(\varSigma_{3} + \varSigma _{2}^{T}\varSigma_{1}^{ - 1}\varSigma_{2} < 0\) if and only if
The following theorem gives the criterion of stability for the system (1)–(2).
Theorem 1
For the system (1)–(2), ψ belonging to the sector K=[K 1,K 2], if there exist a positive definite symmetric matrix P=diag{P h ,P v }>0 and a scalar ε>0 satisfying
where K=K 2−K 1 is a positive definite symmetric matrix, the asterisk (∗) represents a term that is induced by symmetry. Then, the system (1)–(2) is asymptotically stable for any ψ(q)∈[K 1,K 2].
Proof
We decompose the nonlinear function ψ(q) into a linear and a nonlinear part as ψ(q)=ψ n (q)+K 1 q, where the nonlinearity ψ n (q) belongs to the set Φ given by [21]
Since ψ belongs to the sector K=[K 1,K 2], the system (1) becomes
To establish the stability of system (1)–(2). Consider the following index:
where , and Q is a symmetric positive definite matrix to be determined. Then along the solution of the system (1)–(2) we have
where
, Q=P −1,E{x|y} stands for the mathematical expectation of x conditional on y.
By the Schur complement, LMI (5) implies Ψ<0. Then for all x≠0, we have
where λ min(⋅), λ max(⋅) denote the minimum and the maximum eigenvalue of the corresponding matrix, respectively. \(\alpha= 1 - \frac{\lambda_{\min} ( - \varPsi )}{\lambda_{\max} (Q)}\), since \(\frac{\lambda_{\min} ( - \varPsi )}{\lambda_{\max} (Q)} > 0\), we have α<1, obviously
That is, α belongs to (0,1) and is independent of x. Therefore, we have
Taking expectation of both sides yields
Upon the relationship (8), it can be established that
Adding both sides of the inequality system (9) yields
Using this relationship iteratively, we can obtain
Therefore, we have
where \(\kappa: = \frac{\lambda_{\max} (Q)}{\lambda_{\min} (Q)}\).
Now, denote \(\chi_{k}: = \sum_{j = 0}^{k} \Vert x_{k - j,j} \Vert ^{2}\). Then from the inequality (10) we have
Adding both sides of this inequality system yields
Then, under Assumption 1, the right side of this inequality is bounded, which means lim k→0 E{χ k }=0, that is, lim i +j→∞ E{∥x i,j ∥2}=0. Then the 2-D discrete stochastic system (1) is mean-square asymptotically stable. □
Remark 1
Theorem 1 provides an LMI condition for the mean-square asymptotic stability of 2-D nonlinear stochastic system in the Roesser model which can be solved by LMI Toolbox.
3 Bounded Realness of 2-D Stochastic System with Sector Nonlinearity
In this section, we will analyses the bounded realness for 2-D stochastic discrete system with sector nonlinearity. We consider the following system [9]:
where w∈R p is the noise input which belongs to ℓ 2, z∈R q is the controlled output, B 1, N 1, H, H 1 and L 1 are known real constant matrices with appropriate dimensions. Using the transformation (6), the above system (11)–(13) becomes
Definition 3
Given a scalar γ>0 and weighting matrices R 1>0 and R 2>0, the 2-D system (11)–(13) with unknown boundary condition is said to have an H ∞ disturbance attenuation level γ if it is mean-square asymptotically stable and satisfies
In the case when the boundary condition is known to be zero, the H ∞ performance measure (10) reduces to
where
Remark 2
Note that the definition is a natural extension of 2-D Roesser model to 2-D stochastic Roesser model case.
The following bounded real lemma will play an important role in solving the robust H ∞ control problem formulated in the next section.
Theorem 2
Given a positive scalar γ, the 2-D system (11)–(13)with unknown boundary condition has an H ∞ disturbance attenuation level γ if there exist a scalar ε>0 and a block-diagonal matrix P=diag{P h ,P v }>0, where \(P_{h} \in R^{n_{1} \times n_{1}}\) and \(P_{v} \in R^{n_{2} \times n_{2}}\) satisfy \(P_{h}^{\ - 1} < \gamma^{2}R_{1}\) and \(P_{v}^{\ - 1} < \gamma^{2}R_{2}\) such that
Proof
By (18), it is easy to see that
By Theorem 1, we see that system (11)–(13) with w(i,j)=0 is asymptotically stable. Suppose now that there exists a block-diagonal matrix P=diag{P h ,P v }>0, such that the matrix inequality (18) holds, we denote the system sate as
Consider the following index:
where
By the Schur complement, LMI (18) implies Ω<0.
Then for ξ≠0, we have δ(i,j)<0, that is
Taking the expectation of both sides yields
Due to the relationship (19), it can be established that
Adding both sides of the inequality system
Summing up both sides of this inequality from k=0 to k=N, we have
Since Q h <γ 2 R 1 and Q v <γ 2 R 2 (Q=P −1), the inequality (20) leads to
That is
Therefore, from Definition 3, the system (11)–(13) is mean-square asymptotically stable and have an H ∞ disturbance attenuation level γ. The proof is completed. □
Remark 3
Theorem 2 provides an H ∞ performance index for 2-D nonlinear stochastic system. When we assume v i,j =0, A 1=0, that is, no nonlinear and stochastic uncertainty is in the system (11)–(12), it is easy to show that Theorem 2 coincides with the existing bounded real lemma for discrete 2-D Roesser model [5]. Therefore, Theorem 2 in this paper can be regarded as an extension of existing results on bounded realness for 2-D systems to 2-D nonlinear stochastic system described by the Roesser model.
4 Robust H ∞ Control of 2-D Stochastic System with Sector Nonlinearity
Consider the following 2-D stochastic system with sector nonlinearity expressed by [9]:
where u∈R m is the control input, B 2, N 2 and L 2 are known real constant matrices with appropriate dimensions.
Now, we consider the following state feedback controller:
Applying this controller to 2-D stochastic system (21)–(23) results in the following closed-loop system:
For the closed-loop system (25)–(26), we state the 2-D H ∞ control problem as: find a 2-D state feedback controller of the form (24) for the 2-D stochastic system, such that the closed-loop system has a specified H ∞ performance γ.
In the following theorem, we present a sufficient condition for the 2-D stochastic system (18)–(20) to have an H ∞ disturbance attenuation level γ.
Theorem 3
Consider the 2-D stochastic system (21)–(23). Given a positive scalar γ, if there exist a scalar ε>0 and two matrices Y, X=diag{X h ,X v }>0 such that
Then the closed-loop system (25)–(26) has a specified H ∞ performance γ, and
is a γ—suboptimal state feedback H ∞ controller for the 2-D stochastic system (21)–(23).
Proof
By applying Theorem 2, a sufficient condition for the closed-loop system (25)–(26) to have a specified H ∞ performance γ is that there exist a scalar ε>0 and a block-diagonal matrix P=diag{P h ,P v }>0 such that
denoting X=P, Y=XG T, it follows that inequality (29) is equal to the linear matrix inequality (27). This completes this proof.
In view of Theorem 3, in what follows, attention will be focused on the design of a state feedback controller to solve the robust H ∞ control problem for the following 2-D stochastic system.
Consider the 2-D stochastic system in the following Roesser model [9]:
where ΔA, ΔA 1, ΔM, ΔM 1, ΔH, ΔH 1, ΔB i , ΔN i and ΔL i (i=1,2) are unknown matrices representing norm-bounded parameter uncertainties, and are assumed to be of the form:
where F(i,j) is an unknown real matrix satisfying:
and U i , V i (i=1,2,3) are known real constant matrices with appropriate dimensions. □
Lemma 2
([14]) Let L, E, F and Q be real matrices of appropriate dimensions with Q satisfying Q=Q T, then Q+LFE+(LFE)T<0 for all F satisfying F T F≤I, if and only if there exists a scalar ε>0 such that
The main result of this section is given in the following theorem.
Theorem 4
Consider the 2-D stochastic system (30)–(32) with parameter uncertainties. Given a positive scalar γ, if there exist two matrices Y and X=diag{X h ,X v }>0, and scalar ε>0, μ>0 such that
where
Then
is a robust γ—suboptimal state feedback H ∞ controller for the uncertain 2-D stochastic system (30)–(32).
Proof
Suppose the uncertain 2-D stochastic system (30)–(32) has H ∞ performance γ, that is, there exist two matrices Y and X=diag{X h ,X v }>0, and a scalar ε>0 such that the following LMI (34) holds:
where
That is
for all F satisfying (34). Therefore, using Lemma 1, there exists a scalar μ>0 such that
By the Schur complement, LMI (35) implies LMI (32) holds. This completes this proof.
In addition, by solving the following optimization problem [1]:
we can obtain a state feedback controller such that the H ∞ disturbance attenuation γ of the corresponding closed-loop system is minimized. This controller (24) is said to be the robust optimal H ∞ controller for the uncertain 2-D stochastic system (30)–(32).
Theorem 4 provides a sufficient condition for the solvability of the robust H ∞ control problem for the 2-D nonlinear stochastic system described by Roesser model. A desired state feedback controller can be constructed by solving the LMI in (35). The optimization problem proposed above can be carried out automatically by using the function mincx in the LMI control toolbox. □
5 Numerical Example
This section gives an example to illustrate the proposed results.
Example 1
We consider the dynamical processes in gas absorption, water stream heating and air drying, which can be described by the following partial differential equation [13]:
where s(x,t) is an unknown function at x (space) ∈[0,x f ] and t (time) ∈[0,∞]. a 0, a 1,a 2 and b are coefficients, and f(x,t) is the input function. v ij is a standard random scalar signal satisfying E{v ij }=0.
Similar to the technique used in [5]. We define
Taking:
We can write (40) in the discrete form
It is easy to verify that Eq. (41) can be converted into the following 2-D Roesser model:
Let Δt=0.5, Δx=0.1, a 0=0.2, a 1=−3, a 2=−1 and b=0.3. To consider the problem of H ∞ disturbance attenuation, the thermal process is modeled in the form (1)–(2) with
By applying Theorem 4 and solving the optimization problem (39), the minimum H ∞ disturbance attenuation level for the corresponding closed-loop system is γ=0.2830 (based on feasibility of the corresponding LMIs). Meanwhile, we obtain
Thus, the robust optimal H ∞ controller is obtained as
6 Conclusions
This paper has investigated the problem of stability and robust H ∞ control for 2-D stochastic systems with sector nonlinearities. To the authors’ knowledge, it is possibly the first attempt to consider robust control and stability for this class of 2-D nonlinear stochastic systems. The stability and H ∞ disturbance attenuation condition has been developed via the LMI approach. The design of the H ∞ controller can be recast as a convex optimization with constraints of LMI. Finally, a dynamical processes with stochastic perturbation to serve as a simulation example of 2-D stochastic system is given to illustrate the effectiveness of the proposed result. Further development for this class of systems will be studied.
References
S. Boyd, L. El Ghaoul, E. Feron, V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, vol. 15 (Society for Industrial and Applied Mathematics, Philadelphia, 1987)
C.E. de Souza, L. Xie, On the discrete-time bounded real lemma with application in the characterization of static state feedback H ∞ controllers. Syst. Control Lett. 18(1), 61–71 (1992)
H. Deng, M. Krstic, R.J. Williams, Stabilization of stochastic nonlinear systems driven by noise of unknown covariance. IEEE Trans. Autom. Control 46(8), 1237–1253 (2001)
C. Du, L. Xie, Y.C. Soh, H ∞ filtering of 2-D discrete systems. IEEE Trans. Signal Process. 48(6), 1760–1768 (2000)
C. Du, L. Xie, H ∞ Control and Filtering of Two-Dimensional Systems, vol. 278 (Springer, Berlin, 2002)
A. El Bouhtouri, D. Hinrichsen, A.J. Pritchard, H ∞ control for discrete-time stochastic systems. Int. J. Robust Nonlinear Control 9(13), 923–948 (1999)
E. Fornasini, G. Marchesini, State-space realization theory of two-dimensional filters. IEEE Trans. Autom. Control 21(4), 484–492 (1976)
H. Gao, J. Lam, C. Wang, S. Xu, Robust H ∞ filtering for 2D stochastic systems. Circuits Syst. Signal Process. 23(6), 479–505 (2004)
H. Gao, J. Lam, S. Xu, C. Wang, Stability and stabilization of uncertain 2-D discrete systems with stochastic perturbation. Multidimens. Syst. Signal Process. 16(1), 85–106 (2005)
U. Haussmann, Optimal stationary control with state control dependent noise. SIAM J. Control 9(2), 184–198 (1971)
T. Hinamoto, Stability of 2-D discrete systems described by the Fornasini-Marchesini second model. IEEE Trans. Circuits Syst. I, Fundam. Theory Appl. 44(3), 254–257 (1997)
D. Hinrichsen, A. Pritchard, Stochastic H ∞. SIAM J. Control Optim. 36(5), 1504–1538 (1998)
T. Kaczorek, Two-Dimensional Linear Systems (Springer, Berlin, 1985)
H. Kar, V. Singh, Robust stability of 2-D discrete systems described by the Fornasini-Marchesini second model employing quantization/overflow nonlinearities. IEEE Trans. Circuits Syst. II, Express Briefs 51(11), 598–602 (2004)
H.K. Khalil, Nonlinear Systems, 3rd edn. (Prentice Hall, New Jewsey, 2002)
W.S. Lu, Two-Dimensional Digital Filters, vol. 80 (CRC Press, Boca Raton, 1992)
W. Lu, On a Lyapunov approach to stability analysis of 2-D digital filters. IEEE Trans. Circuits Syst. I, Fundam. Theory Appl. 41(10), 665–669 (1994)
W.M. Wonham, On a matrix Riccati equation of stochastic control. SIAM J. Control 6(4), 681–697 (1968)
L. Xie, C. Du, Y.C. Soh, C. Zhang, H ∞ and robust control of 2-D systems in FM second model. Multidimens. Syst. Signal Process. 13(3), 265–287 (2002)
S. Xie, L. Xie, Decentralized stabilization of a class of interconnected stochastic nonlinear systems. IEEE Trans. Autom. Control 45(1), 132–137 (2000)
S. Ye, W. Wang, Stability analysis and stabilisation for a class of 2-D nonlinear discrete systems. Int. J. Inf. Syst. Sci. 42(5), 839–851 (2011)
D. Yue, J.a. Fang, S. Won, Delay-dependent robust stability of stochastic uncertain systems with time delay and Markovian jump parameters. Circuits Syst. Signal Process. 22(4), 351–365 (2003)
Acknowledgements
The authors would like to thank the Associate Editor and anonymous reviewers for their constructive comments and suggestions which led to the considerable improvement of the presentation of this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dai, J., Guo, Z. & Wang, S. Robust H ∞ Control for a Class of 2-D Nonlinear Discrete Stochastic Systems. Circuits Syst Signal Process 32, 2297–2316 (2013). https://doi.org/10.1007/s00034-013-9573-8
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-013-9573-8