Abstract
We consider a system of nonlinear discrete-time equations subject to the influence of a discrete random process of the “white” noise type. It is assumed that the system admits a “partial” (with respect to some part of state variables) zero equilibrium. The problem of partial stability in probability is posed—the stability of a given equilibrium is not with respect to all but only to part of the variables determining it. To solve the problem, a discrete-stochastic version of the Lyapunov function method is used with the appropriate refinement of the requirements for the Lyapunov function. To expand the capabilities of the method used, it is proposed to correct the domain in which the auxiliary Lyapunov function is constructed; this is achieved by introducing an additional (vector, generally speaking) auxiliary function. Conditions of partial and asymptotic stability in probability in the indicated form are obtained. An example is given showing the specific features of the proposed approach.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1. INTRODUCTION
Stability problems are among the main problems of qualitative analysis and synthesis of nonlinear dynamical systems subjected to random disturbances and structural changes. As in the case of deterministic systems, the Lyapunov function method is used to solve these problems.
The development of the stochastic version of the method of Lyapunov functions was greatly influenced by the idea due to Kats and Krasovskii [1] about using the averaged derivative of the Lyapunov function, which can be calculated knowing only the right-hand sides of the system and the probabilistic characteristics of the random process affecting it. This approach, proposed for systems of differential equations with right-hand side containing a homogeneous Markov chain with finitely many states, largely predetermined many subsequent studies, including systems of stochastic differential equations in the Itô form [2, 3] as well as more general classes of stochastic systems with random parameters and/or structure [4, 5].
A separate line of research is associated with the analysis of the stability of discrete-time (finite-difference) systems subjected to random factors. The increased interest in discrete-time systems is associated with the use of digital control systems, problems of financial mathematics, biocenose dynamics, as well as problems of the numerical solution of systems of stochastic differential equations. In this way, the corresponding discrete-stochastic version of the method of Lyapunov functions was developed [2, 6,7,8,9,10,11,12,13] as applied to the highly general problem on the stability of the zero equilibrium with respect to all variables. The problem of stability of compact sets in the system state space was also considered [14]. The averaged derivative (or differential generating operator [2, 3, 5]) is replaced in these cases by the averaged finite difference of the Lyapunov function [6].
Starting from Rumyantsev’s publications [15, 16], the theory of stability of deterministic systems and then of stochastic systems with continuous dynamics considers partial stability problems (see the survey [17]): stability of the zero equilibrium with respect to some of the variables, as well as stability of a “partial” (zero) equilibrium with respect to all or some of the variables. From the formal mathematical point of view, the problem of stability of a “partial” equilibrium with respect to all variables belongs to the problem of stability of noncompact (closed but unbounded) sets, while problems of stability with respect to some of the variables have independent significance and, generally speaking, are not reducible to any problems of stability of sets. The point is that stability with respect to some of the variables does not imply the proximity of the trajectories corresponding to perturbed motions and the unperturbed motion (equilibrium) of the system.
Substantively, the indicated partial stability problems naturally arise in applications both based on the requirement of normal operation and in assessing the capabilities of the system to be designed. They can also be viewed as auxiliary problems in the analysis of stability of selected equilibria with respect to all variables. In addition, there arise related partial stabilization problems for nonlinear control systems, which have been actively examined in recent years. However, partial stability and stabilization problems have practically not been studied for systems of stochastic discrete-time equations.
The present paper discusses a system of nonlinear discrete-time (finite-difference) equations of general form subject to the influence of a discrete random process such as white noise. It is assumed that the system admits a partial (with respect to some part of the state variables) zero equilibrium. The statement of the stability in probability problem for this equilibrium is given; stability is considered with respect to part of the state variables determining it. The possibility of solving the problem on the basis of the Lyapunov function method is analyzed.
2. DEFINITIONS. STATEMENT OF THE PROBLEM
Consider a linear finite-dimensional space of vectors \(\mathbf {x} \) with Euclidean norm \(\|\mathbf {x}\| \). Introduce a partitioning of a vector \(\mathbf {x} \) into two parts, \( \mathbf {x} = (\mathbf {y}^{\mathrm {T}}, \mathbf {z}^{\mathrm {T}})^{\mathrm {T}} \) (where “T” stands for transposition). By \({\mathbb Z}_{+} = \{k = 0, 1, 2, \dots \}\) we denote the set of nonnegative integers.
Assume that we are given a finite-dimensional nonlinear system of stochastic discrete (finite-difference) equations [2, 6,7,8,9,10,11,12,13,14]
where \(k \in {\mathbb Z}_{+} \) is discrete time; \(\mathbf {x}(k) \) is the sequence of state vector values determining the system state; and \(\boldsymbol {\xi }(k) \) is a sequence of independent random vectors defined on a probability space (\(\Omega \), \(F \), \(\mathbf {P}\)) with identical distribution laws for each \(k \in {\mathbb Z}_{+} \). Here \(\Omega \) is the space of elementary events { \(\omega \)} with a \(\sigma \)-algebra of \(F \)-measurable sets, filtration \(F_{k} \), and a probability measure \(\mathbf {P}:F \to [0, 1] \) defined on this space.
Taking into account the partitioning \(\mathbf {x} = (\mathbf {y}^{\mathrm {T}}, \mathbf {z}^{\mathrm {T}})^{\mathrm {T}} \), we represent the system in question in the form of two groups of equations
Under the condition
the set \(M = \{\mathbf {x}(k): \mathbf {y}(k) = \mathbf {0}\} \) is a “partial” equilibrium of system (1).
Assume also that the vector function \(\mathbf {X} = (\mathbf {Y}^{\mathrm {T}}, \mathbf {Z}^{\mathrm {T}})^{\mathrm {T}} \) determining the right-hand side of system (1) is continuous in \(\mathbf {x}\) and \(\boldsymbol {\xi }\) in the domain \(\|\mathbf {x}\| <\infty \) for each \(k\in {\mathbb Z}_{+} \). The initial value \(\mathbf {x}_{0} \) of the state vector will be assumed to be deterministic. Then (see, e.g., [9, 11]) for all \(k_{0 }\geq 0\) and \(\mathbf {x}_{0} \) there exists a unique random multidimensional Markov process that is consistent with the flow of \(\sigma \)-algebras \({F}_{k} \) and is a random vector function \(\{\mathbf {x}(k) = \mathbf {x}(k; k_{0}, \mathbf {x}_{0}),\boldsymbol {\xi }(k)\} \) in the space \(\{\mathbf {x}, \boldsymbol {\xi }\}\) whose realizations \(\{\mathbf {x}(k, \omega ) = \mathbf {x}(k, \omega ; k_{0}, \mathbf {x}_{0}), \boldsymbol {\xi }(k, \omega )\} \) satisfy system (1). For all \(k\ge k_{0} \), this random process and the corresponding collection of realizations of the random vector function determine a solution of system (1) with the initial conditions \( {\mathbf {x}}_{0} = \mathbf {x}(k_{0}; k_{0}, \mathbf {x}_{0}) \) as well as the collection of sample paths of system (1) corresponding to this solution. The Markov property of solutions of system (1) is used in the sequel to justify the conditions for partial stability in probability.
Under the assumptions made, the “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0} \) of system (1) is an invariant set of this system. The assumption \(\mathbf {X}(k, \mathbf {0}, \boldsymbol {\xi }(k)) \equiv \mathbf {0} \) about the existence of a “complete” equilibrium \(\mathbf {x}(k) = \mathbf {0}\) is not necessary and can even contradict the meaning of the problems being solved.
Following the approach of partial stability theory, we will analyze the stability of the “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0} \) not with respect to all the variables determining it but with respect to some part of those, defined in advance. To this end, we assume that \(\mathbf {y} = (\mathbf {y}_{1}^{\mathrm {T}}, \mathbf {y}_{2}^{})^{\mathrm {T}}\), with the vector \(\mathbf {y}_{1} \) including the components of \(\mathbf {y} \) with respect to which stability is considered.
In this case, the variables occurring in the vector \(\mathbf {z} \) are “uncontrolled,” although they significantly affect the dynamics of the \({\mathbf {y}}_{1}\) -variables. To expand the operation capabilities of the notions of \({\mathbf {y}}_{1} \)-stability of the “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0}\) considered in what follows, we arbitrarily introduce a partitioning \(\mathbf {z} = (\mathbf {z}_{1}^{\mathrm {T}}, \mathbf {z}_{2}^{\mathrm {T}})^{\mathrm {T}}\) of the vector \(\mathbf {z}\) into two groups of variables.
By \({D}_{\delta }\) we denote the domain of \({\mathbf {x}}_{0}\) such that \(\| \mathbf {y}_{0}\| <\delta \), \(\|\mathbf {z}_{10}\|\leq L \), and \(\|\mathbf {z}_{20} \|<\infty \); the domain \({D}_{\Delta } \) is obtained by replacing \(\delta \) with \(\Delta \).
Definition.
For large values of \( {\mathbf {z}}_{10}\) and on the whole with respect to \({\mathbf {z}}_{20}\), a “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0}\) of system (1) is
-
1.
\({\mathbf {y}}_{1}\)-stable in probability if for each \({k}_{0}\in {\mathbb Z}_{+} \) and any arbitrarily small numbers \( \varepsilon > 0\) and \(\gamma > 0 \), as well as for each number \(L > 0 \) given in advance, there exists a number \(\delta (\varepsilon , \gamma , L, k_{0}) > 0\) such that for all \(k \geq k_{0}\) and \({\mathbf {x}}_{0} \in D_{\delta }\) one has the relation
$$ \mathbf {P}\left \{\sup _{k\ge k_{0}}\big \|\mathbf {y}_{1} (k; k_{0} ,\mathbf {x}_{0} )\big \| >\varepsilon \right \} <\gamma . $$(2) -
2.
Uniformly \( {\mathbf {y}}_{1}\)-stable if \(\delta = \delta (\varepsilon , \gamma , L)\).
-
3.
Asymptotically \({\mathbf {y}}_{1}\) -stable if it is uniformly \({\mathbf {y}}_{1}\) -stable in probability and, in addition, for each \({k}_{0} \in {\mathbb Z}_{+} \) and for each number \(L > 0 \) given in advance there exists a number \(\Delta (L) > 0 \) such that for all \(k \geq k_{0} \) and \(\mathbf {x}_{0} \in D_{\Delta } \) one has the limit relation
$$ \lim _{\|\mathbf {y}_{0}\|\to 0}\mathbf {P}\left \{\lim _{k\to +\infty } \big \|\mathbf {y}_{1}(k;k_{0},\mathbf {x}_{0})\big \| =0\right \} =1.$$
Remark 1.
It can be shown (see, e.g., [5]) that if \({\mathbf {x}}_{0 }\) is a random variable (independent of \(\boldsymbol {\xi }(k)\)) and the inclusions \({\mathbf {x}}_{0}\in D_{\delta }\) and \({\mathbf {x}}_{0 }\in D_{\Delta }\) hold almost certainly (with probability \(1 \)), then we obtain definitions equivalent to the above-introduced definitions of partial stability.
Remark 2.
The closest to the ones introduced are the notions of partial stability of a “partial” equilibrium of stochastic systems of differential equations in Itô form with respect to all [18, 19] and part [20] of the variables. The assumptions about “on the whole with respect to \({\mathbf {z}}_{0} \)” or “for large values of \({\mathbf {z}}_{0} \)” are typical of the definitions of stability (both in all and part of the variables) of a “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0} \) of system (1) but lead to different requirements for the Lyapunov functions. Partitioning the vector \({\mathbf {z}}_{0}\) into two parts gives rise to “intermediate” concepts of \({\mathbf {y}}_{1} \)-stability in the sense of the above-introduced Definitions 1–3. In this case, the suitable choice of the partition \(\mathbf {z} = (\mathbf {z}_{1}^{\mathrm {T}}, \mathbf {z}_{2}^{\mathrm {T}})^{\mathrm {T}} \) depends on the structure of system (1) and is a result of finding a trade-off between the informative meaning of the concept of the \({\mathbf {y}}_{1}\) -stability of the “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0} \) and the corresponding requirements for the Lyapunov functions. Moreover, the above-introduced notions of stability arise when passing (by means of the notation \(w= k\), \(r = k - k_{0} \)) from system (1) to the time-invariant discrete system
when the requirements of uniformity (nonuniformity) with respect to \({k}_{0}\) in the problems of \( {\mathbf {y}}_{1}\)-stability for large values of \({\mathbf {z}}_{0}\) or on the whole in \({\mathbf {z}}_{0} \) of a “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0} \) are replaced by the requirements “on the whole in \({w}_{0} \)” (“for large values of \({w}_{0} \)”).
3. PARTIAL STABILITY CONDITIONS
In the context of the Lyapunov function method, we consider single-valued scalar functions \(V = V(k, \mathbf {x})\), \(V(k, \mathbf {0}) \equiv 0 \), continuous in \(\mathbf {x} \) for each \(k\in {\mathbb Z}_{+} \) and defined in the domain
An analog of the derivatives of these functions according to system (1) are their averaged difference (increments) calculated by the formula [6, 9]
where the operator \(\mathbf {E}[V(k + 1, \mathbf {X}(k, \mathbf {x}(k), \boldsymbol {\xi }(k))) | \mathbf {x}(k) = \mathbf {x}] \) determines the conditional expectation, for \(\mathbf {x}(k) = \mathbf {x}\), of the random variable \({V(k + 1}, { \mathbf {X}(k, \mathbf {x}(k) \boldsymbol {\xi }(k)))} \) generated by the set of realizations \(\{\mathbf {x}(k, \omega ), \boldsymbol {\xi }(k, \omega )\} \) of a process \(\{\mathbf {x}(k), \boldsymbol {\xi }(k)\}\) that is a solution of system (1).
To state the partial stability conditions, we will also additionally use the following auxiliary functions.
-
1.
Scalar functions \({V}^{*}(k, \mathbf {y}, \mathbf {z}_{1}) \), \({V}^{*}(\mathbf {y}, \mathbf {z}_{1})\) that are required to render concrete (in accordance with the statement of the problem) requirements for the Lyapunov \(V \)-function and an auxiliary vector function \(\boldsymbol {\mu } (k, x)\), \(\boldsymbol {\mu }(k, \mathbf {0}) \equiv \mathbf {0}\), by means of which we correct the domain where the main Lyapunov \(V\)-function is constructed. These functions are continuous in \(\mathbf {x}\) for each \(k\in {\mathbb Z}_{+} \) in the domain \((3) \).
-
2.
Continuous scalar functions \({a}_{i}(r)\), \({a}_{i}(0) = 0 \) (\(i=1,2,3 \)) monotone increasing in \(r> 0 \) (Hahn-type functions [16]) defining the standard requirements for the main Lyapunov \(V \)-function.
Introducing, along with the main Lyapunov \(V \)-function, the auxiliary function \(\boldsymbol {\mu }(k, \mathbf {x})\) is motivated as follows. When studying the \({\mathbf {y}}_{1}\)-stability in probability of a “partial” equilibrium \( \mathbf {y}(k) = \mathbf {0}\) of system (1), in the general case, one has the dependence of Lyapunov \(V \)-functions not only on \(k \), \(\mathbf {y}_{1} \) but also on \({\mathbf {y}}_{2} \), \(\mathbf {z} \). In such a situation, the analysis of the posed problem about \( {\mathbf {y}}_{1}\)-stability in the usually considered domain
does not always allow one to reveal the desired properties of the Lyapunov \(V\)-function or endow it with these properties. The reason lies in the requirement \(\|\mathbf {y}_{2}\| + \|\mathbf {z}\| <\infty \), which considerably complicates producing the necessary estimates for the Lyapunov \(V \)-function and its averaged finite difference.
The indicated requirement essentially means counting on the “worst-case” scenario of changes in the variables \({\mathbf {y}}_{2}\), \(\mathbf {z} \), and it can be replaced by the “softer” requirement
if we mean the “extended” (\({\mathbf {y}}_{1}, \boldsymbol { \mu }\))-stability of the “partial” equilibrium \(\mathbf {y} = \mathbf {0}\) of system (1). In this case, the \(\boldsymbol {\mu } \)-function is not specified initially but is selected when solving the original \({\mathbf {y}}_{1}\) -stability problem, with the possibility of the extension of the concept of \({\mathbf {y}}_{1} \)-stability occurring because of the dependence of the \(\boldsymbol {\mu }\)-function not only on \(k \) and \(\mathbf {y} \) but also on \(\mathbf {z} \).
Therefore, it is not only possible but also expedient to select a suitable Lyapunov \(V \)-function to be consistent with the choice of the domain in the \( (k,\mathbf {x})\)-space in which this function is considered. This consistency can be achieved by introducing, along with the main Lyapunov \(V\)-function, an additional (generally speaking, vector) auxiliary function \(\boldsymbol {\mu }(k,\mathbf {x})\) for correcting the domain in which the main Lyapunov \(V\)-function is constructed.
Theorem 1.
Suppose that for system (1), along with the main scalar Lyapunov \(V \)-function, one can specify an auxiliary vector function \(\boldsymbol {\mu }(k, \mathbf {x})\), \( \boldsymbol {\mu }(k, \mathbf {0}) \equiv 0 \), such that the following conditions are satisfied:
for each \(k\in {\mathbb Z}_{+} \) and a sufficiently small \({h}_{1 }>0\) in the domain (5).
Then the “partial” equilibrium \( \mathbf {y}(k) = \mathbf {0}\) of system (1) is \({\mathbf {y}}_{1} \)-stable in probability for large values of \({\mathbf {z}}_{10} \) on the whole with respect to \({\mathbf {z}}_{20} \).
If conditions (7) are replaced with the conditions
then the “partial” equilibrium \( \mathbf {y}(k) = \mathbf {0}\) of system (1) is uniformly \( {\mathbf {y}}_{1}\) -stable in probability for large values of \({\mathbf {z}}_{10} \) on the whole with respect to \({\mathbf {z}}_{20} \).
The proofs of Theorem 1 and the subsequent Theorem 2 are moved to the Appendix.
Within the framework of the considered approach, we can also state the conditions of asymptotic \({\mathbf {y}}_{1} \)-stability in probability for large values of \({\mathbf {z}}_{10}\) on the whole with respect to \({\mathbf {z}}_{20}\) of the “partial” equilibrium \(\mathbf {y}(k)=\mathbf {0}\) of system (1). Here is one of the versions of such conditions.
Theorem 2.
Suppose that for system (1), along with the main scalar Lyapunov \(V \)-function, one can indicate an additional vector function \(\boldsymbol {\mu }(\mathbf {x})\), \( \boldsymbol {\mu }(\mathbf {0}) \equiv \mathbf {0} \), for which the conditions
as well as conditions (9), are satisfied for each \(k\in {\mathbb Z}_{+} \) and a sufficiently small \({h}_{1 }>0\) in the domain (5).
Then the “partial” equilibrium \( \mathbf {y}(k) = \mathbf {0}\) of system (1) is asymptotically \( {\mathbf {y}}_{1}\) -stable in probability for large values of \({\mathbf {z}}_{10} \) on the whole with respect to \({\mathbf {z}}_{20} \).
Remark 3.
The auxiliary Lyapunov \(V\)-function and its averaged difference (increment) \(\mathbf {L}V(k,\mathbf {x}) \) according to system (1) in Theorems 1 and 2 are, generally speaking, alternating functions in the domain (4) for each \(k\in {\mathbb Z}_{+} \). Along with the main Lyapunov \(V \)-function, an additional auxiliary \(\boldsymbol {\mu } \)-function is introduced for the most expedient replacement of the domain (4) by the domain (5).
Conditions (7) are “intermediate” between the less restrictive condition \(V(k, \mathbf {0}, \mathbf {z}) \equiv 0 \) and the more restrictive conditions \(V(k, \mathbf {x})\leq V ^{*}(k, \mathbf {y})\), \(V ^{*}(k, \mathbf {0}) \equiv 0\), under which the “partial” equilibrium \( \mathbf {y}(k) = \mathbf {0}\) of system (1) is, respectively, \({\mathbf {y}}_{1} \)-stable in probability for large values of \({\mathbf {z}}_{0}\) or \({\mathbf {y}}_{1} \)-stable in probability on the whole with respect to \({\mathbf {z}}_{0}\).
Remark 4.
Within the framework of the proposed approach, the nonlinear Lyapunov \(V \)-functions can be constructed as alternating quadratic forms (or forms of higher order) \(V(k, \mathbf {x}) \equiv V ^{*}(k, \mathbf {y}_{1}, \boldsymbol {\mu }(k, \mathbf {x}))\) of the variables \( {\mathbf {y}}_{1}\), \(\boldsymbol {\mu } \). In this case, the choice of \(\boldsymbol {\mu } \)-functions must be coordinated with conditions (7), (9); for example, auxiliary \(\boldsymbol {\mu } \)-functions of the form \(\boldsymbol {\mu } = \boldsymbol {\mu }(\mathbf {y} _{2}, \mathbf {z} _{1}) \), \(\boldsymbol {\mu }(\mathbf {0}, \mathbf {z}_{1}) \equiv \mathbf {0}\) are admissible.
If a subsystem of the form
can be separated from system (1), then the Lyapunov \(V \)-function can be constructed using the numerical method in [11] as applied to the problem of stability with respect to all variables (with respect to \({\mathbf {y}}_{1} \), \(\boldsymbol {\mu } \)) of the zero equilibrium of this subsystem.
Remark 5.
If system (1) admits a “complete” equilibrium \(\mathbf {x}(k) = \mathbf {0}\), then in the case of \(\boldsymbol {\mu }(k, \mathbf {x}) \equiv \mathbf {0}\), \(\boldsymbol {\xi }(k) \equiv \mathbf {0}\), \(\|\mathbf {x}_{0}\|<\delta \) and under conditions (6) and (8) we have a discrete version of the classical Rumyantsev theorem [15] on the stability with respect to part of the variables. In the case of \(\boldsymbol {\xi }(k) \equiv \mathbf {0} \), Theorem 1 transforms into discrete versions [21, 22] of the corresponding theorems in [23, 24].
Remark 6.
The stability with respect to some of the variables “on the average” of the zero equilibrium of systems of discrete-time stochastic equations was studied in [25, 26] by isolating “truncated” subsystems [25], as well as by constructing auxiliary systems [26]. The possibilities of using the Lyapunov function method to solve partial stability (stabilization) problems for systems of stochastic differential equations were analyzed in [27,28,29,30,31], including systems with a random structure [32,33,34]; a model example is used in [35] to compare optimal stabilization problems with respect to all and part of the variables for quasilinear systems of stochastic differential equations.
4. EXAMPLE
Let the discrete-time system (1) consist of the equations
where \(\xi _{1}(k)\) is a sequence of independent random variables with standard normal distribution for each \(k\in {\mathbb Z}_{+} \); the function \(Z _{2} \) is arbitrary and satisfies only the general requirements for system (1); and \(a \), \(b \), \(c \), \(d \), \(e \), \(l \), and \(\alpha \) are constant parameters.
System (12) admits the “partial” equilibrium
Along with the main Lyapunov function
we also consider the auxiliary function \(\mu _{1}= y _{2}z _{1} \).
Conditions (9) and (10) are satisfied for the Lyapunov \(V \)-function in the domain (5), and its averaged difference (increment) \(\mathbf {L} V(\mathbf {x}) \) according to system (12) is determined for all \({k \in {\mathbb Z}_{+}} \) as follows:
the conditional expectation has been calculated in view of the relations \( \mathbf {E}[\xi _{1}(k)] = 0\) and \(\mathbf {E}[\xi _{1} ^{2}(k)] = 1\) determining the standard normal distribution of the random variables \(\xi _{1}(k) \).
Under the inequalities
satisfied for each \( k\in {\mathbb Z}_{+} \) with a sufficiently small \(h _{1 }> 0 \) in the domain (5) (but not in the domain (4)), for any values of the parameters \(d \) and \(e \) one has the estimate \(\mathbf {L} V(\mathbf {x}) \leq -\beta (y _{1} ^{2} + \mu _{1} ^{2})\), \(\beta = \mathrm {const} > 0\). It follows that, apart from conditions (9) and (10), the Lyapunov \(V \)-function (14) also satisfies condition (11) in the domain (5).
Based on Theorem 2, we conclude that under conditions (15), the “partial” equilibrium (13) of system \((12) \) is asymptotically \(y _{1} \)-stable in probability for large \(z _{10} \) on the whole with respect to \(z _{20} \).
Let us geometrically explain this property of partial stability in connection with Definitions 2 and 3 introduced in Sec. 2. For each \({k _{0} \in {\mathbb Z}_{+}} \) and for any arbitrarily small numbers \( \varepsilon > 0\) (\(\varepsilon < h _{1} \)) and \(\gamma > 0 \), as well as for each number \(L > 0 \) given in advance, the boundary of the admissible domain \(\mathbf {x} _{0 } \in D _{\delta }\) of initial disturbances in the three-dimensional space \(Oy _{1} y _{2} z _{1 } \) is the cylinder \(\|\mathbf {y} _{0}\| = \delta \) of height \(2L \) lying between two planes \(y _{1}= \pm \varepsilon \) (Fig. 1) with \(\delta = \delta (\varepsilon , \gamma , L) \). If the solutions of system (12) start inside this \(\delta \)-cylinder for \(k = k_{0} \) (with an arbitrary value of \(z _{20} \)), then the sample paths corresponding to the indicated solutions in the space \(Oy_{1}y_{2}z_{1}\) will remain between the indicated two \(\varepsilon \)-planes with probability at least \(1-\gamma \) for all \(k \geq k _{0} \) .
We can also indicate a number \(\Delta = \Delta (\gamma , L, h _{1}) > 0 \) such that
for all \(k \geq k _{0}\) and \(\mathbf {x} _{0}\in D _{\Delta }\). If the solutions of system (12) start inside a \(\Delta \)-cylinder \(\|\mathbf {y} _{0}\| = \Delta \) of height \(2L \) for \(k = k_{0} \) (with an arbitrary value of \(z _{20} \)), then the corresponding sample paths in the space \(Oy _{1} y _{2} z _{1}\) will not only stay with a probability at least \(1 -\gamma \) for all \(k \geq k _{0} \) between the \(\varepsilon \)-planes but will tend to the plane \(y _{1} = 0 \) as \(k\to \infty \).
However, within the framework of the approach considered, based on the transition from the domain (4) to the domain (5), one has the “extended” uniform \((y_{1},\mu _{1}) \)-stability of the “partial” equilibrium (13) of system (12), ensuring the legitimacy of such a transition. Therefore, the \(\delta \)-cylinder lies in the domain \(D ^{*} \) of the space \(Oy _{1} y _{2} z _{1} \) bounded by the surface \(y _{1} ^{2}+ y _{2} ^{2} z _{1} ^{2} = \varepsilon ^{2}\). (In Fig. 2, the location of the \(\delta \)-cylinder is shown in projection on the plane \(Oy _{2} z _{1} \); the corresponding rectangle with sides of length \(2\delta \) and \(2L \) lies in a domain whose boundaries are the branches of the hyperbolae \(y _{2} z _{1} = \pm \thinspace \varepsilon \).) If the solutions of system (12) start inside the \(\delta \)-cylinder for \(k = k _{0} \) (with an arbitrary value of \(z _{20} \)), then the corresponding sample paths in the space \(Oy _{1} y _{2} z _{1}\) will remain with probability at least \(1 - \gamma \) in the domain \(D ^{*} \) for all \(k \geq k _{0} \).
An analysis of the structure of system (12) permits one to supplement the conclusions made: under conditions (15), the sample paths in the space \(Oy _{1} y _{2} z _{1}\) corresponding to the solutions of system (12) starting inside the \(\Delta \)-cylinder \(\|\mathbf {y} _{0}\| = \Delta \) of height \(2L \) (with an arbitrary value of \(z _{20} \)) “focus” with probability at least \(1 -\gamma \) as \(k \to \infty \) or along the \(Oy_{2} \)-axis, or along the \(Oz _{1} \)-axis. Indeed, by virtue of the existing “extended” asymptotic \((y _{1}, \mu _{1})\)-stability of the “partial” equilibrium (13) of system (12), the second and third equations in this nonlinear system can be represented in the form of the linear recurrence equations
and with the component \(y _{1}(k; k _{0}, \mathbf {x} _{0})\) of any solution of system \((12) \) starting inside the \(\Delta \)-cylinder of height \(2L \), one has relations (16). Therefore, under conditions (15), for these solutions of system (12) as \(k \to \infty \) with probability at least \(1 -\gamma \) one has the relations \(| y _{2} (k)|\to \infty \) and \(| z _{1} (k)|\to 0 \) (for \(| b |> 1 \) and \(| c |< 1 \)) or the relations \(| y _{2} (k) | \to 0 \) and \(| z _{1} (k) |\to \infty \) (for \(| b |< 1 \) and \(| c |> 1 \)).
To render the obtained numerical data concrete, the left-hand side of Table 1 lists the results of calculations based on the recurrence relations (12) in the range \(k\in [0, 20] \) for the “unperturbed” case of \(\xi _{1}(k) \equiv 0 \) with \(y _{1} (0)=y_{2}(0) = 0{,}1 \) and \(z _{1}(0) = 1 \), as well as with the parameter values \(a = {1}/{2} \), \(b = {3}/ {2} \), \(c = {1}/ {3} \), and \(d = e = l = 1 \). Under the random action \(\xi _{1}(k) \), the sample paths group around the “unperturbed” trajectory, focused along the \(Oy _{2}\)-axis as \(k \to \infty \). To estimate the effect of the random action upon the dynamics of system (12), the right-hand side of Table 1 lists the results of computations for \(\alpha = {1}/ {3}\) and with the same values of parameters in the case where the admissible realization \(\xi _{1}(k)\) is determined on the interval \(k\in [0, 20]\) by the sequence \(\{0, -1, 1, 1, 0, -1, -1,1, 0, 0, 1, 1, -1, 0, 0, -1, 1, 0, -1, 1, -1\} \).
5. CONCLUSIONS
For a nonlinear system of stochastic discrete-time (finite-difference) equations subject to the action of a discrete random process of the white noise type, a statement of the problem of stability (asymptotic stability) with respect to the variables of the “partial” zero equilibrium is given. The initial values of the “uncontrolled” variables that do not determine the considered “partial” equilibrium are assumed to be large (bounded in the norm by any predetermined number) in one part and arbitrary in the other.
Sufficient conditions are given for the solvability of this problem in the context of the discrete-stochastic version of the Lyapunov function method in the corresponding modification. Along with the main Lyapunov \(V\)-function, we consider an additional (vector, generally speaking) auxiliary \(\boldsymbol {\mu } \)-function for correcting the domain in which the main Lyapunov \(V \)-function is constructed. The expediency of this approach lies in the fact that, as a result, the main Lyapunov \(V \)-function, as well as its averaged difference (increment) according to the system in question, can be of alternating signs.
REFERENCES
Kats, I.Ya. and Krasovskii, N.N., On the stability of systems with random parameters, Prikl. Mat. Mekh., 1960, vol. 24, no. 5, pp. 809–823.
Kushner, H.J., Stochastic Stability and Control, New York–London: Academic Press, 1967. Translated under the title: Stokhasticheskaya ustoichivost’ i upravlenie, Moscow: Mir, 1969.
Khas’minskii, R.Z., Ustoichivost’ sistem differentsial’nykh uravnenii pri sluchainykh vozmushcheniyakh ikh parametrov (Stability of Systems of Differential Equations under Random Disturbances of Their Parameters), Moscow: Nauka, 1969.
Kats, I.Ya. and Martynyuk, A.A., Stability and Stabilization of Nonlinear Systems with Random Structure, London: Taylor & Francis, 2002.
Mao, X.R. and Yuan, C.G., Stochastic Differential Equations with Markovian Switching, London: Imperial College Press, 2006.
Akhmetkaliev, T., On the relationship between the stability of stochastic systems of difference and differential systems, Differ. Uravn., 1965, vol. 1, no. 8, pp. 1016–1026.
Halanay, A. and Wexler, D., Teoria calitativ \( \overset {{}_\smile }{a}\) a sistemilor cu impulsuri, Bucharest: Editura Academiei, 1968. Translated under the title: Kachestvennaya teoriya impul’snykh sistem, Moscow: Mir, 1971.
Konstantinov, V.M., On the stability of stochastic difference systems, Probl. Peredachi Inf., 1970, vol. 6, no. 1, pp. 81–86.
Pakshin, P.V., Diskretnye sistemy so sluchainymi parametrami i strukturoi (Discrete-Time Systems with Random Parameters and Structure), Moscow: Fizmatlit, 1994.
Azhmyakov, V.V. and Pyatnitskiy, E.S., Nonlocal synthesis of systems for stabilization of discrete stochastic controllable objects, Autom. Remote Control, 1994, vol. 55, no. 2, pp. 202–210.
Barabanov, I.N., Construction of Lyapunov functions for discrete systems with stochastic parameters, Autom. Remote Control, 1995, vol. 56, no. 11, pp. 1529–1537.
Jian, X.S., Tian, S.P., Zhang, T.L., and Zhang, W.H., Stability and stabilization of nonlinear discrete-time stochastic systems, Int. J. Robust Nonlinear Control, 2019, vol. 29, no. 18, pp. 6419–6437.
Qin, Y., Cao, M., and Anderson, B.D.O., Lyapunov criterion for stochastic systems and its applications in distributed computation, IEEE Trans. Autom. Control, 2020, vol. 65, no. 2, pp. 546–560.
Teel, A.R., Hespanha, J.P., and Subbaraman, A., Equivalent characterizations of input-to-state stability for stochastic discrete-time systems, IEEE Trans. Autom. Control, 2014, vol. 59, no. 2, pp. 516–522.
Rumyantsev, V.V., On the stability of motion with respect to part of the variables, Vestn. Mosk. Gos. Univ. Ser. Mat. Mekh. Fiz. Astron. Khim., 1957, no. 4, pp. 9–16.
Rumyantsev, V.V. and Oziraner, A.S., Ustoichivost’ i stabilizatsiya dvizheniya po otnosheniyu k chasti peremennykh (Stability and Stabilization of Motion with Respect to Part of the Variables), Moscow: Nauka, 1987.
Vorotnikov, V.I., Partial stability and control: the state of the art and developing prospects, Autom. Remote Control, 2005, vol. 66, no. 4, pp. 511–561.
Rajpurohit, T. and Haddad, W.M., Stochastic finite-time partial stability, partial-state stabilization, and finite-time optimal feedback control, Math. Control Signals Syst., 2017, vol. 29, no. 2, article ID 10.
Rajpurohit, T. and Haddad, W.M., Partial-state stabilization and optimal feedback control for stochastic dynamical systems, J. Dyn. Syst. Meas. Control, 2017, vol. 139, no. 9, p. DS-15-1602.
Vorotnikov, V.I. and Martyshenko, Y.G., On the partial stability in probability of nonlinear stochastic systems, Autom. Remote Control, 2019, vol. 80, no. 5, pp. 856–866.
Vorotnikov, V.I. and Martyshenko, Yu.G., On the partial stability problem for nonlinear discrete-time systems, Mekhatron. Avtom. Upr., 2017, vol. 18, no. 6, pp. 371–375.
Ramirez-Llanos, E. and Martinez, S., Distributed and robust fair optimization applied to virus diffusion control, IEEE Trans. Network Sci. Eng., 2017, vol. 4, no. 1, pp. 41–54.
Vorotnikov, V.I., On stability and stability with respect to part of the variables of the “partial” equilibria of nonlinear dynamical systems, Dokl. Ross. Akad. Nauk, 2003, vol. 389, no. 3, pp. 332–337.
Vorotnikov, V.I. and Martyshenko, Yu.G., On partial stability theory of nonlinear dynamic systems, J. Comput. Syst. Sci. Int., 2010, vol. 49, no. 5, pp. 702–709.
Yudaev, G.S., On stability of stochastic difference systems, Sov. Math. (Iz. VUZ), 1979, vol. 23, no. 8, pp. 75–80.
Phillis, Y.A., y-Stability and stabilization in the mean of discrete-time stochastic systems, Int. J. Control, 1984, vol. 40, no. 1, pp. 149–160.
Sharov, V.F., Stability and stabilization of stochastic systems vis-a-vis some of the variables, Autom. Remote Control, 1978, vol. 39, no. 11, pp. 1629–1636.
Vorotnikov, V.I., Partial Stability and Control, Boston: Birkhäuser, 1998.
Ignatyev, O., Partial asymptotic stability in probability of stochastic differential equations, Stat. Probab. Lett., 2009, vol. 79, no. 5, pp. 597–601.
Zuyev, A. and Vasylieva, I., Partial stabilization of stochastic systems with application to rotating rigid bodies, IFAC-PapersOnLine, 2019, vol. 52, no. 16, pp. 162–167.
Sultanov, O., Capture into parametric autoresonance in the presence of noise, Commun. Nonlinear Sci. Numer. Simul., 2019, vol. 75, pp. 14–21.
Kao, Y., Wang, C., Zha, F., and Cao, H., Stability in mean of partial variables for stochastic reaction-diffusion systems with Markovian switching, J. Franklin Inst., 2014, vol. 351, no. 1, pp. 500–512.
Socha, L. and Zhu, Q.X., Exponential stability with respect to part of the variables for a class of nonlinear stochastic systems with Markovian switching, Math. Comput. Simul., 2019, vol. 155, pp. 2–14.
Socha, L., Stability and positivity with respect to part of the variables for positive Markovian jump systems, Bull. Polish Acad. Sci.: Tech. Sci., 2019, vol. 67, no. 4, pp. 769–775.
Khrustalev, M.M. and Onegin, E.E., Necessary and sufficient conditions for optimal stabilization of quasi-linear stochastic systems, Autom. Remote Control, 2019, vol. 80, no. 7, pp. 1252–1264.
Doob, J.L., Stochastic Processes, New York–London: John Wiley & Sons/Chapman & Hall, 1953. Translated under the title: Veroyatnostnye protsessy, Moscow: Inostr. Lit., 1956.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Translated by V. Potapchouck
APPENDIX
Proof of Theorem 1 .
I. Assume that conditions (6)–(8) are satisfied in the domain (5) for each \(k\in {\mathbb Z}_{+} \) and for a sufficiently small \(h _{1 }> 0 \).
Take an arbitrary number \(\varepsilon \) ( \(0 <\varepsilon < h_{1}\)) and consider an arbitrary time \(k _{0} \) and an initial point \(\mathbf {x} _{0} \) in the domain
Consider a random process \(\mathbf {x}(k; t _{0}, \mathbf {x} _{0}) \) \((k \geq k _{0})\) that is a solution of system (1) and denote the “integer” time of the first exit of this process from the domain \(\|\mathbf {y} _{1}\| \leq \varepsilon \) by \(\tau _{\varepsilon } \). If some trajectories leave the domain \(\|\mathbf {y} _{1}\| \leq \varepsilon \) in no finite time, then \(\tau _{\varepsilon }\) for these trajectories is taken to be \(\infty \). Set
One has the relations
It follows from these equalities that for the sequence \(v(k) \) of random variables \(v(k)= \) \(V(\tau (k), \mathbf {x}(\tau (k); k _{0}, \mathbf {x} _{0}))\) generated by the realizations \(\{\mathbf {x}(k, \omega ), \boldsymbol {\xi }(k, \omega )\} \) of the random process \(\{\mathbf {x}(k), \boldsymbol {\xi }(k)\}\) determined by system (1) one has the “averaged” relations
Taking into account the equalities (obtained with allowance for the rule of calculating the repeated expectation)
As a result, based on condition (8), we obtain the inequality
If the inequality \(k > \tau _{\varepsilon } \) holds (in this case, \(\tau (k) = \tau _{\varepsilon }\)), then we have the relations
Since the Lyapunov function \(V(k,\mathbf {x})\) is continuous for each \(k\in {\mathbb Z}_{+} \), \(V(t, \mathbf {0}) \equiv 0 \), and conditions (7) are satisfied for all \(k _{0} \geq 0 \) and for each given number \(L> 0 \), we conclude that the limit relation
Therefore, for all \(k _{0} \geq 0\) and for each given number \(L> 0\), based on inequalities (A.2) and (A.3), we have the limit relation
As a result, for each \(k _{0} \leq 0\) and for any arbitrarily small numbers \(\varepsilon > 0\) and \(\gamma > 0 \), as well as for each number \(L>0 \) given in advance, there exists a number \(\delta (\varepsilon , \gamma , L, k _{0}) > 0\) such that inequality (2) holds for all \(k \geq k _{0 } \) and \(\mathbf {x}_{0 }\in D_{\delta }\). Consequently, for large values of \(\mathbf {z} _{10}\) on the whole with respect to \(\mathbf {z} _{20}\) the “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0} \) of system (1) is \(\mathbf {y} _{1}\) -stable in probability.
II. If conditions (9) are satisfied instead of conditions (7), then for each given number \(L>0 \) the limit relation (A.3) is satisfied for \(\|\mathbf {z} _{10}\| \leq L \) uniformly not only with respect to \(\|\mathbf {z} _{20}\| <\infty \) but also with respect to \(k _{0} \geq 0 \). As a result, for each \(k _{0} \geq 0 \) and for any arbitrarily small numbers \(\varepsilon > 0\) and \(\gamma > 0 \), as well as for each number \(L>0 \) given in advance there exists a number \(\delta (\varepsilon , \gamma , L) > 0\) independent of \(k_{0} \) such that inequality (2) holds for all \(k \geq k _{0 }\) and \(\mathbf {x} _{0 }\in D _{\delta }\). Consequently, for large values of \(\mathbf {z} _{10}\) on the whole with respect to \(\mathbf {z} _{20}\) the “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0} \) of system (1) is uniformly \(\mathbf {y} _{1}\) -stable in probability. The proof of Theorem 1 is complete. \(\quad \blacksquare \)
Proof of Theorem 2. Under the assumptions of the theorem, the “partial” equilibrium \(\mathbf {y}(k) = \mathbf {0} \) of system \((1) \) is uniformly \(\mathbf {y} _{1} \)-stable in probability for large values of \(\mathbf {z} _{10}\) on the whole with respect to \(\mathbf {z} _{20}\).
Based on inequality (A.1), the sequence \(v(k) \) of random variables \(v(k)=V(\tau (k),\mathbf {x}(\tau (k);k _{0},\mathbf {x} _{0}))\) generated by realizations \(\{\mathbf {x}(k, \omega ), \boldsymbol {\xi }(k, \omega )\}\) of the random process \(\{\mathbf {x}(k), \boldsymbol {\xi }(k)\}\) determined by system (1) forms a nonnegative supermartingale, which is an analog of a monotone decreasing sequence in the deterministic case. Therefore, based on inequality (A.1), for each initial point \(\mathbf {x} _{0} \) in the domain \(D _{\varepsilon } \), with probability \(1 \) one has the limit relation [36]
Using the well-known scheme of analysis [2, 3, 9], it can be shown that the equality \(v_{*} =0\) is satisfied with probability \( 1\). Indeed, applying the operation of expectation and passing to the limit on both sides of inequality (11), with probability \(1 \) we obtain
Therefore, by virtue of conditions (10), (11) and the Fatou lemma the equality \(\mathbf {E}[a_{3} (a_{2}^{-1} (v_{*} ))]=0 \) holds, which implies that \(v_{*} =0 \). However, in the case of \(v_{*} =0 \), as \(\|\mathbf {y}_{0}\|\to 0 \) one has the limit relation
Rights and permissions
About this article
Cite this article
Vorotnikov, V.I., Martyshenko, Y.G. On the Partial Stability Problem for Nonlinear Discrete-Time Stochastic Systems. Autom Remote Control 82, 1554–1567 (2021). https://doi.org/10.1134/S0005117921090046
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0005117921090046