Abstract
This paper considers the system modeling problem for the Hammerstein nonlinear model with unknown but bounded noise. A two-stage ellipsoid filtering-based modeling algorithm is proposed and the unknown noise term is wrapped in an ellipsoid during each recursive step. The normalized ellipsoid is varying and its center, as well as its volume, is updated by using the volume minimization criteria of the ellipsoid. Finally, the given simulations visually illustrate the feasible parameter set variation process and the motion trail of the ellipsoids, which shows the effectiveness and the accuracy of the proposed algorithm.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
System modeling [1, 2] is one of the most common methods to find the true value of the complex models and analyze the relation between the input and output signals. However, it is commonly infeasible to find the actual distribution law of the system disturbance, which yields that the probability distribution function of the noise term cannot be assumed facilely. The non-probabilistic noise term results in that the distribution law of the disturbance is hardly precise. Meanwhile, since the unknown feasible solutions of the uncertainty parameters are fitted in a convex set, it cannot directly analyze its variation law for the recursive irregular figures. In the research field of the system modeling, the unknown but bounded noise term are wrapped by some recursively computable spaces [3,4,5].
In recent years, the set membership modeling algorithm is studied for estimating the parameters of the systems with unknown but bounded noise term [6,7,8]. Some geometric spaces with regular structures are commonly used for describing the bounded noise terms, i.e., the ellipsoid space is usually adopted for the simplicity of its formulation [9, 10]. However, the space sets listed in the previous works are commonly fitted for the linear system identification field, rather than in the system modeling for the nonlinear ones, i.e., the Hammerstein system. Considering the computational complexity and the estimation accuracy, in this paper, the ellipsoid space is employed for constructing the known boundary of the noise term.
Differing from the proposed algorithms in [9, 10], in order to diminish the impact of unknown but bounded colored noise term, this paper considers the modeling problem of Hammerstein models and a two-stage ellipsoid filtering modeling algorithm is studied. Meanwhile, compared with the work in [11], this paper derives a two-stage algorithm for solving the nonlinear system identification problem under the disturbance of unknown but bounded noise term. The main contributions of this paper are listed as follows: (1) A two-stage filtering method is proposed for the Hammerstein system modeling by filtering the nonlinear model with unknown noises into two different subsystems, one contains the noise term and the other includes the system parameters; (2) the minimization criteria are adopted to determine the recursive step and find the minimum value of the ellipsoid volume; (3) the simulation results show the motion trail of the ellipsoid sets via the sample time, which can directly illustrate the parameter estimation process.
Briefly, the rest of this paper is organized as follows. Section 2 gives the Hammerstein system with an unknown but bounded noise term and its identification model. Section 3 presents a two-stage ellipsoid minimization volume-based filtering algorithm by adopting different ellipsoids to wrap the boundary of the feasible parameter sets. Section 4 provides the simulations to illustrate the accuracy and effectiveness of the proposed algorithm. Finally, the conclusions and some future works are offered in Sect. 5.
2 Problem statement
The following single input/single output nonlinear system is further considered:
where \(\{u(t),y(t)\}\) is the pair of the signal sequences at time t, v(t) is the unknown bounded noise term with a priori bound \(\delta \). B(z) and D(z) are combinations of negative powers that are defined by \(B(z):=1+\sum \nolimits _{i=1}^{n_b}b_iz^{-i}\) and \(D(z):=1+\sum \nolimits _{j=1}^{n_d}d_jz^{-j}\) in the unit delay operator \(z^{-1}\) [\(z^{-1}y(t)=y(t-1)\)]. The nonlinear term in the model (1) is defined by \({\bar{u}}(t):=\sum \nolimits _{i=1}^{n_c}c_if_i(u(t))\).
The aim of identifying this nonlinear Hammerstein system is to propose a geometrical recursive algorithm to consistently estimate the unknown parameter vectors \({\varvec{b}}:=[b_1,b_2,\ldots ,b_{n_b}]^{\mathrm{T}}\in {{\mathbb {R}}}^{n_b}\), \({\varvec{c}}:=[c_1,c_2,\ldots ,c_{n_c}]^{\mathrm{T}}\in {{\mathbb {R}}}^{n_c}\), \({\varvec{d}}:=[d_1,d_2,\ldots ,d_{n_d}]^{\mathrm{T}}\in {{\mathbb {R}}}^{n_d}\), from the measured data \(\{u(t), y(t)\}_{t=1}^{L}\). From Eq. (1), the identification model can be rewritten as
where
From Eq. (2), since the error bound of the model is known, the parameters belong to the membership set \(S(L):=\{{\varvec{\theta }}|y(t)-\delta \leqslant {\varvec{\varphi }}^{\mathrm{T}}(t){\varvec{\theta }}\leqslant y(t)+\delta ,\ t\in [1,L]\}\). In the geometry, the set S(L) is delimited by L pairs of parallel hyperplanes, i.e., \(H_1(t):=\{{\varvec{\theta }}|{\varvec{\varphi }}^{\mathrm{T}}(t){\varvec{\theta }}=y(t)-\delta \}\) and \(H_2(t):=\{{\varvec{\theta }}|{\varvec{\varphi }}^{\mathrm{T}}(t){\varvec{\theta }}=y(t)+\delta \}\). In the whole parametric space, the hyperplanes are the boundaries of different subspaces. With the data length L increases, the parametric space will be divided into more blocks but only one narrower piece stands for the parameter uncertainty set S(L).
The geometric space goes more flexible as the input data length getting bigger, which rises a gordian knot that it is hardly to form precisely the periphery of the parameter feasible set. The objective of this paper is to find a filtering-based recursive parameter feasible set \(\Theta (t+1)\) that contains the solution \({\varvec{\theta }}(t+1)\) at time \(t+1\) when given the parameter feasible set \(\Theta (t)\).
3 The ellipsoid volume minimization-based filtering algorithm
The unknown noise term \(w(t):=D(z)v(t)\) in Eq. (1) at time t is determined by the input/output sampled data. When the polynomial D(z) equals 1, the feasible parameters of the nonlinear system is easy to be filled in two parallel hyperplanes, as mentioned before. However, the polynomial D(z) is commonly constructed by some unknown parameters \(d_i\) that satisfies \(\prod \nolimits _{i=1}^{n_d}d_i\ne 0\), \(i\in [1,n_d]\), which means the noise term will not be a regular spatial graphic and it is difficult to use the traditional set estimation methods to solve this type of system identification problem.
To avoid the irregular geometric construction and reduce the computation complexity, the filtering idea is adopted to transfer the nonlinear system into two different parts in this section. Based on the input and output signals, the identification model in Eq. (2) can be changed into a controlled autoregressive model by adopting the unknown filter \(D^{-1}(z)\). The filtered model can be written as
where \({\bar{u}}_{\mathrm{f}}(t):=\sum \nolimits _{i=1}^{n_c}c_iU_i(t)\) and \(y_{\mathrm{f}}(t):=\frac{1}{D(z)}y(t)\). The intermediate variable \(U_i(t)\) is defined by \(U_j(t):=\frac{1}{D(z)}f_j(u(t)),\ j=1, 2, \ldots , n_c\). Then, Eq. (3) can be written as
Define the filtered information vector and two parameter vectors:
From Eq. (4), the parameters \(c_i\) and \(b_j\) are determined by a feasible set and the two parallel hyperplanes \(H_{1,\mathrm f}(t)\), \(H_{2,\mathrm f}(t)\) that divide the n-dimensional space, are listed as follows:
However, the true values of the parameters are all in part of the space instead of the whole space, i.e.,
Since the unknown but bounded noise term \(v(t)=y_{\mathrm{f}}(t)-{\varvec{\varphi }}_{\mathrm{f}}^{\mathrm{T}}(t){\varvec{\theta }}_\mathrm{s}\) determines the spatial distance between the two parallel hyperplanes \(H_{1,\mathrm f}(t)\), \(H_{2,\mathrm f}(t)\), the ellipsoid set membership idea can be adopted in estimating \({\varvec{{\hat{\theta }}}}(t)\) as the first stage in solving all the parameter estimates. The filtered model in Eq. (4) can be rewritten in a vector form:
or
where \(y_{\mathrm{f}}(t)=y(t)-\sum \nolimits _{i=1}^{n_d}d_iy_{\mathrm{f}}(t-i)\). Because of the unknown parameters \(d_i\), it is impossible to use \({\bar{u}}_{\mathrm{f}}(t)\) to construct the known parameter vector \({\varvec{\varphi }}_{\mathrm{f}}(t)\) in Eq. (5). The solution here is to use their estimates to derive the following filtering-based ellipsoid recursive algorithm for the Hammerstein models.
For the filtered model in Eq. (11), the normalized ellipsoidal set is
where \(P_{\mathrm{s}}\) is the symmetric, positive definite shape matrix for ellipsoidal set \(E(P_{\mathrm{s}}^{-1},\hat{{\varvec{\theta }}}_{\mathrm{s}})\). The priori assumed noise bound \(\sigma _{\mathrm{s}}\) also represents the radius of the ellipsoid \(E(P^{-1},\hat{{\varvec{\theta }}}_{\mathrm{s}})\) and the error bound of feasible parameter \({{\varvec{\theta }}}_{\mathrm{s}}\) is lower than the \({{\varvec{\theta }}}\), that is, \(\sigma _{\mathrm{s}}\leqslant \sigma \). The estimates \({\hat{B}}(t,z)\) and \({\hat{D}}(t,z)\) are constructed by \({\hat{B}}(t,z):=1+\sum \nolimits _{i=1}^{n_b}{\hat{b}}_i(t)z^{-i}\) and \({\hat{D}}(t,z):=1+\sum \nolimits _{j=1}^{n_d}{\hat{d}}_j(t)z^{-j}\), respectively.
In the first stage, the intermediate variable estimates are \({\hat{w}}(t):=\hat{{\varvec{\varphi }}}_{\mathrm{n}}^{\mathrm{T}}(t)\hat{{\varvec{\theta }}}_{\mathrm{n}}(t-1)+{\hat{v}}(t)\), where the \(\hat{{\varvec{\varphi }}}_{\mathrm{n}}(t)\) is determined by the estimates \({\hat{v}}(t-i)\), \(i=1, 2, \ldots , n_d\). Similarly to the procedure of forming the normalized ellipsoid in Eq. (13), the set of feasible parameter vector \({{\varvec{\theta }}}_{\mathrm{n}}\) is defined as follows:
where \(P_{\mathrm{n}}\) is also a symmetric, positive definite shape matrix that determines the position of the normalized ellipsoid. Using the ellipsoid volume minimization principle, we list the ellipsoid volume minimization-based filtering (EVMF for short) algorithm in the first stage to compute \(\hat{{\varvec{\theta }}}_{\mathrm{n}}(t)\):
The intermediate variable \(q_{\mathrm{n}}(t)\) is the positive real root of the equation
where \(\lambda _\mathrm{n,2}(t):=(n_{d}-1)\sigma ^4_{\mathrm{n}}(t-1)g^{2}_{\mathrm{n}}(t)\), \(\lambda _\mathrm{n,1}(t):=[(2n_{d}-1)\delta ^2(t)-\sigma ^2_{\mathrm{n}}(t-1)g_{\mathrm{n}}(t)+r_{\mathrm{n}}^{2}(t)]\sigma ^2_{\mathrm{n}}(t-1)g_{\mathrm{n}}(t)\), \(\lambda _\mathrm{n,0}(t):=[n_d(\delta ^2(t)-r_{\mathrm{n}}^{2}(t))-\sigma ^2_{\mathrm{n}}(t-1)g_{\mathrm{n}}(t)]\delta ^2(t)\). If Eq. (15) does not have any positive real root, i.e., the sampling data at time t do not update the ellipsoid \(E(P_{\mathrm{n}}^{-1},\hat{{\varvec{\theta }}}_{\mathrm{n}})\), let \(q_{\mathrm{n}}(t)=0\) at time t.
In the second stage, the other ellipsoidal set in Eq. (13) is to be formed. The filter \({\hat{D}}^{-1}(t,z)\) is obtained after running the first stage of the EVMF algorithm and it is easy to compute the estimates, such as \(\hat{{\bar{u}}}_{\mathrm{f}}(t)=\sum \nolimits _{i=1}^{n_c}{\hat{c}}_i(t){\hat{U}}_i(t)\), \({\hat{y}}_{\mathrm{f}}(t)=-\sum \nolimits _{j=1}^{n_d}{\hat{d}}_j(t){\hat{y}}_{\mathrm{f}}(t-j)+y(t)\). The intermediate term \({\hat{U}}_k(t)\) can be computed by \({\hat{U}}_k(t):=\frac{1}{D(z)}f_k(u(t))=-\sum \nolimits _{l=1}^{n_d}{\hat{d}}_l(t){\hat{U}}_k(t-l)+f_k(u(t))\). Construct the estimate of \({\varvec{\varphi }}_{\mathrm{f}}(t)\) with \(\hat{{\bar{u}}}_{\mathrm{f}}(t)\) and \({\hat{U}}_j(t)\):
Similarly to the first stage of EVMF algorithm, by using the ellipsoid volume minimization principle, the estimation of \(\hat{{\varvec{\theta }}}_{\mathrm{s}}(t)\) can be obtained in the second stage. By replacing v(t), \(y_{\mathrm{f}}(t)\), \({\varvec{\varphi }}_{\mathrm{f}}(t)\) and \({\varvec{\theta }}_{\mathrm{s}}\) in Eq. (12) with their estimates \({\hat{v}}(t)\), \({\hat{y}}_{\mathrm{f}}(t)\), \(\hat{{\varvec{\varphi }}}_{\mathrm{f}}(t)\) and \(\hat{{\varvec{\theta }}}_{\mathrm{s}}(t)\) at time t, the filtered noise vector can be computed as
In conclusion, the two-stage ellipsoid filtering-based system modeling algorithm for Hammerstein models can be summarized.
4 Examples
Example 1
In order to verify the feasibility of the proposed method in this paper, a finite impulse response system is studied. The mathematical model can be written as:
where \({\varvec{\theta }}_{\mathrm{s}}=[-0.6786, -0.0176]^{\mathrm{T}}\) and \({\varvec{\theta }}_{\mathrm{n}}=[0.0286, 0.0202]^{\mathrm{T}}\) are, respectively, the system term parameter vector and the noise term parameter vector. The unknown but bounded noise term \(\Vert v(t)\Vert \leqslant 1\). In this simulation, the input and noise signals are uniform random numbers that are randomly distributed in the interval \([-1, 1]\). By using the proposed EVMF algorithm, the ellipsoid set of noise term in stage one and the other ellipsoid set of the system noise term parameters are changing their positions during the recursive steps. The noise term ellipsoid sets and estimation errors via sampling time are shown in Figs. 1 and 2, respectively.
From Figs. 1 and 2, it can be seen that
- 1.
The volumes of the ellipsoids reduce increasing slower as the sampling time goes, which shows the good convergence of the proposed algorithm;
- 2.
The unknown parameter vectors can be directly obtained from the centers of the ellipsoids;
- 3.
The elliptical track illustrates the feasible set at each time instant, and the proposed ellipsoids are hardly changing their positions, which means the parameter estimates are converging to the true values.
Example 2
Consider the mathematical model:
where \({\varvec{\theta }}_{\mathrm{s}}=[b, c]^{\mathrm{T}}=[0.2582, -0.8415]^{\mathrm{T}}\), and \({\varvec{\theta }}_{\mathrm{n}}=[d_1, d_2]^{\mathrm{T}}=[0.0865,0.0427]^{\mathrm{T}}\) are the system term parameter vector and the noise term parameter vector, respectively. The noise term for this example is narrow-band random noise v(t), which defined by a unified model [12]:
where h is the intensity of the random excitation, \(\Omega \) is the center frequency of the random excitation, W(t) is the standard Wiener process, and \(\gamma \geqslant 0\) is the bandwidth of the random excitation. When the bandwidth \(\gamma \) is small, v(t) is a narrow-band random noise. The random process v(t) defined by Eq. (16) can be rewritten as follows:
where the formal derivative \(\zeta (t)\) of the unit Wiener process is a Gaussian white noise. Similarly to the works in [12], let the spectral density \(S_{v}(w)\) of noise term v(t) be 1 when \(0 < w\leqslant 2w_0\), and 0 at the rest. Then, \(\zeta (t)\) can be simulated by:
where \(\varphi _k\) is a sequence of independent and identically distributed random variables that uniformly distributed over \((0,2\pi ]\), where N is a larger integer. Take \(\Omega =2.0\), \(w_0=1.0\), \(\gamma =0.01\), \(h=1.0\), \(N=3100\), and set the input signal be uniform random numbers that are randomly distributed in the interval \([-1, 1]\). By using the proposed EVMF algorithm, the noise term ellipsoid sets via sampling time are shown in Fig. 3. From Fig. 3, it can be concluded that the EVMF algorithm is also effective in estimating the system parameters under the narrow-band random noise disturbance.
5 Conclusions
This paper presents a two-stage ellipsoid estimation algorithm for the Hammerstein nonlinear system with unknown noises. The probability distribution of the noise term is unknown, and ellipsoidal sets are formed to contain the feasible noise parameters. This work can be also extended to deal with other types of nonlinear system modeling problems, such as the Wiener nonlinear system modeling and parameter estimation for the error-in-variables systems.
References
Sersour, L., Djamah, T., Bettayeb, M.: Nonlinear system identification of fractional Wiener models. Nonlinear Dyn. 92(4), 1493–1505 (2018). https://doi.org/10.1007/s11071-018-4142-0
Voros, J.: Iterative identification of nonlinear dynamic systems with output backlash using three-block cascade models. Nonlinear Dyn. 79(3), 2187–2195 (2015). https://doi.org/10.1007/s11071-014-1804-4
Mohammad, A.A., Hamid, K., Ahmadreza, V., Mohammad, R.A.: Set value-based dynamic model development for non-linear manoeuvring target tracking problem in the presence of unknown but bounded disturbances. IET Radar Sonar Navig. 12(2), 186–194 (2018). https://doi.org/10.1049/iet-rsn.2017.0293
Vito, C., Jean, B.L., Dario, P., Diego, R.: A unified framework for solving a general class of conditional and robust set-membership estimation problems. IEEE Trans. Autom. Control 59(11), 2897–2909 (2014). https://doi.org/10.1109/TAC.2014.2351695
Ge, X.H., Han, Q.L., Yang, F.W.: Event-based set-membership leader-following consensus of networked multi-agent systems subject to limited communication resources and unknown-but-bounded noise. IEEE Trans. Ind. Electron. 64(6), 5045–5054 (2017). https://doi.org/10.1109/TIE.2016.2613929
Wang, Z., Tian, Q., Hu, H.Y.: Dynamics of spatial rigid-flexible multibody systems with uncertain interval parameters. Nonlinear Dyn. 84(2), 527–548 (2016). https://doi.org/10.1007/s11071-015-2504-4
Zheng, Z.S., Liu, Z.G., Zhao, H.Q., Yu, Y., Lu, L.: Robust set-membership normalized subband adaptive filtering algorithms and their application to acoustic echo cancellation. IEEE Trans. Circuits Syst. I Regul. Pap. 64(8), 2098–2111 (2017). https://doi.org/10.1109/TCSI.2017.2685679
Liu, C., Zhi, Z.: Set-membership normalised least M-estimate spline adaptive filtering algorithm in impulsive noise. Electron. Lett. 54(6), 393–395 (2018). https://doi.org/10.1049/el.2017.4434
Goudjil, A., Pouliquen, M., Pigeon, E., Gehan, O.: Identification algorithm for MIMO switched output error model in presence of bounded noise. In: IEEE Conference on Decision & Control, pp. 5286–5291 (2017). https://doi.org/10.1109/CDC.2017.8264441
Liu, Y.S., Zhao, Y., Wu, F.L.: Ellipsoidal state-bounding-based set-membership estimation for linear system with unknown-but-bounded disturbances. IET Control Theory Appl. 10(4), 431–442 (2016). https://doi.org/10.1049/iet-cta.2015.0654
Wang, Z.Y., Wang, Y., Ji, Z.C.: A novel two-stage estimation algorithm for nonlinear Hammerstein–Wiener systems from noisy input and output data. J. Frankl. Inst. 354, 1937–1944 (2017). https://doi.org/10.1016/j.jfranklin.2016.12.024
Rong, H.W., Xu, W., Wang, X.D., et al.: Response statistics of two-degree-of-freedom non-linear system to narrow-band random excitation. Int. J. Non Linear Mech. 37(6), 1017–1028 (2002). https://doi.org/10.1016/S0020-7462(01)00024-5
Acknowledgements
This work is supported in part by Basic Science Research Programs through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (Grant Number NRF-2017R1A2B2004671), the National Natural Science Foundation of China (61802150, 61803180), Natural Science Foundation of Jiangsu Province (BK20170196, BK20180599), the China Postdoctoral Science Foundation Funded Project (2018M642161), the Fundamental Research Funds for the Central Universities with Grant (JUSRP11860), the Fundamental Research Funds for the Central Universities (JUSRP51912B), Jiangsu Key Laboratory of Advanced Food Manufacturing Equipment & Technology (FM-2019-07) and in part by the 111 Project (B12018).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This manuscript is original and has not been published and will not be submitted elsewhere for publication while being considered by Nonlinear Dynamics. The study is not split up into several parts to increase the quantity of submissions and submitted to various journals or to one journal over time. No data have been fabricated or manipulated to support the conclusions. No data, text, or theories by others are presented as if they were our own. The submission has been received explicitly from all co-authors. The authors whose names appear on the submission have contributed sufficiently to the scientific work and therefore share collective responsibility and accountability for the results.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, Z., Tang, Z. & Park, J.H. A novel two-stage ellipsoid filtering-based system modeling algorithm for a Hammerstein nonlinear model with an unknown noise term. Nonlinear Dyn 98, 2919–2925 (2019). https://doi.org/10.1007/s11071-019-05231-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11071-019-05231-y