Abstract
By means of the model equivalence theory, this paper proposes a model equivalence based least squares iterative algorithm for estimating the parameters of stochastic dynamical systems with ARMA noise. The proposed algorithm reduces the number of the unknown noise terms in the information vector and can give more accurate parameter estimates compared with the generalized extended least squares algorithm. The validity of the proposed method is evaluated through a numerical example.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Y. Wei, J. Qiu, H. K. Lam, and L. Wu, “Approaches to T-S fuzzy-affine-model-based reliable output feedback control for nonlinear Itô stochastic systems,” IEEE Transactions on Fuzzy Systems, vol. 25, no. 3, pp. 569–583, May 2016. [click]
Y. Wei, J. Qiu, H. R. Karimi, and M. Wang, “New results on H-infinity dynamic output feedback control for Markovian jump systems with time-varying delay and defective mode information,” Optimal Control, Applications and Methods, vol. 35, no. 6, pp. 656–675, November 2014. [click]
Y. Wei, J. Qiu, H. R. Karimi, and M. Wang, “H-infinity model reduction for continuous-time Markovian jump systems with incomplete statistics of mode information,” International Journal of Systems Science, vol. 45, no. 7, pp. 1496–1507, 2014. [click]
F. Ding, L. Xu, and Q. M. Zhu, “Performance analysis of the generalised projection identification for time-varying systems,” IET Control Theory and Applications, vol. 10, no. 18, pp. 2506–2514, December 2016. [click]
F. Ding, F. F. Wang, L. Xu, T. Hayat, and A. Alsaedi, “Parameter estimation for pseudo-linear systems using the auxiliary model and the decomposition technique,” IET Control Theory and Applications, vol. 11, no. 3, pp. 390–400, February 2017. [click]
Y. Wei, J. Qiu, H. R. Karimi, and M. Wang, “Filtering design for two-dimensional Markovian jump systems with state-delays and deficient mode information,” Information Sciences, vol. 269, pp. 316–331, June 2014. [click]
Y. Wei, J. Qiu, and H. R. Karimi, “Quantized H-infinity filtering for continuous-time Markovian jump systems with deficient mode information,” Asian Journal of Control, vol. 17, no. 5, pp. 1914–1923, September 2015. [click]
L. Xu and F. Ding, “Recursive least squares and multiinnovation stochastic gradient parameter estimation methods for signal modeling,” Circuits, Systems and Signal Processing, vol. 36, no. 4, pp. 1735–1753, April 2017. [click]
L. Xu, “A proportional differential control method for a time-delay system using the Taylor expansion approximation,” Applied Mathematics and Computation, vol. 236, pp. 391–399, June 2015.
L. Xu, L. Chen, and W. L. Xiong, “Parameter estimation and controller design for dynamic systems from the step responses based on the Newton iteration,” Nonlinear Dynamics, vol. 79, no. 3, pp. 2155–2163, February 2015.
L. Xu, “The damping iterative parameter identification method for dynamical systems based on the sine signal measurement,” Signal Processing, vol. 120, pp. 660–667, March 2016.
L. Xu and F. Ding, “The parameter estimation algorithms for dynamical response signals based on the multiinnovation theory and the hierarchical principle,” IET Signal Processing, vol. 11, no. 2, pp. 228–237, April 2017. [click]
F. Ding, F. F. Wang, L. Xu, and M. H. Wu, “Decomposition based least squares iterative identification algorithm for multivariate pseudo-linear ARMA systems using the data filtering,” Journal of the Franklin Institute, vol. 354, no. 3, pp. 1321–1339, February 2017. [click]
L. Xu, “Application of the Newton iteration algorithm to the parameter estimation for dynamical systems,” Journal of Computational and Applied Mathematics, vol. 288, pp. 33–43, November 2015.
M. H. Li, X. M. Liu, and F. Ding, “Least-squares-based iterative and gradient-based iterative estimation algorithms for bilinear systems,” Nonlinear Dynamics, vol. 89, no. 1, pp. 197–211, July, 2017.
M. H. Li, X. M. Liu, and F. Ding, “The maximum likelihood least squares based iterative estimation algorithm for bilinear systems with autoregressive noise,” Journal of the Franklin Institute, vol. 354, no. 12, pp. 4861–4881, August 2017. [click]
J. X. Ma, W. L. Xiong, and F. Ding, “Iterative identification algorithms for input nonlinear output error autoregressive systems,” International Journal of Control, Automation, and Systems, vol. 14, no. 1, pp. 140–147, January 2016. [click]
D. Q. Wang and Y. P. Gao, “Recursive maximum likelihood identification method for a multivariable controlled autoregressive moving average system,” IMA Journal of Mathematical Control and Information, vol. 33, no. 4, pp. 1015–1031, December 2016. [click]
T. Söderström, M. Hong, J. Schoukens, and R. Pintelon, “Accuracy analysis of time domain maximum likelihood method and sample maximum likelihood method for errors-in-variables and output error identification,” Automatica, vol. 46, no. 4, pp. 721–727, April 2010. [click]
J. H. Li, W. X. Zheng, J. P. Gu, and L. Hua, “Parameter estimation algorithms for Hammerstein output error systems using Levenberg-Marquardt optimization method with varying interval measurements,” Journal of the Franklin Institute, vol. 354, no. 1, pp. 316–331, January 2017.
D. Q. Wang, L. Mao, and F. Ding, “Recasted models based hierarchical extended stochastic gradient method for MIMO nonlinear systems,” IET Control Theory and Applications, vol. 11, no. 4, 476–485, February 2017. [click]
L. Ma and X. G. Liu, “A nonlinear recursive instrumental variables identification method of Hammerstein ARMAX system,” Nonlinear Dynamics, vol. 79, no. 2, pp. 1601–1613, January 2015. [click]
J. H. Li, “Parameter estimation for Hammerstein CARARMA systems based on the Newton iteration,” Applied Mathematics Letters, vol. 26, no. 1, pp. 91–96, January 2013.
D. D. Meng and F. Ding, “Identification of stochastic systems with colored noise by the model equivalence theory,” The 28th Chinese Control and Decision Conference, Yinchuan, China, pp. 5842–5847, May 2016.
D. D. Meng and F. Ding, “Model equivalence-based identification algorithm for equation-error systems with colored noise,” Algorithms, vol. 8, no. 2, pp. 280–291, June 2015. [click]
F. Ding, D. D. Meng, and Q. Wang, “The model equivalence based parameter estimation methods for Box-Jenkins systems,” Journal of the Franklin Institute, vol. 352, no. 12, pp. 5473–5485, December 2015.
F. Ding, X. P. Liu, and Y. Shi, “Convergence analysis of estimation algorithms for dual-rate stochastic systems,” Applied Mathematics and Computation, vol. 176, no. 1, pp. 245–261, May 2006.
L. Xu, F. Ding, Y. Gu, A. Alsaedi, and T. Hayat, “A multiinnovation state and parameter estimation algorithm for a state space system with d-step state-delay,” Signal Processing, vol. 140, pp. 97–103, November 2017. [click]
J. Chen and B. Jiang, “Modified stochastic gradient parameter estimation algorithms for a nonlinear two-variable difference system,” International Journal of Control, Automation, and Systems, vol. 14, no. 6, pp. 1493–1500, December 2016. [click]
D. Q. Wang, Z. Zhang, and J. Y. Yuan, “Maximum likelihood estimation method for dual-rate Hammerstein systems,” International Journal of Control, Automation, and Systems, vol. 15, no. 2, pp. 698–705, April 2017. [click]
J. Pan, X. Jiang, X. K. Wan, and W. F. Ding, “A filtering based multi-innovation extended stochastic gradient algorithm for multivariable control systems,” International Journal of Control, Automation, and Systems, vol. 15, no. 3, pp. 1189–1197, June 2017. [click]
M. H. Li, X. M. Liu, and F. Ding, “The gradient based iterative estimation algorithms for bilinear systems with autoregressive noise,” Circuits, Systems and Signal Processing, vol. 36, no. 11, pp. 4541–4568, November 2019.
F. Ding, X. H. Wang, L. Mao, and L. Xu, “Joint state and multi-innovation parameter estimation for time-delay linear systems and its convergence based on the Kalman filtering,” Digital Signal Processing, vol. 62, pp. 211–223, March 2017.
X. Zhang, F. Ding, A. Alsaadi, and T. Hayat, “Recursive parameter identification of the dynamical models for bilinear state space systems,” Nonlinear Dynamics, vol. 89, no. 4, pp. 2415–2429, September 2017.
N. Zhao, M. H. Wu, and J. J. Chen, “Android-based mobile educational platform for speech signal processing,” International Journal of Electrical Engineering Education, vol. 54, no. 1, pp. 3–16, January 2017.
N. Zhao, Y. Chen, R. Liu, M. H. Wu, and W. Xiong, “Monitoring strategy for relay incentive mechanism in cooperative communication networks,” Computers & Electrical Engineering, vol. 60, pp. 14–29, January 2017.
F. Ding, Y. J. Wang, J. Y. Dai, Q. S. Li, and Q. J. Chen, “A recursive least squares parameter estimation algorithm for output nonlinear autoregressive systems using the inputoutput data filtering,” Journal of the Franklin Institute, vol. 354, no. 15, pp. 6938–6955, October 2017.
X. Cao, D. Q. Zhu, and S. X. Yang, “Multi-AUV target search based on bioinspired neurodynamics model in 3-D underwater environments,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 11, pp. 2364–2374, November 2016. [click]
Z. Z. Chu, D. Q. Zhu, and S. X. Yang, “Observer-based adaptive neural network trajectory tracking control for remotely operated vehicle,” IEEE Transactions on Neural Networks and Learning Systems, vol. 28, no. 7, pp. 1633–1645, July 2017. [click]
M. T. Chen, F. Ding, L. Xu, T. Hayat, and A. Alsaedi, “Iterative identification algorithms for bilinear-in-parameter systems with autoregressive moving average noise,” Journal of the Franklin Institute, vol. 354, no. 17, pp. 7885–7898, November 2017.
F. Ding and X. H. Wang, “Hierarchical stochastic gradient algorithm and its performance analysis for a class of bilinear-in-parameter systems,” Circuits, Systems and Signal Processing, vol. 36, no. 4, pp. 1393–1405, Aptil 2017.
L. Xu, “The parameter estimation algorithms based on the dynamical response measurement data,” Advances in Mechanical Engineering, vol. 9, no. 11, pp. 1–12, November 2017. [click]
Y. Ji and F. Ding, “Multiperiodicity and exponential attractivity of neural networks with mixed delays,” Circuits, Systems and Signal Processing, vol. 36, no. 6, pp. 2558–2573, June 2017. [click]
J. L. Ding, “Recursive and iterative least squares parameter estimation algorithms for multiple-input-output-error systems with autoregressive noise,” Circuits, Systems and Signal Processing, vol. 37, 2018. doi: 10.1007/s00034-017-0636-0 [click]
J. L. Ding, “The hierarchical iterative identification algorithm for multi-input-output-error systems with autoregressive noise,” Complexity, 2017, 1–11. Article ID5292894. https://doi.org/10.1155/2017/5292894
Author information
Authors and Affiliations
Corresponding author
Additional information
Recommended by Associate Editor Yongping Pan under the direction of Editor Duk-Sun Shim. This work was supported by the National Natural Science Foundation of China (Nos. 60474039, 61164015) and the Flexible Distinguished Top-Level Talent Plan of Jiangxi Province Talent Project 555.
Feng Ding received his B.Sc. degree from the Hubei University of Technology (Wuhan, China) in 1984, and his M.Sc. and Ph.D. degrees both from the Tsinghua University, in 1991 and 1994, respectively. He has been a professor in the School of Internet of Things Engineering at the Jiangnan University (Wuxi, China) since 2004. His current research interests include model identification and adaptive control. He authored four books on System Identification.
Dandan Meng was born in Jilin (Jilin Province, China) in 1993. She received her B.Sc and M.Sc degrees both in the School of Internet of Things Engineering at the Jiangnan University (Wuxi, China), in 2014 and 2017, respectively. Her research interests include system identification.
Jiyang Dai was born in Jiujiang, Jiangxi Province. He received his B.Sc. and M.Sc. degrees from the Nanjing University of Aeronautics and Astronautics (Nanjing, China), in 1988 and 1991, and Ph.D. degree from Beihang University (Beijing, China) in 2001. From 1991 to now, he is with and is a Professor in the Nanchang Hangkong University (Nanchang, China). His current research interests include robust control theory and applications, intelligent controls, helicopter control.
Qishen Li received his B.Sc., M.Sc. and Ph.D degrees from Huazhong University of Science and Technology (Wuhan, China), in 1998, 2000, and 2005, repsectively. He has been an associate professor in the School of Information Engineering at the Nanchang Hangkong University (Nanchang, China) since 2006. His current research interests include artificial intelligence and pattern recognition.
Ahmed Alsaedi obtained his Ph.D. degree from Swansea University (UK) in 2002. He has a broad experience of research in applied mathematics. His fields of interest include dynamical systems, nonlinear analysis involving ordinary differential equations, fractional differential equations, boundary value problems, mathematical modeling, biomathematics, Newtonian and Non-Newtonian fluid mechanics. He has published several articles in peer-reviewed journals. He has supervised several M.S. students and executed many research projects successfully. He is a reviewer of several international journals. He served as the chairman of the mathematics department at KAU and presently he is serving as director of the research program at KAU. Under his great leadership, this program is running quite successfully and it has attracted a large number of highly rated researchers and distinguished professors from all over the world. He is also the head of NAAM international research group at KAU.
Tasawar Hayat was born in Khanewal, Punjab, Distinguished National Professor and Chairperson of Mathematics Department at Quaid-I-Azam University is renowned worldwide for his seminal, diversified and fundamental contributions in models relevant to physiological systems, control engineering. He has a honor of being fellow of Pakistan Academy of Sciences, Third World Academy of Sciences (TWAS) and Islamic World Academy of Sciences in the mathematical Sciences. His publications in diverse areas are in high impact factor journals. His research work has total ISI WEB citations (11730) and hindex (52) at present. He has received many national and international awards including Tamgha-i-Imtiaz, Sitara-i-Imtiaz, Khwarizmi Int. award, ISESCO Int. award, TWAS prize for young scientists, Alexander-Von-Humboldt fellowship etc.
Rights and permissions
About this article
Cite this article
Ding, F., Meng, D., Dai, J. et al. Least Squares based Iterative Parameter Estimation Algorithm for Stochastic Dynamical Systems with ARMA Noise Using the Model Equivalence. Int. J. Control Autom. Syst. 16, 630–639 (2018). https://doi.org/10.1007/s12555-017-0001-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12555-017-0001-x