Abstract
This paper focuses on the identification of a multivariable controlled autoregressive-like (CAR-like) system. A joint identification algorithm of stochastic gradient and least squares is deduced for estimating the system parameters by decomposing the multivariable CAR-like system into two subsystems, which avoids the calculation of the matrix inversion. To further improve the parameter estimation accuracy, a joint identification algorithm of hierarchical multi-innovation stochastic gradient and least squares is proposed by using the multi-innovation identification theory. The simulation results confirm that these proposed algorithms are effective.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
J. Wang, Y. Ji, and C. Zhang, “Iterative parameter and order identification for fractional-order nonlinear finite impulse response systems using the key term separation,” International Journal of Adaptive Control and Signal Processing, vol. 35, no. 8, pp. 1562–1577, August 2021.
Y. Ji, Z. Kang, and X. Liu, “The data filtering based multiple-stage Levenberg-Marquardt algorithm for Hammerstein nonlinear systems,” International Journal of Robust and Nonlinear Control, vol. 31, no. 15, pp. 7007–7025, October 2021
M. Li and X. Liu, “Maximum likelihood least squares based iterative estimation for a class of bilinear systems using the data filtering technique,” International Journal of Control, Automation, and Systems, vol. 18, no. 6, pp. 1581–1592, June 2020.
M. Li and X. Liu, “Maximum likelihood hierarchical least squares-based iterative identification for dual-rate stochastic systems,” International Journal of Adaptive Control and Signal Processing, vol. 35, no. 2, pp. 240–261, 2021.
M. Li and X. Liu, “Iterative identification methods for a class of bilinear systems by using the particle filtering technique,” International Journal of Adaptive Control and Signal Processing, vol. 35, no. 10, pp. 2056–2074, 2021.
Y. Fan and X. Liu, “Two-stage auxiliary model gradient-based iterative algorithm for the input nonlinear controlled autoregressive system with variable-gain nonlinearity,” International Journal of Robust and Nonlinear Control, vol. 30, no. 14, pp. 5492–5509, September 2020.
X. Liu and Y. Fan, “Maximum likelihood extended gradient-based estimation algorithms for the input nonlinear controlled autoregressive moving average system with variable-gain nonlinearity,” International Journal of Robust and Nonlinear Control, vol. 31, no. 9, pp. 4017–4036, June 2021.
G. Chen, M. Gan, C. Chen, and H. Li, “A regularized variable projection algorithm for separable nonlinear least-squares problems,” IEEE Transactions on Automatic Control, vol. 64, no. 2, pp. 526–537, February 2019.
L. Xu, G. Song, “A recursive parameter estimation algorithm for modeling signals with multi-frequencies,” Circuits Systems and Signal Processing, vol. 39, no. 8, pp. 4198–4224, August 2020.
L. Xu, “Separable multi-innovation Newton iterative modeling algorithm for multi-frequency signals based on the sliding measurement window,” Circuits Systems and Signal Processing, vol. 41, no. 2, pp. 805–830, February 2022.
Y. Ji, C. Zhang, Z. Kang, and T. Yu, “Parameter estimation for block-oriented nonlinear systems using the key term separation,” International Journal of Robust and Nonlinear Control, vol. 30, no. 9, pp. 3727–3752, June 2020.
P. Ma and L. Wang, “Filtering-based recursive least squares estimation approaches for multivariate equation-error systems by using the multiinnovation theory,” International Journal of Adaptive Control and Signal Processing, vol. 35, no. 9, pp. 1898–1915, September 2021.
F. Ding, System Identification - Auxiliary Model Identification Idea and Methods, Science Press, Beijing, 2017.
Y. Ji, Z. Kang, and C. Zhang, “Two-stage gradient-based recursive estimation for nonlinear models by using the data filtering,” International Journal of Control, Automation, and Systems, vol. 19, no. 8, pp. 2706–2715, 2021.
Y. Ji, X. Jiang, and L. Wan, “Hierarchical least squares parameter estimation algorithm for two-input Hammerstein finite impulse response systems,” Journal of the Franklin Institute, vol. 357, no. 8, pp. 5019–5032, May 2020.
F. Ding, “Coupled-least-squares identification for multivariable systems,” IET Control Theory and Applications, vol. 7, no. 1, pp. 68–79, January 2013.
J. You, C. Yu, J. Sun, and J. Chen, “Generalized maximum entropy based identification of graphical ARMA models,” Automatica, vol. 141, p. 110319, 2022.
Y. Wang, “Novel data filtering based parameter identification for multiple-input multiple-output systems using the auxiliary model,” Automatica, vol. 71, pp. 308–313, September 2016.
C. Yu, Y. Li, H. Fang, and J. Chen, “System identification approach for inverse optimal control of finite-horizon linear quadratic regulators,” Automatica, vol. 129, 109636, 2021.
F. Ding, Y. Liu, and B. Bao, “Gradient based and least squares based iterative estimation algorithms for multi-input multi-output systems,” Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol. 226, no. 1, pp. 43–55, 2012.
T. Katayama and H. Ase, “Linear approximation and identification of MIMO Wiener-Hammerstein systems,” Automatica, vol. 71, pp. 118–124, September 2016.
F. Ding, System Identification - Hierarchical Identification Principle and Methods, Science Press, Beijing, 2024.
F. Ding and Y.J. Wang, “Hierarchical multi-innovation identification methods for multivariable equation-error-like type systems,” Journal of Nanjing University of Information Science and Technology (Natural Science Edition), vol. 6, no. 5, pp. 385–404, 2014.
F. Ding and T. Chen, “Hierarchical gradient-based identification of multivariable discrete-time systems,” Automatica, vol. 41, no. 2, pp. 315–325, February 2005.
F. Ding and T. Chen, “Hierarchical least squares identification methods for multivariable systems,” IEEE Transactions on Automatic Control, vol. 50, no. 3, pp. 397–402, March 2005.
Y. Ji, Z. Kang, and L. Xu, “Model recovery for multi-input signal-output nonlinear systems based on the compressed sensing recovery theory,” Journal of the Franklin Institute, vol. 359, no. 5, pp. 2317–2339, March 2022.
C. Zhang and Y. Ji, “Gradient parameter estimation of a class of nonlinear systems based on the maximum likelihood principle,” International Journal of Control, Automation, and Systems, vol. 20, no. 5, pp. 1393–1404, May 2022.
Y. Ji and Z. Kang, “Three-stage forgetting factor stochastic gradient parameter estimation methods for a class of non-linear systems,” International Journal of Robust and Nonlinear Control, vol. 31, no. 3, pp. 871–987, 2021.
L. Xu, “Separable Newton recursive estimation method through system responses based on dynamically discrete measurements with increasing data length,” International Journal of Control, Automation, and Systems, vol. 20, no. 2, pp. 432–443, February 2022.
L. Xu, “Auxiliary model multiinnovation stochastic gradient parameter estimation methods for nonlinear sandwich systems,” International Journal of Robust and Nonlinear Control, vol. 31, no. 1, pp. 148–165, January 2021.
J. Pan, S. Liu, and X. Wan, “Hierarchical recursive least squares estimation algorithm for secondorder Volterra nonlinear systems,” International Journal of Control, Automation, and Systems, vol. 20, no. 12, pp. 3940–3950, 2022.
X. Zhang, “Highly computationally efficient state filter based on the delta operator,” International Journal of Adaptive Control and Signal Processing, vol. 33, no. 6, pp. 875–889, June 2019.
J. Pan, Y. Liu, and J. Shu, “Gradient-based parameter estimation for an exponential nonlinear autoregressive time-series model by using the multi-innovation,” International Journal of Control, Automation, and Systems, vol. 21, no. 1, pp. 140–150, 2023.
X. Zhang, “State estimation for bilinear systems through minimizing the covariance matrix of the state estimation errors,” International Journal of Adaptive Control and Signal Processing, vol. 33, no. 7, pp. 1157–1173, July 2019.
Y. Wang, S. Tang, and X. Gu, “Parameter estimation for nonlinear Volterra systems by using the multi-innovation identification theory and tensor decomposition,” Journal of the Franklin Institute, vol. 359, no. 2, pp. 1782–1802, January 2022.
Y. Wang and L. Yang, “An efficient recursive identification algorithm for multilinear systems based on tensor decomposition,” International Journal of Robust and Nonlinear Control, vol. 31, no. 16, pp. 7920–7936, 2021.
X. Zhang, “Optimal adaptive filtering algorithm by using the fractional-order derivative,” IEEE Signal Processing Letters, vol. 29, pp. 399–403, 2022.
Y. Zhou, “Partially-coupled nonlinear parameter optimization algorithm for a class of multivariate hybrid models,” Applied Mathematics and Computation, vol. 414, p. 126663, Februray 2022.
S. Su, T. Tang, and Y. Wang, “Design of running grades for energy-efficient train regulation: A case study for beijing yizhuang line,” IEEE Intelligent Transportation Systems Magazine, vol. 13, no. 2, 189–200, February 2021.
Y. Cao, Z. Wang, and G. Xie, “Bio-inspired speed curve optimization and sliding mode tracking control for subway trains,” IEEE Transactions on Vehicular Technology, vol. 68, no. 7, pp. 6331–6342, July 2019.
Y. Cao, Y. Sun, and T. Wen, “Fault diagnosis of train plug door based on a hybrid criterion for IMFs selection and fractional wavelet package energy entropy,” IEEE Transactions on Vehicular Technology, vol. 68, no. 8, pp. 7544–7551, August 2019.
Y. Cao, L. Ma, and W. Xu, “Standard analysis for transfer delay in CTCS-3,” Chinese Journal of Electronics, vol. 26, no. 5, pp. 1057–1063, September 2017.
Y. Cao, J. Wen, and L. Ma, “Tracking and collision avoidance of virtual coupling train control system,” Alexandria Engineering Journal, vol. 60, no. 2, pp. 2115–2125, 2021.
S. Su, X. Wang, and J. Yin, “An energy-efficient train operation approach by integrating the metro timetabling and eco-driving,” IEEE Transactions on Intelligent Transportation Systems, vol. 21, no. 10, pp. 4252–4268, 2020.
F. Ding and T. Chen, “Combined parameter and output estimation of dual-rate systems using an auxiliary model,” Automatica, vol. 40, no. 10, pp. 1739–1748.
F. Ding, “Filtered auxiliary model recursive generalized extended parameter estimation methods for Box-Jenkins systems,” International Journal of Robust and Nonlinear Control, vol. 33, 2023. DOI: https://doi.org/10.1002/rnc.6657
J. Chen, “Modified Kalman filtering based multi-step-length gradient iterative algorithm for ARX models with random missing outputs,” Automatica, vol. 118, 109034, 2020.
Y. Wang, “Recursive parameter estimation algorithm for multivariate output-error systems,” Journal of the Franklin Institute, vol. 355, no. 12, pp. 5163–5181, 2018.
L. Xu, “Application of the Newton iteration algorithm to the parameter estimation for dynamical systems,” Journal of Computational and Applied Mathematics, vol. 288, pp. 33–43, November 2015.
L. J. Wan, “Decomposition- and gradient-based iterative identification algorithms for multivariable systems using the multi-innovation theory,” Circuits Systems and Signal Processing, vol. 38, no. 7, pp. 2971–2991, July 2019.
H. J. Wang, “Singularly degenerate heteroclinic cycles with nearby apple-shape attractors,” International Journal of Bifurcation and Chaos, vol. 33, no. 1, 2350011, 2023
L. Xu, “The damping iterative parameter identification method for dynamical systems based on the sine signal measurement,” Signal Processing, vol. 120, pp. 660–667, March 2016.
L. Xu, “Separable synchronous multi-innovation gradient-based iterative signal modeling from on-line measurements,” IEEE Transactions on Instrumentation and Measurement, vol. 71, 6501313, 2022.
J. Wang, Y. Ji, and L. Xu, “Two-stage gradient-based iterative algorithms for the fractional-order nonlinear systems by using the hierarchical identification principle,” International Journal of Adaptive Control and Signal Processing, vol. 36, no. 7, pp. 1778–1796, 2022.
Y. Zhou, “Hierarchical estimation approach for RBF-AR models with regression weights based on the increasing data length,” IEEE Transactions on Circuits and Systems-II: Express Briefs, vol. 68, no, 12, pp. 3597–3601, December 2021.
Z. Kang, Y. Ji, and X. Liu, “Hierarchical recursive least squares algorithms for Hammerstein nonlinear autoregressive output-error systems,” International Journal of Adaptive Control and Signal Processing, vol. 35, no. 11, pp. 2276–2295, November 2021.
Y. Zhou, “Modeling nonlinear processes using the radial basis function-based state-dependent autoregressive models,” IEEE Signal Processing Letters, vol. 27, pp. 1600–1604, 2020.
J. Ding and W. Zhang, “Finite-time adaptive control for nonlinear systems with uncertain parameters based on the command filters,” International Journal of Adaptive Control and Signal Processing, vol. 35, no. 9, pp. 1754–1767, September 2021.
X. Zhang, “Hierarchical parameter and state estimation for bilinear systems,’ International Journal of Systems Science, vol. 51, no. 2, 275–290, 2020.
Y. Cao, Y. Sun, and P. Li, “A sound-based fault diagnosis method for railway point machines based on two-stage feature selection strategy and ensemble classifier,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 8, pp. 12074–12083, 2022.
Y. Cao, J. Wen, and T. Wen, “Parameter-varying artificial potential field control of virtual coupling system with nonlinear dynamics,” Fractals, vol. 30, no. 2, 2240099, 2022.
X. Zhang, “Recursive identification of bilinear time-delay systems through the redundant rule,” Journal of the Franklin Institute, vol. 357, no. 1, pp. 726–747, 2020.
X. Zhang, “Adaptive parameter estimation for a general dynamical system with unknown states,” International Journal of Robust and Nonlinear Control, vol. 30, no. 4, pp. 1351–1372, March 2020.
Y. Cao, “Research on virtual coupled train control method based on GPC & VAPF,” Chinese Journal of Electronics, vol. 31, no. 5, pp. 897–905, 2022.
X. Zhang, “Recursive parameter estimation methods and convergence analysis for a special class of nonlinear systems,” International Journal of Robust and Nonlinear Control, vol. 30, no. 4, pp. 1373–1393, March 2020.
F. Ding, System Identification - Multi-Innovation Identification Theory and Methods, Science Press, Beijing, 2016.
F. Ding, “Least squares parameter estimation and multiinnovation least squares methods for linear fitting problems from noisy data,” Journal of Computational and Applied Mathematics, vol. 426, 115107, July 2023.
J. Xiong, J. Pan, and G. Chen, “Sliding mode dual-channel disturbance rejection attitude control for a quadrotor,” IEEE Transactions on Industrial Electronics, vol. 69, no. 10, pp. 10489–10499, October 2022.
J. Ding, “Hierarchical least squares identification for linear SISO systems with dual-rate sampled-data,” IEEE Transactions on Automatic Control, vol. 56, no. 11, pp. 2677–2683, November 2011.
J. Pan, Q. Chen, J. Xiong, and G. Chen, “A novel quadruple boost nine level switched capacitor inverter,” Journal of Electrical Engineering & Technology, vol. 18, pp. 467–480, 2023.
L. Xu, “Hierarchical recursive signal modeling for multi-frequency signals based on discrete measured data,” International Journal of Adaptive Control and Signal Processing, vol. 35, no. 5, pp. 676–693, May 2021.
C. Wei, “Overall recursive least squares and overall stochastic gradient algorithms and their convergence for feedback nonlinear controlled autoregressive systems,” International Journal of Robust and Nonlinear Control, vol. 32, no. 9, pp. 5534–5554, June 2020.
Author information
Authors and Affiliations
Corresponding author
Additional information
Jian Pan was born in Wuhan, China. He received his B.Sc. degree from Hubei University of Technology (Wuhan, China) in 1984. He has been a Professor in School of Electrical and Electronic Engineering, Hubei University of Technology. His research interests include control science and engineering, computer control systems, and power electronics.
Huijian Zhang was born in Xianning (Hubei Province, China) in 1999. He received his B.D. degree from Hubei University of Technology (Wuhan, China) in 2020. He is currently a Master student in the School of Electrical and Electronic Engineering, Hubei University of Technology. His interests include system identification and parameter estimation.
Hongzhan Guo was born in Yingshan (Hubei Province, China) in 1998. He received his B.Sc degree from Huanggang Normal University (Huanggang, China) in 2019. He is currently a master’s degree student in the School of Electrical and Electronic Engineering, Hubei University of Technology. His interests include system modeling and resonant converters.
Sunde Liu was born in Anqing, Anhui Province, China. He received his B.Sc. degree from the Jiangxi University of Science and Technology (Ganzhou, China) in 2018. He is now a master’s degree student at the Huibei University of Technology, Wuhan, China. His research interests include system identification and control theory.
Yuqing Liu was born in Xiangtan, Hunan Province, China. She received her B.Sc. degree from the Hunan Institute of Science and Technology (Yueyang, China) in 2019. She is now a master’s degree student at the Huibei University of Technology, Wuhan, China. Her research interests include nonlinear system identification and control theory.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was supported by the National Natural Science Foundation of China (No. 61571182).
Rights and permissions
About this article
Cite this article
Pan, J., Zhang, H., Guo, H. et al. Multivariable CAR-like System Identification with Multi-innovation Gradient and Least Squares Algorithms. Int. J. Control Autom. Syst. 21, 1455–1464 (2023). https://doi.org/10.1007/s12555-022-0253-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12555-022-0253-y