Abstract
This paper presents a new computational guidance algorithm based on the Model Predictive Path Integral (MPPI) control for missiles with the impact angle, seeker’s look angle, and acceleration constraints. The MPPI control is one of the optimization approaches using the stochastic process, and the optimal control input is determined using sample trajectories generated by propagating the system model. Thus, the MPPI control can be considered as a data-driven method for solving nonlinear and constrained optimization problems. The proposed guidance algorithm consists of the proportional navigation (PN) guidance command with a time-varying gain to be optimized at every guidance cycle by utilizing the iterative path integral technique in conjunction with the importance sampling under the model predictive control (MPC) philosophy. Unlike existing approaches, this approach allows us to effectively solve nonlinear guidance problems without the convexification or linearization process. It can also adapt to environmental changes by reflecting the current system state variables. Furthermore, unlike other computational guidance approaches, the proposed algorithm does not rely on a dedicated solver for optimization problems. In this study, numerical simulations are performed to investigate the effectiveness and applicability of the proposed guidance algorithm.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
P. Zarchan, Tactical and Strategic Missile Guidance, American Institute of Aeronautics and Astronautics, Inc., 2012.
B. S. Kim, J. G. Lee, and H. S. Han, “Biased PNG law for impact with angular constraint,” IEEE Transactions on Aerospace and Electronic Systems, vol. 34, no. 1, pp. 277–288, 1998.
K. S. Erer and O. Merttopçuoglu, “Indirect impact-angle-control against stationary targets using biased pure proportional navigation,” Journal of Guidance, Control, and Dynamics, vol. 35, no. 2, pp. 700–704, 2012.
C.-H. Lee, T.-H. Kim, and M.-J. Tahk, “Interception angle control guidance using proportional navigation with error feedback,” Journal of Guidance, Control, and Dynamics, vol. 36, no. 5, pp. 1556–1561, 2013.
A. Ratnoo and D. Ghose, “Impact angle constrained interception of stationary targets,” Journal of Guidance, Control, and Dynamics, vol. 31, no. 6, pp. 1817–1822, 2008.
R. Tekin and K. S. Erer, “Switched-gain guidance for impact angle control under physical constraints,” Journal of Guidance, Control, and Dynamics, vol. 38, no. 2, pp. 205–216, 2015.
S. He, C.-H. Lee, H.-S. Shin, and A. Tsourdos, Optimal Guidance and Its Applications in Missiles and UAVs, Springer, 2020.
C.-K. Ryoo, H.-J. Cho, and M.-J. Tahk, “Optimal guidance laws with terminal impact angle constraint,” Journal of Guidance, Control, and Dynamics, vol. 28, no. 4, pp. 724–732, 2005.
C.-K. Ryoo, H. Cho, and M.-J. Tahk, “Time-to-go weighted optimal guidance with impact angle constraints,” IEEE Transactions on Control Systems Technology, vol. 14, no. 3, pp. 483–492, 2006.
C.-H. Lee, M.-J. Tahk, and J.-I. Lee, “Generalized formulation of weighted optimal guidance laws with impact angle constraint,” IEEE Transactions on Aerospace and Electronic Systems, vol. 49, no. 2, pp. 1317–1322, 2013.
C.-H. Lee and M.-Y. Ryu, “Practical generalized optimal guidance law with impact angle constraint,” Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, vol. 233, no. 10, pp. 3790–3809, 2019.
C.-H. Lee and M.-G. Seo, “New insights into guidance laws with terminal angle constraints,” Journal of Guidance, Control, and Dynamics, vol. 41, no. 8, pp. 1832–1837, 2018.
C.-H. Lee, T.-H. Kim, and M.-J. Tahk, “Design of impact angle control guidance laws via high-performance sliding mode control,” Proc. of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, vol. 227, no. 2, pp. 235–253, 2013.
H.-B. Zhou, S.-M. Song, and J.-H. Song, “Design of sliding mode guidance law with dynamic delay and impact angle constraint,” International Journal of Control, Automation, and Systems, vol. 15, no. 1, pp. 239–247, 2017.
C. Ming and X. Wang, “Nonsingular terminal sliding mode control-based prescribed performance guidance law with impact angle constraints,” International Journal of Control, Automation, and Systems, vol. 20, no. 3, pp. 715–726, 2022.
S. R. Kumar, S. Rao, and D. Ghose, “Nonsingular terminal sliding mode guidance with impact angle constraints,” Journal of Guidance, Control, and Dynamics, vol. 37, no. 4, pp. 1114–1130, 2014.
R. Bardhan and D. Ghose, “Nonlinear differential games-based impact-angle-constrained guidance law,” Journal of Guidance, Control, and Dynamics, vol. 38, no. 3, pp. 384–402, 2015.
R. Tekin and F. Holzapfel, “Impact angle control based on feedback linearization,” Proc. of AIAA Guidance, Navigation, and Control Conference, p. 1509, 2017.
C. Wang, W. Dong, J. Wang, and J. Shan, “Nonlinear suboptimal guidance law with impact angle constraint: an SDRE-based approach,” IEEE Transactions on Aerospace and Electronic Systems, vol. 56, no. 6, pp. 4831–4840, 2020.
H.-G. Kim, J.-Y. Lee, and H. J. Kim, “Look angle constrained impact angle control guidance law for homing missiles with bearings-only measurements,” IEEE Transactions on Aerospace and Electronic Systems, vol. 54, no. 6, pp. 3096–3107, 2018.
K. S. Erer, R. Tekin, and M. K. Ozgoren, “Look angle constrained impact angle control based on proportional navigation,” Proc. of AIAA Guidance, Navigation, and Control Conference, 0091, 2015.
T.-H. Kim, B.-G. Park, and M.-J. Tahk, “Bias-shaping method for biased proportional navigation with terminalangle constraint,” Journal of Guidance, Control, and Dynamics, vol. 36, no. 6, pp. 1810–1816, 2013.
A. Ratnoo, “Analysis of two-stage proportional navigation with heading constraints,” Journal of Guidance, Control, and Dynamics, vol. 39, no. 1, pp. 156–164, 2016.
X. Liu, Z. Shen, and P. Lu, “Closed-loop optimization of guidance gain for constrained impact,” Journal of Guidance, Control, and Dynamics, vol. 40, no. 2, pp. 453–460, 2016.
P. Lu, “Introducing computational guidance and control,” 2017.
S. He, H.-S. Shin, and A. Tsourdos, “Computational missile guidance: A deep reinforcement learning approach,” Journal of Aerospace Information Systems, vol. 18, no. 8, pp. 571–582, 2021.
S. Boyd, S. P. Boyd, and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004.
Q. Zhang, Z. Gong, Z. Yang, and Z. Chen, “Distributed convex optimization for flocking of nonlinear multi-agent systems,” International Journal of Control, Automation, and Systems, vol. 17, no. 5, pp. 1177–1183, 2019.
X. Ping, S. Yang, B. Ding, T. Raissi, and Z. Li, “A convexity approach to dynamic output feedback robust MPC for lpv systems with bounded disturbances,” International Journal of Control, Automation, and Systems, vol. 18, no. 6, pp. 1378–1391, 2020.
J. Liu, W. Chen, and H. Dai, “Sampled-data based distributed convex optimization with event-triggered communication,” International Journal of Control, Automation and Systems, vol. 14, no. 6, pp. 1421–1429, 2016.
X. Liu, P. Lu, and B. Pan, “Survey of convex optimization for aerospace applications,” Astrodynamics, vol. 1, no. 1, pp. 23–40, 2017.
H. Ahn, J. Park, H. Bang, and Y. Kim, “Model predictive control-based multirotor three-dimensional motion planning with point cloud obstacle,” Journal of Aerospace Information Systems, pp. 1–15, 2021.
J. Bae, S.-D. Lee, Y.-W. Kim, C.-H. Lee, and S.-Y. Kim, “Convex optimization-based entry guidance for spaceplane,” International Journal of Control, Automation, and Systems, vol. 20, no. 5, pp. 1652–1670, 2022.
X. Liu, Z. Shen, and P. Lu, “Exact convex relaxation for optimal flight of aerodynamically controlled missiles,” IEEE Transactions on Aerospace and Electronic Systems, vol. 52, no. 4, pp. 1881–1892, 2016.
H.-H. Kwon and H.-L. Choi, “A convex programming approach to mid-course trajectory optimization for air-to-ground missiles,” International Journal of Aeronautical and Space Sciences, pp. 1–14, 2019.
K. Zhang, S. Yang, and F. Xiong, “Rapid ascent trajectory optimization for guided rockets via sequential convex programming,” Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, vol. 233, no. 13, pp. 4800–4809, 2019.
H. Roh, Y.-J. Oh, M.-J. Tahk, K.-J. Kwon, and H.-H. Kwon, “L1-penalized sequential convex programming for fast trajectory optimization: with application to optimal missile guidance,” International Journal of Aeronautical and Space Sciences, pp. 1–11, 2019.
G. Williams, N. Wagener, B. Goldfain, P. Drews, J. M. Rehg, B. Boots, and E. A. Theodorou, “Information theoretic mpc for model-based reinforcement learning,” Proc. of IEEE International Conference on Robotics and Automation (ICRA), pp. 1714–1721, IEEE, 2017.
H. J. Kappen, “An introduction to stochastic control theory, path integrals and reinforcement learning,” AIP Conference Proceedings, vol. 887, pp. 149–181, 2007.
G. Williams, A. Aldrich, and E. A. Theodorou, “Model predictive path integral control: From theory to parallel computation,” Journal of Guidance, Control, and Dynamics, vol. 40, no. 2, pp. 344–357, 2017.
G. Williams, E. Rombokas, and T. Daniel, “Gpu based path integral control with learned dynamics,” arXiv preprint arXiv:1503.00330, 2015.
G. Williams, P. Drews, B. Goldfain, J. M. Rehg, and E. A. Theodorou, “Aggressive driving with model predictive path integral control,” Proc. of IEEE International Conference on Robotics and Automation (ICRA), pp. 1433–1440, IEEE, 2016.
A. Buyval, A. Gabdullin, K. Sozykin, and A. Klimchik, “Model predictive path integral control for car driving with autogenerated cost map based on prior map and camera image,” Proc. of IEEE Intelligent Transportation Systems Conference (ITSC), pp. 2109–2114, IEEE, 2019.
J. Pravitra, E. Theodorou, and E. N. Johnson, “Flying complex maneuvers with model predictive path integral control,” PRoc. of AIAA Scitech 2021 Forum, 1957, 2021.
I. S. Mohamed, G. Allibert, and P. Martinet, “Model predictive path integral control framework for partially observable navigation: A quadrotor case study,” Proc. of 16th IEEE International Conference on Control, Automation, Robotics and Vision, ICARCV 2020, pp. 196–203, 2020.
V. Comandur and J. Prasad, “Rotorcraft shipboard landing guidance using MPPI trajectory optimization,” 2018.
C. Liang, W. Wang, Z. Liu, C. Lai, and B. Zhou, “Learning to guide: Guidance law based on deep meta-learning and model predictive path integral control,” IEEE Access, vol. 7, pp. 47353–47365, 2019.
C. Liang, W. Wang, Z. Liu, C. Lai, and S. Wang, “Range-aware impact angle guidance law with deep reinforcement meta-learning,” IEEE Access, vol. 8, pp. 152093–152104, 2020.
M.-Y. Ryu, C.-H. Lee, and M.-J. Tahk, “Command shaping optimal guidance laws against high-speed incoming targets,” Journal of Guidance, Control, and Dynamics, vol. 38, no. 10, pp. 2025–2033, 2015.
C.-H. Lee, H.-S. Shin, J.-I. Lee, and M.-J. Tahk, “Zero-effort-miss shaping guidance laws,” IEEE Transactions on Aerospace and Electronic Systems, vol. 54, no. 2, pp. 693–705, 2017.
C.-H. Lee, J.-I. Lee, and M.-J. Tahk, “Sinusoidal function weighted optimal guidance laws,” Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, vol. 229, no. 3, pp. 534–542, 2015.
J.-I. Lee, I.-S. Jeon, and C.-H. Lee, “Command-shaping guidance law based on a gaussian weighting function,” IEEE Transactions on Aerospace and Electronic Systems, vol. 50, no. 1, pp. 772–777, 2014.
E. Theodorou, J. Buchli, and S. Schaal, “A generalized path integral control approach to reinforcement learning,” The Journal of Machine Learning Research, vol. 11, pp. 3137–3181, 2010.
G. Williams, A. Aldrich, and E. Theodorou, “Model predictive path integral control using covariance variable importance sampling,” arXiv preprint arXiv:1509.01149, 2015.
A. Bryson and Y.-C. Ho, Applied Optimal Control, Hemisphere, New York, 1975.
P. Lu and F. Chavez, “Nonlinear optimal guidance,” Proc. of AIAA Guidance, Navigation, and Control Conference and Exhibit, 6079, 2006.
R. H. Byrd, M. E. Hribar, and J. Nocedal, “An interior point algorithm for large-scale nonlinear programming,” SIAM Journal on Optimization, vol. 9, no. 4, pp. 877–900, 1999.
D. Wei, W. Qiuqiu, X. Qunli, and Y. Shengjiang, “Multiple-constraint cooperative guidance based on two-stage sequential convex programming,” Chinese Journal of Aeronautics, vol. 33, no. 1, pp. 296–307, 2020.
E. D. Andersen, C. Roos, and T. Terlaky, “On implementing a primal-dual interior-point method for conic quadratic optimization,” Mathematical Programming, vol. 95, no. 2, pp. 249–277, 2003.
Author information
Authors and Affiliations
Corresponding author
Additional information
Conflict of Interest
The authors declare that there is no competing financial interest or personal relationship that could have appeared to influence the work reported in this paper.
Ki-Pyo Kim received his B.S. degree in electronic engineering from Kyung-book National University, Daegu, Korea, in 2002, and an M.S. degree in electronic engineering from Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea, in 2004. He is currently working toward a Ph.D. degree in the Department of Aerospace Engineering, Korea Advanced Institute of Science and Technology. Since 2004, he has been with the Agency for Defense Development (ADD), Daejeon, Korea. His current research interests include missile guidance and control.
Chang-Hun Lee received his B.S., M.S., and Ph.D. degrees in aerospace engineering from Korea Advanced Institute of Science and Technology (KAIST), in 2008, 2010, and 2013, respectively. From 2013 to 2015, he was a Senior Researcher for Guidance and Control Team, Agency for Defense Development (ADD), Daejeon, Korea. From 2016 to 2018, he was a Research Fellow for School of Aerospace, Transportation, and Manufacturing, Cranfield University, Bedford, United Kingdom. Since 2019, he has been with the Department of Aerospace Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Korea, where he is currently an Associate Professor. His recent research interests include advanced missile guidance and control, cooperative control for unmanned aerial vehicles, target tracking filter, deep learning, and aviation data analytics. Currently, he is technical editor of International Journal of Aeronautical and Space Science.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kim, KP., Lee, CH. Fixed Range Horizon MPPI-based Missile Computational Guidance for Constrained Impact Angle. Int. J. Control Autom. Syst. 21, 1866–1884 (2023). https://doi.org/10.1007/s12555-022-0660-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12555-022-0660-0