Abstract
Mean-field dynamic systems are used to model collective behaviors among multi-agent systems. Different choices of interaction policies among agents lead to understandings of attraction behavior, alignment behavior and so on. Such systems are highly nonlinear, which hinders the further development of control strategies for them. In this paper, a geometric description of the mean-field optimal control problem is considered and the corresponding optimality conditions are derived following the Euler-Poincaré theory for ideal continuum motions. Comparing to Pontryagin maximum principle and Hamilton-Jacobi-Bellman strategies, our approach results in multiplier-free optimality conditions, which reduces computational complexities. To show its effectiveness, we numerically demonstrate a scenario where a multi-agent system splits from one cluster into two clusters.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Burger, M., Di Francesco, M., Markowich, P., Wolfram, M.-T.: Mean field games with nonlinear mobilities in pedestrian dynamics. arXiv preprint arXiv:1304.5201 (2013)
Perthame, B.: Transport Equations in Biology. FM. Springer, Heidelberg (2006). https://doi.org/10.1007/978-3-7643-7842-4
Cucker, F., Smale, S.: Emergent behavior in flocks. IEEE Trans. Autom. Control 52(5), 852–862 (2007)
Carrillo, J.A., Choi, Y.-P., Hauray, M.: The derivation of swarming models: mean-field limit and Wasserstein distances. In: Muntean, A., Toschi, F. (eds.) Collective Dynamics from Bacteria to Crowds. CICMS, vol. 553, pp. 1–46. Springer, Vienna (2014). https://doi.org/10.1007/978-3-7091-1785-9_1
Burger, M., Haškovec, J., Wolfram, M.-T.: Individual based and mean-field modeling of direct aggregation. Physica D:Nonlinear Phenomena 260, 145–158 (2013)
Fornasier, M., Solombrino, F.: Mean-field optimal control. ESAIM Control Optim. Calculus Variations 20(4), 1123–1152 (2014)
Albi, G., Choi, Y.-P., Fornasier, M., Kalise, D.: Mean field control hierarchy. Appl. Math. Optim. 76(1), 93–135 (2017)
Lauriere, M., Pironneau, O.: Dynamic programming for mean-field type control. J. Optim. Theory Appl. 169(3), 902–924 (2016)
Holm, D., Schmah, T., Stoica, C.: Geometric Mechanics and Symmetry: From Finite to Infinite Dimensions. Oxford University Press, Oxford (2009)
Mesbahi, M., Egerstedt, M.: Graph Theoretic Methods in Multiagent Networks. Princeton University Press, Princeton (2010)
Benamou, J.-D., Brenier, Y.: A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem. Numer. Math. 84(3), 375–393 (2000)
Peyré, G.: The numerical tours of signal processing. Comput. Sci. Eng. 13(4), 94–97 (2011)
Papadakis, N., Peyré, G., Oudet, E.: Optimal transport with proximal splitting. SIAM J. Imaging Sci. 7(1), 212–238 (2014)
Chen, Y., Georgiou, T.T., Pavon, M.: Steering the distribution of agents in mean-field games system. J. Optim. Theory Appl. 179(1), 332–357 (2018). https://doi.org/10.1007/s10957-018-1365-7
Lee, J.M.: Introduction to Riemannian Manifolds. GTM, vol. 176. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91755-9
Cui, J., Dieci, L., Zhou, H.: Time discretizations of Wasserstein-Hamiltonian flows. arXiv preprint arXiv:2006.09187 (2020)
Cui, J., Dieci, L., Zhou, H.: A continuation multiple shooting method for Wasserstein geodesic equation. arXiv preprint arXiv:2105.09502 (2021)
Acknowledgement
The authors thank the support from National Natural Science Foundation of China (Grant 11872107).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Liu, H., Shi, D. (2022). An Euler-Poincaré Approach to Mean-Field Optimal Control. In: Wu, M., Niu, Y., Gu, M., Cheng, J. (eds) Proceedings of 2021 International Conference on Autonomous Unmanned Systems (ICAUS 2021). ICAUS 2021. Lecture Notes in Electrical Engineering, vol 861. Springer, Singapore. https://doi.org/10.1007/978-981-16-9492-9_204
Download citation
DOI: https://doi.org/10.1007/978-981-16-9492-9_204
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-9491-2
Online ISBN: 978-981-16-9492-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)