Abstract
This paper presents a new game theory based method to control multi-agent systems under directed and time varying interaction topology. First, the sensing/communication matrix is introduced to cope with information sharing among agents, and to provide the minimal information requirement which ensures the system level objective is desirable. Second, different from traditional methods of controlling multi-agent systems, non-cooperative games are investigated to enforce agents to make rational decisions. And a new game model, termed stochastic weakly acyclic game, is developed to capture the optimal solution to the distributed optimization problem for multi-agent systems with directed topology. It is worth noting that the system level objective can be achieved at the points of the corresponding equilibriums of the new game model. The proposed method is illustrated with an example in smart grid where multiple distributed generators are controlled to reach the fair power utilization profile in the game formulation to ensure the aggregated power output are optimal.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Y. Liu and Y. M. Jia, “Formation control of discrete time multi-agent systems by iterative learning approach,” International Journal of Control, Automation and Systems, vol. 10, no. 5, pp. 913–919, October 2012.
K. Y. You and L. H. Xie, “Network topology and communication data rate for consensusability of discrete-time multi-agent systems,” IEEE Trans. on Automatic Control, vol. 56, no. 10, pp. 2262–2275, October 2011.
X. H. Wang and H. B. Ji, “Leader-follower consensus for a class of nonlinear multi-agent systems,” International Journal of Control, Automation and Systems, vol. 10, no. 1, pp. 27–35, February 2012.
W. Ren and R. W. Beard, “Consensus seeking in multiagent systems under dynamically changing interaction topologies,” IEEE Trans. on Automatic Control, vol. 50, no. 5, pp. 655–661, May 2005.
C. Y. Li and Z. H. Qu, “Distributed estimation of algebraic connectivity of directed networks,” Systems & Control Letters, vol. 62, no. 6, pp. 517–524, April 2013.
J. A. Fax and R. M. Murray, “Information flow and cooperative control of vehicle formations,” IEEE Trans. on Automatic Control, vol. 49, no. 9, pp. 1465–1476, September 2004.
Z. H. Qu, J. Wang, and R. A. Hull, “Cooperative control of dynamical systems with application to autonomous vehicles,” IEEE Trans. on Automatic Control, vol. 53, no. 4, pp. 894–911, May 2008.
H. H. Xin, Z. H. Qu, J. Seuss, and A. Maknunineijad, “A self organizing strategy for power flow control of photovoltaic generators in a distribution network,” IEEE Trans. on Power Systems, vol. 26, no. 3, pp. 1462–1473, August 2011.
H. H. Xin, D. Q. Gan, N. Li, and C. Dai, “A virtual power plant based distributed control strategy for multiple distributed generators,” IET Control Theory & Applications, vol. 7, no. 1, pp. 90–98, January 2013.
J. R. Marden, G. Arslan, and J. S. Shamma, “Cooperative control and potential games,” IEEE Trans. on Systems Man and Cybernetics Part BCybernetics, vol. 39, no. 6, pp. 1393–1407, December 2009.
D. Monderer and L. S. Shapley, “Potential games,” Games and Economic Behavior, vol. 14, no. 1, pp. 124–143, May 1996.
D. Fudenberg and D. K. Levine, The Theory of ai]Learning in Games, MIT Press Cambridge, MA, 1998.
G. Arslan, J. R. Marden, and J. S. Shamma, “Autonomous vehicle target assignment: a game theoretical formulation,” ASME Journal of Dynamic Systems, Measurement and Control, vol. 129, no. 5, pp. 584–596, September 2007.
N. Li and J. R. Marden, “Designing games to handle coupled constraints,” Proc. of the 49th Conf. Decision and Control, pp. 250–255, December 2010.
J. R. Marden, G. Arslan, and J. S. Shamma, “Joint strategy fictitious play with inertia for potential games,” IEEE Trans. on Automatic Control, vol. 54, no. 2, pp. 208–220, February 2009.
J. R. Marden, H. P. Young, G. Arslan, and J. S. Shamma, “Payoff-based dynamics for multiplayer weakly acyclic games,” SIAM Journal on Control and Optimization, vol. 48, no. 1, pp. 373–396, February 2009.
A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis, “On distributed averaging algorithms and quantization effects,” IEEE Trans. on Automatic Control, vol. 54, no. 11, pp. 2506–2517, November 2009.
I. Lobel and A. Ozdaglar, “Distributed subgradient methods for convex optimization over random networks,” IEEE Trans. on Automatic Control, vol. 56, no. 6, pp. 1291–1306, June 2011.
H. P. Young, “Learning by trial and error,” Games and Economic Behavior, vol. 65, no. 2, pp. 626–643, March 2009.
H. P. Young, Strategic Learning and Its Limits, Oxford University Press Oxford, UK, 2004.
J. R. Marden and A. Wierman, “Overcoming the limitations of utility design for multiagent systems,” IEEE Trans. on Automatic Control, vol. 58, no. 6, pp. 1402–1415, June 2013.
N. Li and J. R. Marden, “Designing games for distributed optimization,” Proc. of the 50th IEEE Conf. Decision and Control and European Control Conf., pp. 2434–2440, December 2011.
J. R. Marden, “State based potential games,” Automatica, vol. 48, no. 12, pp. 3075–3088, December 2012.
Z. Qu, Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles, Springer Verlag London, 2009.
L. S. Shapley, “Stochastic games,” Proc. of National ai]Academy of Sciences of the United States of America, vol. 39, no. 10, pp. 1095–1100, October 1953.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, Jl., Qi, Dl. & Yu, M. A game theoretic approach for the distributed control of multi-agent systems under directed and time-varying topology. Int. J. Control Autom. Syst. 12, 749–758 (2014). https://doi.org/10.1007/s12555-013-0377-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12555-013-0377-1