Abstract
Automatic learning techniques stand as promising tools to respond to the need of higher efficiency of traffic network, even more so at times of mounting pressure from economic and energy markets. To this end, this paper looks into the operation of a traffic network with distributed, intelligent agents. In particular, it casts the task of operating a traffic network as a distributed, stochastic game in which the agents solve reinforcement-learning problems. Results from computational experiments show that these agents can yield substantial gains with respect to the performance achieved by two other control policies for traffic lights. The paper ends with an outline of future research to deploy machine-learning technology in real-world traffic networks.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Basar, T., Olsder, G.J.: Dynamic Noncooperative Game Theory. Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania (1999)
Bertsekas, D.P.: Dynamic Programming and Optimal Control. Athena Scientific, Belmont (1995)
Bowling, M., Veloso, M.M.: Existence of multiagent equilibria with limited agents. Technical Report CMU-CS-02-104, Computer Science Department, Carnegie Mellon University, Pittsburgh, Pennsylvania (2002)
Camponogara, E.: Altruistic agents in dynamic games. In: Bittencourt, G., Ramalho, G.L. (eds.) SBIA 2002. LNCS (LNAI), vol. 2507, pp. 74–84. Springer, Heidelberg (2002)
Crabtree, M.R., Vincent, R.A., Harrison, S.: Transyt 10 User’s Guide: TRRL Application Guide 28. Technical Report, Transport and Road Research Laboratory, Crawthorne, England (1996)
Gazis, D.C.: Traffic Theory. Kluwer Academic Publishers, Boston (2002)
Hunt, P.B., Robertson, D.I., Bretherton, R.D., Winton, R.I.: SCOOT - a traffic responsive method of coordinating signals. Technical Report, Transport and Road Research Laboratory, Crowthorne, England (1981)
Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. Journal of Artificial Intelligence Research 4, 237–285 (1996)
Schneider, J., Wong, W.-W., Moore, A.W., Riedmiller, M.: Distributed value functions. In: Proceedings of the 16th International Conference on Machine Learning, Bled, Slovenia, pp. 371–378 (1999)
Sutton, R.S., Barto, A.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Camponogara, E., Kraus, W. (2003). Distributed Learning Agents in Urban Traffic Control. In: Pires, F.M., Abreu, S. (eds) Progress in Artificial Intelligence. EPIA 2003. Lecture Notes in Computer Science(), vol 2902. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24580-3_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-24580-3_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20589-0
Online ISBN: 978-3-540-24580-3
eBook Packages: Springer Book Archive