Abstract
Automated recognition of the behavior of robots is increasingly needed in a variety of tasks, as we develop more autonomous robots and general information processing agents. For example, in environments with multiple autonomous robots, a robot may need to make decisions based on the behavior of the other robots. As another interesting example, an intelligent narrator agent observing a robot will need to automatically identify the robot’s behaviors. In this paper, we introduce a novel framework for using Hidden Markov Models (HMMs) to represent and recognize strategic behaviors of robotic agents. We first introduce and characterize the perceived signal in terms of behavioral-relevant state features. We then show how several HMMs capture different defined robot behaviors Finally we present the HMM-based recognition algorithm which orchestrates and selects the appropriate HMMs in real time. We use the multi-robot robotic soccer domain as the substrate of our empirical validation, both in simulation and using real robots. Robots will then adapt their behaviors as a function of the autonomously recognized behavior of the other agents, either teammates or opponents.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
T. Balch and R.C. Arkin. Communication in reactive multiagent robotic systems. Autonomous Robots, 1(1), 1995.
Kim Binsted. Character design for soccer commentary. In Minoru Asada and Hiroaki Kitano, editors, RoboCup-98: Robot Soccer World Cup II. Springer Verlag, Berlin, 1999.
Mike Bowling, Peter Stone, and Manuela M. Veloso. Predictive memory for an inaccessible environment. In Working Notes of the IROS-96 Workshop on RoboCup, Osaka, Japan, November 1996.
Rodney A. Brooks. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, RA-2: 14–23, 1986.
Kwun Han and Manuela Veloso. Reactive visual control of multiple non-holonomic robotic agents. In Proceedings of the International Conference on Robotics and Automation, Leuven, Belgium, May 1998.
Yang J and et al. Hidden markov model approach to skill learnign and its applications to telerobotics. IEEE Transactions on Robotics and Automation, 10 (5): 621–631, October 1994.
Hiroaki Kitano, Milind Tambe, Peter Stone, Manuela Veloso, Silvia Coradeschi, Eiichi Osawa, Hitoshi Matsubara, Itsuki Noda, and Minoru Asada. The RoboCup synthetic agent challenge 97. In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, pages 24–29, San Francisco, CA, 1997. Morgan Kaufmann.
Christopher Lee and Yangsheng Xu. Online, interactive learning of gestures for human/robot interfaces. In IEEE International Conference on Robotics and Automation, pages 2982–2987, 1996.
Maja J. Mataric. Interaction and intelligent behavior. MIT EECS PhD Thesis AITR-1495, MIT AI Lab, August 1994.
L.R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. In Proceedings of the IEEE, volume 77, pages 257–86, 1989.
Milind Tambe. Agent architectures for flexible, practical teamwork. In Proceedings of AAAI-97, Menlo Park, California, 1997. AAAI Press.
Manuela Veloso, Peter Stone, and Kwun Han. CMUnited-97: RoboCup-97 small-robot world champion team. AI Magazine, 19 (3): 61–69, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag London
About this paper
Cite this paper
Han, K., Veloso, M. (2000). Automated Robot Behavior Recognition. In: Hollerbach, J.M., Koditschek, D.E. (eds) Robotics Research. Springer, London. https://doi.org/10.1007/978-1-4471-0765-1_30
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0765-1_30
Publisher Name: Springer, London
Print ISBN: 978-1-4471-1254-9
Online ISBN: 978-1-4471-0765-1
eBook Packages: Springer Book Archive