Abstract
The paper considers a guiding task in which a robot has to guide a person towards a destination. A robust operation requires to consider uncertain models on the person motion and intentions, as well as noise and occlusions in the sensors employed for the task. Partially Observable Markov Decision Processes (POMDPs) are used to model the task. The paper describes an enhancement on online POMDP solvers that allow to apply them to larger problems. The algorithm is used to control the robot in real-time for the guiding application. Results in simulation illustrate the approach.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
References
Ballesteros, J., Merino, L., Trujillo, M.A., Viguria, A., Ollero, A.: Improving the efficiency of online POMDPs by using belief similarity measures. In: Proc. International Conference on Robotics and Automation, ICRA (2013)
Bennewitz, M., Burgard, W., Cielniak, G., Thrun, S.: Learning motion patterns of people for compliant robot motion. I. J. Robotic Res. 24(1), 31–48 (2005)
Bonet, B., Geffner, H.: Solving pomdps: Rtdp-bel vs. point-based algorithms. In: Proceedings of the 21st International Jont Conference on Artifical Intelligence, IJCAI 2009, pp. 1641–1646. Morgan Kaufmann Publishers Inc., San Francisco (2009)
Capitan, J., Spaan, M., Merino, L., Ollero, A.: Decentralized Multi-Robot Cooperation with Auctioned POMDPs. The International Journal of Robotics Research 32, 650–671 (2013)
Feil-Seifer, D., Mataric, M.: People-aware navigation for goal-oriented behavior involving a human partner. In: Proceedings of the IEEE International Conference on Development and Learning, ICDL (2011)
He, R., Bachrach, A., Roy, N.: Efficient planning under uncertainty for a target-tracking micro-aerial vehicle. In: Proc. International Conference on Robotics and Automation, ICRA (2010)
Henry, P., Vollmer, C., Ferris, B., Fox, D.: Learning to navigate through crowded environments. In: ICRA 2010, pp. 981–986 (2010)
Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artificial Intelligence 101, 99–134 (1998)
Kurniawati, H., Hsu, D., Lee, W.: SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces. In: Proceedings of the Robotics: Science and Systems Conference, Zurich, Switzerland (2008)
Liwicki, S., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: Efficient online subspace learning with an indefinite kernel for visual tracking and recognition. IEEE Transactions on Neural Networks and Learning Systems 23, 1624–1636 (2012)
López, M., Bergasa, L., Barea, R., Escudero, M.: A navigation system for assistant robots using visually augmented POMDPs. Autonomous Robots 19(1), 67–87 (2005)
Luber, M., Tipaldi, G.D., Arras, K.O.: Place-Dependent People Tracking. International Journal of Robotics Research 30(3) (March 2011)
Merino, L., Gilbert, A., Capitan, J., Bowden, R., Illingworth, J., Ollero, A.: Data Fusion in Ubiquitous Networked Robot Systems for Urban Services. Annals of Telecommunications, Special Issue Ubiquitous Robots 67 (2012)
Ong, S., Png, S.W., Hsu, D., Lee, W.S.: POMDPs for Robotic Tasks with Mixed Observability. In: Proc. Robotics: Science and Systems, RSS (2009)
Papadimitriou, C., Tsitsiklis, J.N.: The complexity of markov decision processes. Mathematics of Operations Research 12(3), 441–450 (1987)
Perrin, X., Colas, F., Pradalier, C., Siegwart, R.: Learning to identify users and predict their destination in a robotic guidance application. In: Howard, A., Iagnemma, K., Kelly, A. (eds.) Field and Service Robotics. STAR, vol. 62, pp. 377–387. Springer, Heidelberg (2010)
Pineau, J., Gordon, G., Thrun, S.: Point-based value iteration: An anytime algorithm for POMDPs. In: Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJCAI), Acapulco, Mexico (2003)
Ross, S., Pineau, J., Paquet, S., Chaib-draa, B.: Online planning algorithms for POMDPs. Journal of Artificial Intelligence Research (2008)
Siegwart, R., Arras, K.O., Bouabdallah, S., Burnier, D., Froidevaux, G., Greppin, X., Jensen, B., Lorotte, A., Mayor, L., Meisser, M., Philippsen, R., Piguet, R., Ramel, G., Terrien, G., Tomatis, N.: Robox at Expo.02: A large-scale installation of personal robots. Robotics and Autonomous Systems 42(3-4), 203–222 (2003)
Smith, T., Simmons, R.: Heuristic search value iteration for POMDPs. In: Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, pp. 520–527. AUAI Press (2004)
Smith, T.: Probabilistic Planning for Robotic Exploration. Ph.D. thesis, The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA (July 2007)
Smith, T.: ZMDP software for POMDP and MDP planning (2012), http://www.cs.cmu.edu/~trey/zmdp/
Spaan, M.T.J., Vlassis, N.: Perseus: Randomized point-based value iteration for POMDPs. Journal of Artificial Intelligence Research 24, 195–220 (2005)
Taha, T., Miro, J.V., Dissanayake, G.: Pomdp-based long-term user intention prediction for wheelchair navigation. In: IEEE International Conference on Robotics and Automation, ICRA 2008, pp. 3920–3925 (2008)
Thompson, S., Horiuchi, T., Kagami, S.: A probabilistic model of human motion and navigation intent for mobile robot path planning. In: Gupta, G.S., Mukhopadhyay, S.C. (eds.) ICARA, pp. 663–668. IEEE (2009)
Thrun, S., Beetz, M., Bennewitz, M., Burgard, W., Cremers, A.B., Dellaert, F., Fox, D., Hahnel, C.: Probabilistic algorithms and the interactive museum tour-guide robot minerva. The International Journal of Robotics Research 19, 972–999 (2000)
Trautman, P., Krause, A.: Unfreezing the robot: Navigation in dense, interacting crowds. In: IROS, pp. 797–803. IEEE (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Merino, L., Ballesteros, J., Pérez-Higueras, N., Vigo, R.R., Pérez-Lara, J., Caballero, F. (2014). Robust Person Guidance by Using Online POMDPs. In: Armada, M., Sanfeliu, A., Ferre, M. (eds) ROBOT2013: First Iberian Robotics Conference. Advances in Intelligent Systems and Computing, vol 253. Springer, Cham. https://doi.org/10.1007/978-3-319-03653-3_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-03653-3_22
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03652-6
Online ISBN: 978-3-319-03653-3
eBook Packages: EngineeringEngineering (R0)