Abstract
We present a novel Dynamic Bayesian Network for pedestrian path prediction in the intelligent vehicle domain. The model incorporates the pedestrian situational awareness, situation criticality and spatial layout of the environment as latent states on top of a Switching Linear Dynamical System (SLDS) to anticipate changes in the pedestrian dynamics. Using computer vision, situational awareness is assessed by the pedestrian head orientation, situation criticality by the distance between vehicle and pedestrian at the expected point of closest approach, and spatial layout by the distance of the pedestrian to the curbside. Our particular scenario is that of a crossing pedestrian, who might stop or continue walking at the curb. In experiments using stereo vision data obtained from a vehicle, we demonstrate that the proposed approach results in more accurate path prediction than only SLDS, at the relevant short time horizon (1 s), and slightly outperforms a computationally more demanding state-of-the-art method.
Chapter PDF
Similar content being viewed by others
Keywords
References
Abbeel, P., Coates, A., Montemerlo, M., Ng, A.Y., Thrun, S.: Discriminative training of Kalman filters. In: Robotics: Science and Systems, pp. 289–296 (2005)
Antonini, G., Martinez, S.V., Bierlaire, M., Thiran, J.P.: Behavioral priors for detection and tracking of pedestrians in video sequences. IJCV 69(2), 159–180 (2006)
Ba, S., Odobez, J.: Multiperson visual focus of attention from head pose and meeting contextual cues. IEEE PAMI 33(1), 101–116 (2011)
Bandyopadhyay, T., Won, K., Frazzoli, E., Hsu, D., Lee, W., Rus, D.: Intention-aware motion planning. In: Algorithmic Foundations of Robotics X, pp. 475–491. Springer (2013)
Benfold, B., Reid, I.: Guiding visual surveillance by tracking human attention. In: Proc. BMVC (2009)
Bishop, C.M.: Pattern Recognition and Machine Learning, vol. 1. Springer (2006)
Blackman, S., Popoli, R.: Design and Analysis of Modern Tracking Systems. Artech House Norwood (1999)
Boyen, X., Koller, D.: Tractable inference for complex stochastic processes. In: Proc. of UAI, pp. 33–42. Morgan Kaufmann Publishers Inc. (1998)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proc. CVPR, pp. 886–893. IEEE (2005)
Dollár, P., Wojek, C., Schiele, B., Perona, P.: Pedestrian detection: An evaluation of the state of the art. IEEE PAMI 34(4), 743–761 (2012)
Duda, R.O., Hart, P.E.: Use of the Hough transformation to detect lines and curves in pictures. Commun. ACM 15(1), 11–15 (1972)
Enzweiler, M., Gavrila, D.M.: Monocular pedestrian detection: Survey and experiments. IEEE PAMI 31(12), 2179–2195 (2009)
Enzweiler, M., Gavrila, D.M.: Integrated pedestrian classification and orientation estimation. In: Proc. CVPR, pp. 982–989. IEEE (2010)
Flohr, F., Dumitru-Guzu, M., Kooij, J.F.P., Gavrila, D.M.: Joint probabilistic pedestrian head and body orientation estimation. In: IEEE Intell. Veh. (2014)
Hamaoka, H., Hagiwara, T., Tada, M., Munehiro, K.: A study on the behavior of pedestrians when confirming approach of right/left-turning vehicle while crossing a crosswalk. In: IEEE Intell. Veh., pp. 106–110 (2013)
Helbing, D., Molnár, P.: Social force model for pedestrian dynamics. Phys. Rev. E 51(5), 4282 (1995)
Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. IEEE PAMI 30(2), 328–341 (2008)
Keller, C.G., Gavrila, D.M.: Will the pedestrian cross? A study on pedestrian path prediction. IEEE Trans. ITS 15(2), 494–506 (2014)
Kitani, K.M., Ziebart, B.D., Bagnell, J.A., Hebert, M.: Activity forecasting. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 201–214. Springer, Heidelberg (2012)
Köhler, S., Schreiner, B., Ronalter, S., Doll, K., Brunsmann, U., Zindler, K.: Autonomous evasive maneuvers triggered by infrastructure-based detection of pedestrian intentions. In: IEEE Intell. Veh., pp. 519–526 (2013)
Kooij, J.F.P., Englebienne, G., Gavrila, D.M.: A non-parametric hierarchical model to discover behavior dynamics from tracks. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VI. LNCS, vol. 7577, pp. 270–283. Springer, Heidelberg (2012)
Lauritzen, S.L.: Propagation of probabilities, means, and variances in mixed graphical association models. Journal of the American Statistical Association 87(420), 1098–1108 (1992)
Meinecke, M.M., Obojski, M., Gavrila, D.M., Marc, E., Morris, R., Töns, M., Lettelier, L.: Strategies in terms of vulnerable road user protection. In: EU Project SAVE-U, Deliverable D6 (2003)
Meuter, M., Iurgel, U., Park, S.B., Kummert, A.: Unscented Kalman filter for pedestrian tracking from a moving host. In: IEEE Intell. Veh., pp. 37–42 (2008)
Minka, T.P.: Expectation propagation for approximate Bayesian inference. In: Proc. of UAI, pp. 362–369. Morgan Kaufmann Publishers Inc. (2001)
Oh, S.M., Rehg, J.M., Balch, T., Dellaert, F.: Learning and inferring motion patterns using parametric segmental switching linear dynamic systems. IJCV 77(1-3), 103–124 (2008)
Pavlovic, V., Rehg, J.M., MacCormick, J.: Learning switching linear models of human motion. In: Advances in NIPS, pp. 981–987 (2000)
Pellegrini, S., Ess, A., Schindler, K., Van Gool, L.: You’ll never walk alone: Modeling social behavior for multi-target tracking. In: Proc. ICCV, pp. 261–268 (2009)
Rosti, A.V.I., Gales, M.J.F.: Rao-Blackwellised Gibbs sampling for switching linear dynamical systems. In: Proc. of the IEEE ICASSP, vol. 1, pp. 809–812 (2004)
Schneider, N., Gavrila, D.M.: Pedestrian path prediction with recursive Bayesian filters: A comparative study. In: Weickert, J., Hein, M., Schiele, B. (eds.) GCPR 2013. LNCS, vol. 8142, pp. 174–183. Springer, Heidelberg (2013)
Schreiber, M., Knöppel, C., Franke, U.: LaneLoc: Lane marking based localization using highly accurate maps. In: IEEE Intell. Veh., pp. 449–454 (2013)
Tamura, Y., Le, P.D., Hitomi, K., Chandrasiri, N., Bando, T., Yamashita, A., Asama, H.: Development of pedestrian behavior model taking account of intention. In: IEEE IROS, pp. 382–387 (2012)
Wöhler, C., Anlauf, J.K.: A time delay neural network algorithm for estimating image-pattern shape and motion. IVC 17(3-4), 281–294 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
1 Electronic Supplementary Material
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Kooij, J.F.P., Schneider, N., Flohr, F., Gavrila, D.M. (2014). Context-Based Pedestrian Path Prediction. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8694. Springer, Cham. https://doi.org/10.1007/978-3-319-10599-4_40
Download citation
DOI: https://doi.org/10.1007/978-3-319-10599-4_40
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10598-7
Online ISBN: 978-3-319-10599-4
eBook Packages: Computer ScienceComputer Science (R0)