Abstract
We present a novel non-parametric Bayesian model to jointly discover the dynamics of low-level actions and high-level behaviors of tracked people in open environments. Our model represents behaviors as Markov chains of actions which capture high-level temporal dynamics. Actions may be shared by various behaviors and represent spatially localized occurrences of a person’s low-level motion dynamics using Switching Linear Dynamics Systems. Since the model handles real-valued features directly, we do not lose information by quantizing measurements to ‘visual words’ and can thus discover variations in standing, walking and running without discrete thresholds. We describe inference using Gibbs sampling and validate our approach on several artificial and real-world tracking datasets. We show that our model can distinguish relevant behavior patterns that an existing state-of-the-art method for hierarchical clustering cannot.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Blei, D., Ng, A., Jordan, M.: Latent Dirichlet allocation. J. of Machine Learning Research 3, 993–1022 (2003)
Teh, Y.W., Jordan, M.I., Beal, M.J., Blei, D.M.: Hierarchical Dirichlet processes. The Journal of the Acoustical Society of America 101(476), 1566–1581 (2006)
Beal, M.J., Ghahramani, Z., Rasmussen, C.E.: The infinite hidden Markov model. In: Advances in Neural Information Processing Systems, vol. 1, pp. 577–584 (2002)
Fox, E., Sudderth, E., Jordan, M., Willsky, A.: Bayesian nonparametric inference of switching dynamic linear models. IEEE Trans. on Signal Processing 59(4), 1569–1585 (2011)
Rosti, A.V., Gales, M.J.F.: Rao-Blackwellised Gibbs sampling for switching linear dynamical systems. In: Proc. of the ICASSP, vol. 1, p. I–809 (2004)
Hospedales, T., Gong, S., Xiang, T.: A Markov clustering topic model for mining behaviour in video. In: Proc. of the IEEE ICCV, pp. 1165–1172 (2009)
Kuettel, D., Breitenstein, M., Van Gool, L., Ferrari, V.: What’s going on? Discovering spatiotemporal dependencies in dynamic scenes. In: Proc. of the IEEE CVPR, pp. 1951–1958 (2010)
Emonet, R., Varadarajan, J., Odobez, J.M.: Multi-camera open space human activity discovery for anomaly detection. In: Proc. of the IEEE AVSS, p. 6 (August 2011)
Varadarajan, J., Emonet, R., Odobez, J.M.: Probabilistic latent sequential motifs: Discovering temporal activity patterns in video scenes. In: Proc. of the BMVC (2010)
Fu, Z., Hu, W., Tan, T.: Similarity based vehicle trajectory clustering and anomaly detection. In: Proc. of the ICIP, vol. 2, p. II–602 (2005)
Wang, X., Tieu, K., Grimson, E.: Learning Semantic Scene Models by Trajectory Analysis. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part III. LNCS, vol. 3953, pp. 110–123. Springer, Heidelberg (2006)
Keogh, E., Pazzani, M.: Scaling up dynamic time warping for datamining applications. In: Proc. of the ACM SIGKDD, pp. 285–289 (2000)
Wang, X., Ma, K.T., Ng, G.W., Grimson, W.E.: Trajectory analysis and semantic region modeling using a nonparametric Bayesian model. In: Proc. of the IEEE CVPR, pp. 1–8 (2008)
Fernyhough, J., Cohn, A., Hogg, D.: Generation of Semantic Regions From Image Sequences. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065, pp. 475–484. Springer, Heidelberg (1996)
Makris, D., Ellis, T.: Automatic learning of an activity-based semantic scene model. In: Proc. of the IEEE AVSS, pp. 183–188 (2003)
Lin, D., Grimson, E., Fisher, J.: Learning visual flows: A Lie algebraic approach. In: Proc. of the IEEE CVPR, pp. 747–754 (2009)
Rauch, H., Tung, F., Striebel, C.: Maximum likelihood estimates of linear dynamic systems. AIAA Journal 3(8), 1445–1450 (1965)
Jensen, C., Kjærulff, U., Kong, A.: Blocking Gibbs sampling in very large probabilistic expert systems. International J. of Human Computer Studies 42(6), 647–666 (1995)
Liem, M., Gavrila, D.M.: Multi-person Localization and Track Assignment in Overlapping Camera Views. In: Mester, R., Felsberg, M. (eds.) DAGM 2011. LNCS, vol. 6835, pp. 173–183. Springer, Heidelberg (2011)
Pellegrini, S., Ess, A., Schindler, K., Van Gool, L.: You’ll never walk alone: Modeling social behavior for multi-target tracking. In: Proc. of the IEEE ICCV, pp. 261–268 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kooij, J.F.P., Englebienne, G., Gavrila, D.M. (2012). A Non-parametric Hierarchical Model to Discover Behavior Dynamics from Tracks. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33783-3_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-33783-3_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33782-6
Online ISBN: 978-3-642-33783-3
eBook Packages: Computer ScienceComputer Science (R0)